保全合成smoke、tiny随机基座适配器与两步IDM头,保留历史限制及逐张量映射
Browse files- retired-training/idm-step2/README.md +11 -0
- retired-training/idm-step2/SOURCE_TENSOR_MAPPING.json +567 -0
- retired-training/idm-step2/config.json +52 -0
- retired-training/idm-step2/head.safetensors +3 -0
- retired-training/synthetic-idm/README.md +9 -0
- retired-training/synthetic-idm/SOURCE_TENSOR_MAPPING.json +28 -0
- retired-training/synthetic-idm/smoke-400-step/config.json +54 -0
- retired-training/synthetic-idm/smoke-400-step/config.yaml +36 -0
- retired-training/synthetic-idm/smoke-400-step/gates_report.json +89 -0
- retired-training/synthetic-idm/smoke-400-step/gates_report.md +23 -0
- retired-training/synthetic-idm/smoke-400-step/model.safetensors +3 -0
- retired-training/synthetic-idm/smoke-400-step/train_log.jsonl +17 -0
- retired-training/synthetic-idm/smoke-600-step/config.json +53 -0
- retired-training/synthetic-idm/smoke-600-step/config.yaml +35 -0
- retired-training/synthetic-idm/smoke-600-step/gates_report.json +105 -0
- retired-training/synthetic-idm/smoke-600-step/gates_report.md +27 -0
- retired-training/synthetic-idm/smoke-600-step/model.safetensors +3 -0
- retired-training/synthetic-idm/smoke-600-step/train_log.jsonl +25 -0
- retired-training/tiny-vlm-smoke/NOTICE +1 -0
- retired-training/tiny-vlm-smoke/README.md +11 -0
- retired-training/tiny-vlm-smoke/SOURCE_MAPPING.json +37 -0
- retired-training/tiny-vlm-smoke/adapter_config.json +45 -0
- retired-training/tiny-vlm-smoke/adapter_model.safetensors +3 -0
- retired-training/tiny-vlm-smoke/config.yaml +26 -0
- retired-training/tiny-vlm-smoke/summary.json +5 -0
- retired-training/tiny-vlm-smoke/train_log.jsonl +5 -0
retired-training/idm-step2/README.md
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Historical two-step IDM checkpoint
|
| 2 |
+
|
| 3 |
+
This artifact preserves the action head from an early `ab-p0-cod-idm` checkpoint. The actual saved step is **2**, while the historical configuration targeted 6,000 steps. It is an early pipeline artifact, not a completed training run or a quality-certified model.
|
| 4 |
+
|
| 5 |
+
The saved configuration names `data/cod_attested`, the historical `dm1-attested` contract, 30 fps, five-frame windows and two held-out sessions. These are recorded experiment settings, not independent rights certification or new training authorization. No evaluation results are asserted here.
|
| 6 |
+
|
| 7 |
+
The export contains 58 F32 head tensors only. All 175 frozen DINOv2 ViT-S/14 trunk tensors were checked byte-for-byte against the project's existing base-tensor SHA index and omitted. The saved base revision was not recorded. Source ZIP CRC/SHA, each tensor SHA, finite-value checks and independent safetensors readback were verified without importing Torch or executing saved code.
|
| 8 |
+
|
| 9 |
+
The corresponding 6,000-step checkpoint is already publicly preserved in the WM01 research archive; it is represented through an exact source and tensor mapping instead of another copy.
|
| 10 |
+
|
| 11 |
+
Archived as an early pipeline checkpoint with the original configuration and limitations above.
|
retired-training/idm-step2/SOURCE_TENSOR_MAPPING.json
ADDED
|
@@ -0,0 +1,567 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"source_sha256": "c17f8c1205285a18627bfa391e8ed7de9840fc28666be0ecd7a708e84e334410",
|
| 3 |
+
"source_bytes": 98807879,
|
| 4 |
+
"step": 2,
|
| 5 |
+
"preserved_tensors": 58,
|
| 6 |
+
"omitted_frozen_tensors": 175,
|
| 7 |
+
"all_omitted_frozen_actual_tensor_sha_match": true,
|
| 8 |
+
"all_saved_tensor_bytes_roundtrip_verified": true,
|
| 9 |
+
"safetensors_bytes": 10495976,
|
| 10 |
+
"safetensors_sha256": "86ae4da4bb45e8c677b9537e07891497f20ee20a7b244790256e3a4ddeb458ae",
|
| 11 |
+
"tensors": {
|
| 12 |
+
"head.pos": {
|
| 13 |
+
"shape": [
|
| 14 |
+
1,
|
| 15 |
+
23,
|
| 16 |
+
256
|
| 17 |
+
],
|
| 18 |
+
"dtype": "F32",
|
| 19 |
+
"storage_name": "checkpoint.pt/data/175",
|
| 20 |
+
"size": 23552,
|
| 21 |
+
"sha256": "cd5b67e8c21de9a10c77c0d7cb3bee05ed38a391f817d45126f82d8fe830d7d2"
|
| 22 |
+
},
|
| 23 |
+
"head.frame_proj.weight": {
|
| 24 |
+
"shape": [
|
| 25 |
+
256,
|
| 26 |
+
384
|
| 27 |
+
],
|
| 28 |
+
"dtype": "F32",
|
| 29 |
+
"storage_name": "checkpoint.pt/data/176",
|
| 30 |
+
"size": 393216,
|
| 31 |
+
"sha256": "526aaab9abf245329ac01e99d11d9320ea1bcc6a74d1d006cfbed4643ca65b8e"
|
| 32 |
+
},
|
| 33 |
+
"head.frame_proj.bias": {
|
| 34 |
+
"shape": [
|
| 35 |
+
256
|
| 36 |
+
],
|
| 37 |
+
"dtype": "F32",
|
| 38 |
+
"storage_name": "checkpoint.pt/data/177",
|
| 39 |
+
"size": 1024,
|
| 40 |
+
"sha256": "8f543722af762023adace597c33281c621de7ba1f6881f00a2c02099db36f8de"
|
| 41 |
+
},
|
| 42 |
+
"head.motion.scale_emb": {
|
| 43 |
+
"shape": [
|
| 44 |
+
2,
|
| 45 |
+
1,
|
| 46 |
+
256
|
| 47 |
+
],
|
| 48 |
+
"dtype": "F32",
|
| 49 |
+
"storage_name": "checkpoint.pt/data/178",
|
| 50 |
+
"size": 2048,
|
| 51 |
+
"sha256": "3a1a51bddf375c88d990bf77072e6b52cce0aeba30a670ce57470fb70d19e6d5"
|
| 52 |
+
},
|
| 53 |
+
"head.motion.conv3d.weight": {
|
| 54 |
+
"shape": [
|
| 55 |
+
32,
|
| 56 |
+
2,
|
| 57 |
+
5,
|
| 58 |
+
5,
|
| 59 |
+
5
|
| 60 |
+
],
|
| 61 |
+
"dtype": "F32",
|
| 62 |
+
"storage_name": "checkpoint.pt/data/179",
|
| 63 |
+
"size": 32000,
|
| 64 |
+
"sha256": "e5e584a1f8394d780b19b0d40d8b8f6d508b46d981b511ac035ac0affcf7da4e"
|
| 65 |
+
},
|
| 66 |
+
"head.motion.conv3d.bias": {
|
| 67 |
+
"shape": [
|
| 68 |
+
32
|
| 69 |
+
],
|
| 70 |
+
"dtype": "F32",
|
| 71 |
+
"storage_name": "checkpoint.pt/data/180",
|
| 72 |
+
"size": 128,
|
| 73 |
+
"sha256": "0906b6cabdee450753f23821f1b51252c3d50c67415d012b927bf5112585618d"
|
| 74 |
+
},
|
| 75 |
+
"head.motion.net2d.1.weight": {
|
| 76 |
+
"shape": [
|
| 77 |
+
64,
|
| 78 |
+
32,
|
| 79 |
+
3,
|
| 80 |
+
3
|
| 81 |
+
],
|
| 82 |
+
"dtype": "F32",
|
| 83 |
+
"storage_name": "checkpoint.pt/data/181",
|
| 84 |
+
"size": 73728,
|
| 85 |
+
"sha256": "20e498ad9c9732c292b3e457f647072fb4bf05b870ba190aea46d1da2587eb17"
|
| 86 |
+
},
|
| 87 |
+
"head.motion.net2d.1.bias": {
|
| 88 |
+
"shape": [
|
| 89 |
+
64
|
| 90 |
+
],
|
| 91 |
+
"dtype": "F32",
|
| 92 |
+
"storage_name": "checkpoint.pt/data/182",
|
| 93 |
+
"size": 256,
|
| 94 |
+
"sha256": "122241558c661c2ab4f1e51978a25c3e5c8b84ff20dcdb79b299a05092fb3621"
|
| 95 |
+
},
|
| 96 |
+
"head.motion.net2d.3.weight": {
|
| 97 |
+
"shape": [
|
| 98 |
+
128,
|
| 99 |
+
64,
|
| 100 |
+
3,
|
| 101 |
+
3
|
| 102 |
+
],
|
| 103 |
+
"dtype": "F32",
|
| 104 |
+
"storage_name": "checkpoint.pt/data/183",
|
| 105 |
+
"size": 294912,
|
| 106 |
+
"sha256": "6efb642da1747c4e19e35246d708475368bd21592f6cf2063610d2d6d1c5c8c3"
|
| 107 |
+
},
|
| 108 |
+
"head.motion.net2d.3.bias": {
|
| 109 |
+
"shape": [
|
| 110 |
+
128
|
| 111 |
+
],
|
| 112 |
+
"dtype": "F32",
|
| 113 |
+
"storage_name": "checkpoint.pt/data/184",
|
| 114 |
+
"size": 512,
|
| 115 |
+
"sha256": "074bd5b34a7a211ce909cffb269f14e0f36e2c0c728a3b5e8c32c081bea45954"
|
| 116 |
+
},
|
| 117 |
+
"head.motion.proj.weight": {
|
| 118 |
+
"shape": [
|
| 119 |
+
256,
|
| 120 |
+
128
|
| 121 |
+
],
|
| 122 |
+
"dtype": "F32",
|
| 123 |
+
"storage_name": "checkpoint.pt/data/185",
|
| 124 |
+
"size": 131072,
|
| 125 |
+
"sha256": "dd80a308847ed507fa1d244c95e710eb98843de2e8a81aef8eeb9f15ca433337"
|
| 126 |
+
},
|
| 127 |
+
"head.motion.proj.bias": {
|
| 128 |
+
"shape": [
|
| 129 |
+
256
|
| 130 |
+
],
|
| 131 |
+
"dtype": "F32",
|
| 132 |
+
"storage_name": "checkpoint.pt/data/186",
|
| 133 |
+
"size": 1024,
|
| 134 |
+
"sha256": "17c551cb7adccf663a599a72bab2fab4f970bd8e6e2732dbff5ff96da2c0b305"
|
| 135 |
+
},
|
| 136 |
+
"head.encoder.layers.0.self_attn.in_proj_weight": {
|
| 137 |
+
"shape": [
|
| 138 |
+
768,
|
| 139 |
+
256
|
| 140 |
+
],
|
| 141 |
+
"dtype": "F32",
|
| 142 |
+
"storage_name": "checkpoint.pt/data/187",
|
| 143 |
+
"size": 786432,
|
| 144 |
+
"sha256": "d09007b07ca54bc526ff1baf0c99e626b2d9cb768f15c91104a75e87ee35c9ca"
|
| 145 |
+
},
|
| 146 |
+
"head.encoder.layers.0.self_attn.in_proj_bias": {
|
| 147 |
+
"shape": [
|
| 148 |
+
768
|
| 149 |
+
],
|
| 150 |
+
"dtype": "F32",
|
| 151 |
+
"storage_name": "checkpoint.pt/data/188",
|
| 152 |
+
"size": 3072,
|
| 153 |
+
"sha256": "1d64b19333a9225bf24d4fbb5ff65167cdf4b0389bd28f09d3576afcc952654d"
|
| 154 |
+
},
|
| 155 |
+
"head.encoder.layers.0.self_attn.out_proj.weight": {
|
| 156 |
+
"shape": [
|
| 157 |
+
256,
|
| 158 |
+
256
|
| 159 |
+
],
|
| 160 |
+
"dtype": "F32",
|
| 161 |
+
"storage_name": "checkpoint.pt/data/189",
|
| 162 |
+
"size": 262144,
|
| 163 |
+
"sha256": "38b9e98735fd6ccebd9570f8ff27dec68cf6bb2223ff3522dba0845e996890c0"
|
| 164 |
+
},
|
| 165 |
+
"head.encoder.layers.0.self_attn.out_proj.bias": {
|
| 166 |
+
"shape": [
|
| 167 |
+
256
|
| 168 |
+
],
|
| 169 |
+
"dtype": "F32",
|
| 170 |
+
"storage_name": "checkpoint.pt/data/190",
|
| 171 |
+
"size": 1024,
|
| 172 |
+
"sha256": "63355e893ca71178a6155ece0463888e13b33e53fc89c0067e99e5efd1e988c1"
|
| 173 |
+
},
|
| 174 |
+
"head.encoder.layers.0.linear1.weight": {
|
| 175 |
+
"shape": [
|
| 176 |
+
1024,
|
| 177 |
+
256
|
| 178 |
+
],
|
| 179 |
+
"dtype": "F32",
|
| 180 |
+
"storage_name": "checkpoint.pt/data/191",
|
| 181 |
+
"size": 1048576,
|
| 182 |
+
"sha256": "674ec1d1b402215678c597bb2268aa44e92ab1dfaec6517d02870c0835ae3a7f"
|
| 183 |
+
},
|
| 184 |
+
"head.encoder.layers.0.linear1.bias": {
|
| 185 |
+
"shape": [
|
| 186 |
+
1024
|
| 187 |
+
],
|
| 188 |
+
"dtype": "F32",
|
| 189 |
+
"storage_name": "checkpoint.pt/data/192",
|
| 190 |
+
"size": 4096,
|
| 191 |
+
"sha256": "ee2ab37f1be7cef7546c6737799e6a866637973d96c630ddd71e08340d5f39c7"
|
| 192 |
+
},
|
| 193 |
+
"head.encoder.layers.0.linear2.weight": {
|
| 194 |
+
"shape": [
|
| 195 |
+
256,
|
| 196 |
+
1024
|
| 197 |
+
],
|
| 198 |
+
"dtype": "F32",
|
| 199 |
+
"storage_name": "checkpoint.pt/data/193",
|
| 200 |
+
"size": 1048576,
|
| 201 |
+
"sha256": "6f27f580f9c10fda29801b46f48a1b6ae475ccde94a565fdfa3fac95a9b2a16a"
|
| 202 |
+
},
|
| 203 |
+
"head.encoder.layers.0.linear2.bias": {
|
| 204 |
+
"shape": [
|
| 205 |
+
256
|
| 206 |
+
],
|
| 207 |
+
"dtype": "F32",
|
| 208 |
+
"storage_name": "checkpoint.pt/data/194",
|
| 209 |
+
"size": 1024,
|
| 210 |
+
"sha256": "6dae2f9e0eb44aafb743f9a4ebc4a29b53ce7dd4eec5d5f1b5ebb7daefc14285"
|
| 211 |
+
},
|
| 212 |
+
"head.encoder.layers.0.norm1.weight": {
|
| 213 |
+
"shape": [
|
| 214 |
+
256
|
| 215 |
+
],
|
| 216 |
+
"dtype": "F32",
|
| 217 |
+
"storage_name": "checkpoint.pt/data/195",
|
| 218 |
+
"size": 1024,
|
| 219 |
+
"sha256": "0b0e3d1a7010b2962d937f7a099f9bc971ab27f67b7ebe4d0319549c16afa591"
|
| 220 |
+
},
|
| 221 |
+
"head.encoder.layers.0.norm1.bias": {
|
| 222 |
+
"shape": [
|
| 223 |
+
256
|
| 224 |
+
],
|
| 225 |
+
"dtype": "F32",
|
| 226 |
+
"storage_name": "checkpoint.pt/data/196",
|
| 227 |
+
"size": 1024,
|
| 228 |
+
"sha256": "3759c5b9aa364f142c69ab946839d8cc1bbf024147868080c4886f83b1ac7c6b"
|
| 229 |
+
},
|
| 230 |
+
"head.encoder.layers.0.norm2.weight": {
|
| 231 |
+
"shape": [
|
| 232 |
+
256
|
| 233 |
+
],
|
| 234 |
+
"dtype": "F32",
|
| 235 |
+
"storage_name": "checkpoint.pt/data/197",
|
| 236 |
+
"size": 1024,
|
| 237 |
+
"sha256": "0cab890775bc7892e959e03da961de33a6698d7a9f36ea8ee80523d51d45798a"
|
| 238 |
+
},
|
| 239 |
+
"head.encoder.layers.0.norm2.bias": {
|
| 240 |
+
"shape": [
|
| 241 |
+
256
|
| 242 |
+
],
|
| 243 |
+
"dtype": "F32",
|
| 244 |
+
"storage_name": "checkpoint.pt/data/198",
|
| 245 |
+
"size": 1024,
|
| 246 |
+
"sha256": "f9a3f0e45b393a8aed9036460cf6cb13f358e04f2aa8b8d6e07bf56bb860996e"
|
| 247 |
+
},
|
| 248 |
+
"head.encoder.layers.1.self_attn.in_proj_weight": {
|
| 249 |
+
"shape": [
|
| 250 |
+
768,
|
| 251 |
+
256
|
| 252 |
+
],
|
| 253 |
+
"dtype": "F32",
|
| 254 |
+
"storage_name": "checkpoint.pt/data/199",
|
| 255 |
+
"size": 786432,
|
| 256 |
+
"sha256": "300562b8fc3ab3c65cc0ff4bbd482f4049dc2f4bbfd00c9acc116582ab52e365"
|
| 257 |
+
},
|
| 258 |
+
"head.encoder.layers.1.self_attn.in_proj_bias": {
|
| 259 |
+
"shape": [
|
| 260 |
+
768
|
| 261 |
+
],
|
| 262 |
+
"dtype": "F32",
|
| 263 |
+
"storage_name": "checkpoint.pt/data/200",
|
| 264 |
+
"size": 3072,
|
| 265 |
+
"sha256": "58fd84235cff977e5d9f73d0dd5524bf170995c88d41d8ca895e1b8d7bfe45c5"
|
| 266 |
+
},
|
| 267 |
+
"head.encoder.layers.1.self_attn.out_proj.weight": {
|
| 268 |
+
"shape": [
|
| 269 |
+
256,
|
| 270 |
+
256
|
| 271 |
+
],
|
| 272 |
+
"dtype": "F32",
|
| 273 |
+
"storage_name": "checkpoint.pt/data/201",
|
| 274 |
+
"size": 262144,
|
| 275 |
+
"sha256": "f62457cce0ef381817fc269f84a2f7d61ee3410da8f71e305e8246c0959c5fb6"
|
| 276 |
+
},
|
| 277 |
+
"head.encoder.layers.1.self_attn.out_proj.bias": {
|
| 278 |
+
"shape": [
|
| 279 |
+
256
|
| 280 |
+
],
|
| 281 |
+
"dtype": "F32",
|
| 282 |
+
"storage_name": "checkpoint.pt/data/202",
|
| 283 |
+
"size": 1024,
|
| 284 |
+
"sha256": "0039167f197c484bacf479cab644547be2be5129b580f8ac4f810de1212f99bb"
|
| 285 |
+
},
|
| 286 |
+
"head.encoder.layers.1.linear1.weight": {
|
| 287 |
+
"shape": [
|
| 288 |
+
1024,
|
| 289 |
+
256
|
| 290 |
+
],
|
| 291 |
+
"dtype": "F32",
|
| 292 |
+
"storage_name": "checkpoint.pt/data/203",
|
| 293 |
+
"size": 1048576,
|
| 294 |
+
"sha256": "d9566955c091e5483f8b55d6a69e65794c1af8905ddb2e92c6261368511abccb"
|
| 295 |
+
},
|
| 296 |
+
"head.encoder.layers.1.linear1.bias": {
|
| 297 |
+
"shape": [
|
| 298 |
+
1024
|
| 299 |
+
],
|
| 300 |
+
"dtype": "F32",
|
| 301 |
+
"storage_name": "checkpoint.pt/data/204",
|
| 302 |
+
"size": 4096,
|
| 303 |
+
"sha256": "3c553fff2ca1f4188451b0e9d117a833271072ae1122135988ad173d22e5d81f"
|
| 304 |
+
},
|
| 305 |
+
"head.encoder.layers.1.linear2.weight": {
|
| 306 |
+
"shape": [
|
| 307 |
+
256,
|
| 308 |
+
1024
|
| 309 |
+
],
|
| 310 |
+
"dtype": "F32",
|
| 311 |
+
"storage_name": "checkpoint.pt/data/205",
|
| 312 |
+
"size": 1048576,
|
| 313 |
+
"sha256": "6c6b6a94de5a44a0cdf4eb69fc3f36a931437b1aba62e01734dd13edb76a0f7b"
|
| 314 |
+
},
|
| 315 |
+
"head.encoder.layers.1.linear2.bias": {
|
| 316 |
+
"shape": [
|
| 317 |
+
256
|
| 318 |
+
],
|
| 319 |
+
"dtype": "F32",
|
| 320 |
+
"storage_name": "checkpoint.pt/data/206",
|
| 321 |
+
"size": 1024,
|
| 322 |
+
"sha256": "997489410a1b90f09267d29657abe2c6d191234fc6cf660952bb82217d5f4d9e"
|
| 323 |
+
},
|
| 324 |
+
"head.encoder.layers.1.norm1.weight": {
|
| 325 |
+
"shape": [
|
| 326 |
+
256
|
| 327 |
+
],
|
| 328 |
+
"dtype": "F32",
|
| 329 |
+
"storage_name": "checkpoint.pt/data/207",
|
| 330 |
+
"size": 1024,
|
| 331 |
+
"sha256": "2a1007eff63d7866a88ccfc6be3701ada90db4d20819a7e647e187aa1c1a0327"
|
| 332 |
+
},
|
| 333 |
+
"head.encoder.layers.1.norm1.bias": {
|
| 334 |
+
"shape": [
|
| 335 |
+
256
|
| 336 |
+
],
|
| 337 |
+
"dtype": "F32",
|
| 338 |
+
"storage_name": "checkpoint.pt/data/208",
|
| 339 |
+
"size": 1024,
|
| 340 |
+
"sha256": "8e54b868d64c1ce21b138eca29fdb9d95634bcfbe63049f28cee958962114e73"
|
| 341 |
+
},
|
| 342 |
+
"head.encoder.layers.1.norm2.weight": {
|
| 343 |
+
"shape": [
|
| 344 |
+
256
|
| 345 |
+
],
|
| 346 |
+
"dtype": "F32",
|
| 347 |
+
"storage_name": "checkpoint.pt/data/209",
|
| 348 |
+
"size": 1024,
|
| 349 |
+
"sha256": "8a971a88a1fce9ae4e4c5e71415fe90d3b25a8e9a10e8882916548d458ba40b2"
|
| 350 |
+
},
|
| 351 |
+
"head.encoder.layers.1.norm2.bias": {
|
| 352 |
+
"shape": [
|
| 353 |
+
256
|
| 354 |
+
],
|
| 355 |
+
"dtype": "F32",
|
| 356 |
+
"storage_name": "checkpoint.pt/data/210",
|
| 357 |
+
"size": 1024,
|
| 358 |
+
"sha256": "738d9dbbd34b0fd138e3bf475f29a24b5346cccd8bb20188d0dda0d12888532c"
|
| 359 |
+
},
|
| 360 |
+
"head.encoder.layers.2.self_attn.in_proj_weight": {
|
| 361 |
+
"shape": [
|
| 362 |
+
768,
|
| 363 |
+
256
|
| 364 |
+
],
|
| 365 |
+
"dtype": "F32",
|
| 366 |
+
"storage_name": "checkpoint.pt/data/211",
|
| 367 |
+
"size": 786432,
|
| 368 |
+
"sha256": "a305e8a92e3ba0a34eb61fe581c655db140848c5890133e17531f0e6a287fb41"
|
| 369 |
+
},
|
| 370 |
+
"head.encoder.layers.2.self_attn.in_proj_bias": {
|
| 371 |
+
"shape": [
|
| 372 |
+
768
|
| 373 |
+
],
|
| 374 |
+
"dtype": "F32",
|
| 375 |
+
"storage_name": "checkpoint.pt/data/212",
|
| 376 |
+
"size": 3072,
|
| 377 |
+
"sha256": "ded33b79b493997868dd3141d72d4662fa93affd27ce02fd422e8d68520d83e5"
|
| 378 |
+
},
|
| 379 |
+
"head.encoder.layers.2.self_attn.out_proj.weight": {
|
| 380 |
+
"shape": [
|
| 381 |
+
256,
|
| 382 |
+
256
|
| 383 |
+
],
|
| 384 |
+
"dtype": "F32",
|
| 385 |
+
"storage_name": "checkpoint.pt/data/213",
|
| 386 |
+
"size": 262144,
|
| 387 |
+
"sha256": "64f2309d0954bc2fa009f74f91164d4c1cedcc6158aa1d75ff172093c2814b67"
|
| 388 |
+
},
|
| 389 |
+
"head.encoder.layers.2.self_attn.out_proj.bias": {
|
| 390 |
+
"shape": [
|
| 391 |
+
256
|
| 392 |
+
],
|
| 393 |
+
"dtype": "F32",
|
| 394 |
+
"storage_name": "checkpoint.pt/data/214",
|
| 395 |
+
"size": 1024,
|
| 396 |
+
"sha256": "b74468728a515e944ee21dc84f5c886e5858cd51957e896e1682f3d8d6a4d8b5"
|
| 397 |
+
},
|
| 398 |
+
"head.encoder.layers.2.linear1.weight": {
|
| 399 |
+
"shape": [
|
| 400 |
+
1024,
|
| 401 |
+
256
|
| 402 |
+
],
|
| 403 |
+
"dtype": "F32",
|
| 404 |
+
"storage_name": "checkpoint.pt/data/215",
|
| 405 |
+
"size": 1048576,
|
| 406 |
+
"sha256": "5804825c87668bb579fac76e20b08e994dba14699c3bbb1d906dd9f704033ef9"
|
| 407 |
+
},
|
| 408 |
+
"head.encoder.layers.2.linear1.bias": {
|
| 409 |
+
"shape": [
|
| 410 |
+
1024
|
| 411 |
+
],
|
| 412 |
+
"dtype": "F32",
|
| 413 |
+
"storage_name": "checkpoint.pt/data/216",
|
| 414 |
+
"size": 4096,
|
| 415 |
+
"sha256": "2f77f3c2c6605aba4db8e15d9032a8aa3302231eab6324dd29e0c6d32a2e5202"
|
| 416 |
+
},
|
| 417 |
+
"head.encoder.layers.2.linear2.weight": {
|
| 418 |
+
"shape": [
|
| 419 |
+
256,
|
| 420 |
+
1024
|
| 421 |
+
],
|
| 422 |
+
"dtype": "F32",
|
| 423 |
+
"storage_name": "checkpoint.pt/data/217",
|
| 424 |
+
"size": 1048576,
|
| 425 |
+
"sha256": "a405bfaea3173ace978fb3546d52daec7e11758acbfdd23b97f53acb046170a2"
|
| 426 |
+
},
|
| 427 |
+
"head.encoder.layers.2.linear2.bias": {
|
| 428 |
+
"shape": [
|
| 429 |
+
256
|
| 430 |
+
],
|
| 431 |
+
"dtype": "F32",
|
| 432 |
+
"storage_name": "checkpoint.pt/data/218",
|
| 433 |
+
"size": 1024,
|
| 434 |
+
"sha256": "63434bdec62618844c6b59432c30136a311f5a78df7adddc6cd79bfd33d4d882"
|
| 435 |
+
},
|
| 436 |
+
"head.encoder.layers.2.norm1.weight": {
|
| 437 |
+
"shape": [
|
| 438 |
+
256
|
| 439 |
+
],
|
| 440 |
+
"dtype": "F32",
|
| 441 |
+
"storage_name": "checkpoint.pt/data/219",
|
| 442 |
+
"size": 1024,
|
| 443 |
+
"sha256": "921b7c2c5a9fe245816e01e06156bcc4aa4c25df0dd7b706ae8df9765da73bff"
|
| 444 |
+
},
|
| 445 |
+
"head.encoder.layers.2.norm1.bias": {
|
| 446 |
+
"shape": [
|
| 447 |
+
256
|
| 448 |
+
],
|
| 449 |
+
"dtype": "F32",
|
| 450 |
+
"storage_name": "checkpoint.pt/data/220",
|
| 451 |
+
"size": 1024,
|
| 452 |
+
"sha256": "e9b7158312de21bc9c45ecda9ca5793b3b155865af254264d40836cf73f21720"
|
| 453 |
+
},
|
| 454 |
+
"head.encoder.layers.2.norm2.weight": {
|
| 455 |
+
"shape": [
|
| 456 |
+
256
|
| 457 |
+
],
|
| 458 |
+
"dtype": "F32",
|
| 459 |
+
"storage_name": "checkpoint.pt/data/221",
|
| 460 |
+
"size": 1024,
|
| 461 |
+
"sha256": "ec6d017a97622515f9fe31e968d2fe2a0126471a2690ad075dbe099612151692"
|
| 462 |
+
},
|
| 463 |
+
"head.encoder.layers.2.norm2.bias": {
|
| 464 |
+
"shape": [
|
| 465 |
+
256
|
| 466 |
+
],
|
| 467 |
+
"dtype": "F32",
|
| 468 |
+
"storage_name": "checkpoint.pt/data/222",
|
| 469 |
+
"size": 1024,
|
| 470 |
+
"sha256": "1d1937cc76af56df452b0a63f6179cd835988b91245d6a011573a176ee312290"
|
| 471 |
+
},
|
| 472 |
+
"head.norm.weight": {
|
| 473 |
+
"shape": [
|
| 474 |
+
256
|
| 475 |
+
],
|
| 476 |
+
"dtype": "F32",
|
| 477 |
+
"storage_name": "checkpoint.pt/data/223",
|
| 478 |
+
"size": 1024,
|
| 479 |
+
"sha256": "32c6954296e54f5a53b98886dc051a582a92af567581c1b62c96a1b6eaf392b1"
|
| 480 |
+
},
|
| 481 |
+
"head.norm.bias": {
|
| 482 |
+
"shape": [
|
| 483 |
+
256
|
| 484 |
+
],
|
| 485 |
+
"dtype": "F32",
|
| 486 |
+
"storage_name": "checkpoint.pt/data/224",
|
| 487 |
+
"size": 1024,
|
| 488 |
+
"sha256": "79054689d0d27ff691799819bb859d65fde4e0665ee6cf19d495838d79d1c8da"
|
| 489 |
+
},
|
| 490 |
+
"head.head_keys.weight": {
|
| 491 |
+
"shape": [
|
| 492 |
+
12,
|
| 493 |
+
256
|
| 494 |
+
],
|
| 495 |
+
"dtype": "F32",
|
| 496 |
+
"storage_name": "checkpoint.pt/data/225",
|
| 497 |
+
"size": 12288,
|
| 498 |
+
"sha256": "98dd9f5c080e342d236ed6e81781063f5c545ba323b28468e8acaab6f0942bf5"
|
| 499 |
+
},
|
| 500 |
+
"head.head_keys.bias": {
|
| 501 |
+
"shape": [
|
| 502 |
+
12
|
| 503 |
+
],
|
| 504 |
+
"dtype": "F32",
|
| 505 |
+
"storage_name": "checkpoint.pt/data/226",
|
| 506 |
+
"size": 48,
|
| 507 |
+
"sha256": "cb49a1e85c6558b29ee3efb439078ee9ab4daca4d206bf7f6aeda61149f42e60"
|
| 508 |
+
},
|
| 509 |
+
"head.head_bin_x.weight": {
|
| 510 |
+
"shape": [
|
| 511 |
+
21,
|
| 512 |
+
256
|
| 513 |
+
],
|
| 514 |
+
"dtype": "F32",
|
| 515 |
+
"storage_name": "checkpoint.pt/data/227",
|
| 516 |
+
"size": 21504,
|
| 517 |
+
"sha256": "7f8294ace06d4d7891f8b0f89f741a89f31792f3258a9a144becfd2cc27b17c8"
|
| 518 |
+
},
|
| 519 |
+
"head.head_bin_x.bias": {
|
| 520 |
+
"shape": [
|
| 521 |
+
21
|
| 522 |
+
],
|
| 523 |
+
"dtype": "F32",
|
| 524 |
+
"storage_name": "checkpoint.pt/data/228",
|
| 525 |
+
"size": 84,
|
| 526 |
+
"sha256": "b6391c7864b95cb6b611ee7bb4efae28b88d06168fa7d6c2100118ea9a21a435"
|
| 527 |
+
},
|
| 528 |
+
"head.head_bin_y.weight": {
|
| 529 |
+
"shape": [
|
| 530 |
+
21,
|
| 531 |
+
256
|
| 532 |
+
],
|
| 533 |
+
"dtype": "F32",
|
| 534 |
+
"storage_name": "checkpoint.pt/data/229",
|
| 535 |
+
"size": 21504,
|
| 536 |
+
"sha256": "d92ec76bc2cb81ccf950a8e8741018cfce7a81e1fc620bdc209f594391389364"
|
| 537 |
+
},
|
| 538 |
+
"head.head_bin_y.bias": {
|
| 539 |
+
"shape": [
|
| 540 |
+
21
|
| 541 |
+
],
|
| 542 |
+
"dtype": "F32",
|
| 543 |
+
"storage_name": "checkpoint.pt/data/230",
|
| 544 |
+
"size": 84,
|
| 545 |
+
"sha256": "b7aa7137f68938024751cae74894f6020c0f9c8bebd7ddda9612f6182dfcbdd0"
|
| 546 |
+
},
|
| 547 |
+
"head.head_delta.weight": {
|
| 548 |
+
"shape": [
|
| 549 |
+
2,
|
| 550 |
+
256
|
| 551 |
+
],
|
| 552 |
+
"dtype": "F32",
|
| 553 |
+
"storage_name": "checkpoint.pt/data/231",
|
| 554 |
+
"size": 2048,
|
| 555 |
+
"sha256": "c8fcd75e99e32a21719abf4a80f2be8b11f672b6721105a807c0440785f43fd0"
|
| 556 |
+
},
|
| 557 |
+
"head.head_delta.bias": {
|
| 558 |
+
"shape": [
|
| 559 |
+
2
|
| 560 |
+
],
|
| 561 |
+
"dtype": "F32",
|
| 562 |
+
"storage_name": "checkpoint.pt/data/232",
|
| 563 |
+
"size": 8,
|
| 564 |
+
"sha256": "a33aaeafc145d519034895b291f5b7cd2092bc3afc7b36261a29ed81729dcdcb"
|
| 565 |
+
}
|
| 566 |
+
}
|
| 567 |
+
}
|
retired-training/idm-step2/config.json
ADDED
|
@@ -0,0 +1,52 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"historical_config": {
|
| 3 |
+
"run_name": "ab-p0-cod-idm",
|
| 4 |
+
"seed": 0,
|
| 5 |
+
"data": {
|
| 6 |
+
"roots": [
|
| 7 |
+
"data/cod_attested"
|
| 8 |
+
],
|
| 9 |
+
"window": 5,
|
| 10 |
+
"stride": 2,
|
| 11 |
+
"input_res": [
|
| 12 |
+
224,
|
| 13 |
+
224
|
| 14 |
+
],
|
| 15 |
+
"delta_scale": 50.0,
|
| 16 |
+
"min_key_frac": 0.1,
|
| 17 |
+
"contract_mode": "dm1-attested",
|
| 18 |
+
"expected_fps": 30,
|
| 19 |
+
"cache_chunks": 4,
|
| 20 |
+
"holdout_sessions": 2
|
| 21 |
+
},
|
| 22 |
+
"model": {
|
| 23 |
+
"trunk": "dinov2_vits14",
|
| 24 |
+
"d_model": 256,
|
| 25 |
+
"n_layers": 3,
|
| 26 |
+
"n_heads": 8
|
| 27 |
+
},
|
| 28 |
+
"train": {
|
| 29 |
+
"batch_size": 48,
|
| 30 |
+
"max_steps": 6000,
|
| 31 |
+
"lr": 0.0003,
|
| 32 |
+
"weight_decay": 0.01,
|
| 33 |
+
"log_every": 250,
|
| 34 |
+
"save_every": 1000,
|
| 35 |
+
"num_workers": 4,
|
| 36 |
+
"loss_weights": {
|
| 37 |
+
"keys": 1.0,
|
| 38 |
+
"bins": 0.5,
|
| 39 |
+
"delta": 2.0
|
| 40 |
+
}
|
| 41 |
+
},
|
| 42 |
+
"output": {
|
| 43 |
+
"dir": "runs"
|
| 44 |
+
}
|
| 45 |
+
},
|
| 46 |
+
"step": 2,
|
| 47 |
+
"source_checkpoint_sha256": "c17f8c1205285a18627bfa391e8ed7de9840fc28666be0ecd7a708e84e334410",
|
| 48 |
+
"base_encoder": "facebookresearch/dinov2:dinov2_vits14",
|
| 49 |
+
"historical_base_revision": null,
|
| 50 |
+
"base_weights_included": false,
|
| 51 |
+
"head_key_prefix": "head."
|
| 52 |
+
}
|
retired-training/idm-step2/head.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:86ae4da4bb45e8c677b9537e07891497f20ee20a7b244790256e3a4ddeb458ae
|
| 3 |
+
size 10495976
|
retired-training/synthetic-idm/README.md
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Historical synthetic IDM smoke checkpoints
|
| 2 |
+
|
| 3 |
+
These two small checkpoints record early synthetic pipeline tests using the project’s `tiny` encoder and action head, trained on `data/synth_smoke` with the synthetic `synth_canyon` holdout. They contain 400-step and 600-step results, respectively; they are not the separate WM01 step-0 random initialization fixture and are not DINOv2 checkpoints.
|
| 4 |
+
|
| 5 |
+
Both exports preserve all original tensor bytes, including the small original encoder, in non-executable safetensors format. Full original checkpoint SHA-256, ZIP member CRC/SHA checks and tensor-level readback evidence are retained privately. Configuration, training logs and gate reports retain their historical values.
|
| 6 |
+
|
| 7 |
+
The 400-step run failed its hard gates: validation key exact match was about 0.241 and minimum mouse R² about -0.838. The 600-step run’s report passed a changed gate policy based on macro-F1 and bin accuracy; its validation key exact match was about 0.179 and minimum mouse R² about -0.045. This is not evidence of improved performance under an unchanged evaluation criterion. Synthetic pipeline results do not establish performance on real game captures or generalization.
|
| 8 |
+
|
| 9 |
+
This archive preserves the historical synthetic smoke experiments and their original limitations. No model quality or new training-data rights are asserted.
|
retired-training/synthetic-idm/SOURCE_TENSOR_MAPPING.json
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[
|
| 2 |
+
{
|
| 3 |
+
"variant": "smoke-400-step",
|
| 4 |
+
"source_sha256": "04622628d2dec38e234fc74bf916d72904820a9c610537a6749b0c8d3a6d5f5e",
|
| 5 |
+
"source_bytes": 2535285,
|
| 6 |
+
"step": 400,
|
| 7 |
+
"tensor_count": 51,
|
| 8 |
+
"tensor_bytes": 2515936,
|
| 9 |
+
"safetensors_sha256": "80f5721d5f4d0bd1187a82d2818caa7789b50200cf38ef380d88ce3d7c0dd129",
|
| 10 |
+
"safetensors_bytes": 2520856,
|
| 11 |
+
"actual_scientific_scope": "synthetic tiny-trunk pipeline smoke",
|
| 12 |
+
"hard_gates_passed": false,
|
| 13 |
+
"gate_policy_changed_between_runs": true
|
| 14 |
+
},
|
| 15 |
+
{
|
| 16 |
+
"variant": "smoke-600-step",
|
| 17 |
+
"source_sha256": "5bf1b333fe664cb90571381d4e5492ce8cf264d152e338c380fcb92f7a901821",
|
| 18 |
+
"source_bytes": 2561269,
|
| 19 |
+
"step": 600,
|
| 20 |
+
"tensor_count": 52,
|
| 21 |
+
"tensor_bytes": 2541664,
|
| 22 |
+
"safetensors_sha256": "e49e68d8585927e44e673107f4804151bfc391c985eb1a1c29533cee91f090a5",
|
| 23 |
+
"safetensors_bytes": 2546680,
|
| 24 |
+
"actual_scientific_scope": "synthetic tiny-trunk pipeline smoke",
|
| 25 |
+
"hard_gates_passed": true,
|
| 26 |
+
"gate_policy_changed_between_runs": true
|
| 27 |
+
}
|
| 28 |
+
]
|
retired-training/synthetic-idm/smoke-400-step/config.json
ADDED
|
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"historical_config": {
|
| 3 |
+
"run_name": "smoke",
|
| 4 |
+
"seed": 0,
|
| 5 |
+
"data": {
|
| 6 |
+
"roots": [
|
| 7 |
+
"data/synth_smoke"
|
| 8 |
+
],
|
| 9 |
+
"holdout_games": [
|
| 10 |
+
"synth_canyon"
|
| 11 |
+
],
|
| 12 |
+
"val_fraction": 0.2,
|
| 13 |
+
"window": 5,
|
| 14 |
+
"stride": 2,
|
| 15 |
+
"input_res": [
|
| 16 |
+
96,
|
| 17 |
+
96
|
| 18 |
+
],
|
| 19 |
+
"allow_method_validation_only": false
|
| 20 |
+
},
|
| 21 |
+
"model": {
|
| 22 |
+
"trunk": "tiny",
|
| 23 |
+
"d_model": 128,
|
| 24 |
+
"n_layers": 2,
|
| 25 |
+
"n_heads": 4
|
| 26 |
+
},
|
| 27 |
+
"train": {
|
| 28 |
+
"batch_size": 32,
|
| 29 |
+
"max_steps": 400,
|
| 30 |
+
"lr": 0.0003,
|
| 31 |
+
"weight_decay": 0.01,
|
| 32 |
+
"log_every": 25,
|
| 33 |
+
"num_workers": 0,
|
| 34 |
+
"loss_weights": {
|
| 35 |
+
"keys": 1.0,
|
| 36 |
+
"bins": 0.5,
|
| 37 |
+
"delta": 2.0
|
| 38 |
+
}
|
| 39 |
+
},
|
| 40 |
+
"gates": {
|
| 41 |
+
"key_exact_min": 0.5,
|
| 42 |
+
"mouse_r2_min": 0.5,
|
| 43 |
+
"macro_f1_warn": 0.4
|
| 44 |
+
},
|
| 45 |
+
"output": {
|
| 46 |
+
"dir": "runs"
|
| 47 |
+
}
|
| 48 |
+
},
|
| 49 |
+
"step": 400,
|
| 50 |
+
"source_checkpoint_sha256": "04622628d2dec38e234fc74bf916d72904820a9c610537a6749b0c8d3a6d5f5e",
|
| 51 |
+
"includes_original_tiny_encoder": true,
|
| 52 |
+
"trained_tensor_count": 51,
|
| 53 |
+
"archive_scope": "historical synthetic pipeline smoke experiment; not a general gaming control model"
|
| 54 |
+
}
|
retired-training/synthetic-idm/smoke-400-step/config.yaml
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
allow_method_validation_only: false
|
| 3 |
+
holdout_games:
|
| 4 |
+
- synth_canyon
|
| 5 |
+
input_res:
|
| 6 |
+
- 96
|
| 7 |
+
- 96
|
| 8 |
+
roots:
|
| 9 |
+
- data/synth_smoke
|
| 10 |
+
stride: 2
|
| 11 |
+
val_fraction: 0.2
|
| 12 |
+
window: 5
|
| 13 |
+
gates:
|
| 14 |
+
key_exact_min: 0.5
|
| 15 |
+
macro_f1_warn: 0.4
|
| 16 |
+
mouse_r2_min: 0.5
|
| 17 |
+
model:
|
| 18 |
+
d_model: 128
|
| 19 |
+
n_heads: 4
|
| 20 |
+
n_layers: 2
|
| 21 |
+
trunk: tiny
|
| 22 |
+
output:
|
| 23 |
+
dir: runs
|
| 24 |
+
run_name: smoke
|
| 25 |
+
seed: 0
|
| 26 |
+
train:
|
| 27 |
+
batch_size: 32
|
| 28 |
+
log_every: 25
|
| 29 |
+
loss_weights:
|
| 30 |
+
bins: 0.5
|
| 31 |
+
delta: 2.0
|
| 32 |
+
keys: 1.0
|
| 33 |
+
lr: 0.0003
|
| 34 |
+
max_steps: 400
|
| 35 |
+
num_workers: 0
|
| 36 |
+
weight_decay: 0.01
|
retired-training/synthetic-idm/smoke-400-step/gates_report.json
ADDED
|
@@ -0,0 +1,89 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"gates": [
|
| 3 |
+
{
|
| 4 |
+
"name": "val.key_exact",
|
| 5 |
+
"value": 0.2413793103448276,
|
| 6 |
+
"threshold": 0.5,
|
| 7 |
+
"passed": false,
|
| 8 |
+
"level": "hard"
|
| 9 |
+
},
|
| 10 |
+
{
|
| 11 |
+
"name": "val.mouse_r2_min",
|
| 12 |
+
"value": -0.8383413014874044,
|
| 13 |
+
"threshold": 0.5,
|
| 14 |
+
"passed": false,
|
| 15 |
+
"level": "hard"
|
| 16 |
+
},
|
| 17 |
+
{
|
| 18 |
+
"name": "val.key_macro_f1",
|
| 19 |
+
"value": 0.2747747600078583,
|
| 20 |
+
"threshold": 0.4,
|
| 21 |
+
"passed": null,
|
| 22 |
+
"level": "info"
|
| 23 |
+
},
|
| 24 |
+
{
|
| 25 |
+
"name": "zero_shot.key_exact",
|
| 26 |
+
"value": 0.15086206896551724,
|
| 27 |
+
"threshold": null,
|
| 28 |
+
"passed": null,
|
| 29 |
+
"level": "info"
|
| 30 |
+
},
|
| 31 |
+
{
|
| 32 |
+
"name": "zero_shot.key_macro_f1",
|
| 33 |
+
"value": 0.21202483773231506,
|
| 34 |
+
"threshold": null,
|
| 35 |
+
"passed": null,
|
| 36 |
+
"level": "info"
|
| 37 |
+
},
|
| 38 |
+
{
|
| 39 |
+
"name": "zero_shot.mouse_r2_min",
|
| 40 |
+
"value": -0.6140172129594248,
|
| 41 |
+
"threshold": null,
|
| 42 |
+
"passed": null,
|
| 43 |
+
"level": "info"
|
| 44 |
+
}
|
| 45 |
+
],
|
| 46 |
+
"reports": {
|
| 47 |
+
"val": {
|
| 48 |
+
"n": 116,
|
| 49 |
+
"key_exact": 0.2413793103448276,
|
| 50 |
+
"key_macro_f1": 0.2747747600078583,
|
| 51 |
+
"per_key_f1": {
|
| 52 |
+
"1": 1.0,
|
| 53 |
+
"2": 0.6486,
|
| 54 |
+
"87": 0.0,
|
| 55 |
+
"65": 0.0,
|
| 56 |
+
"83": 0.0,
|
| 57 |
+
"68": 0.0
|
| 58 |
+
},
|
| 59 |
+
"bin_acc_x": 0.20689655172413793,
|
| 60 |
+
"bin_acc_y": 0.19827586206896552,
|
| 61 |
+
"mouse_r2_x": -0.09577393302620107,
|
| 62 |
+
"mouse_r2_y": -0.8383413014874044,
|
| 63 |
+
"mouse_r2_min": -0.8383413014874044
|
| 64 |
+
},
|
| 65 |
+
"zero_shot": {
|
| 66 |
+
"n": 696,
|
| 67 |
+
"key_exact": 0.15086206896551724,
|
| 68 |
+
"key_macro_f1": 0.21202483773231506,
|
| 69 |
+
"per_key_f1": {
|
| 70 |
+
"1": 1.0,
|
| 71 |
+
"2": 0.9029,
|
| 72 |
+
"87": 0.0,
|
| 73 |
+
"65": 0.2174,
|
| 74 |
+
"83": 0.0,
|
| 75 |
+
"68": 0.0,
|
| 76 |
+
"49": 0.0,
|
| 77 |
+
"50": 0.0,
|
| 78 |
+
"52": 0.0,
|
| 79 |
+
"54": 0.0
|
| 80 |
+
},
|
| 81 |
+
"bin_acc_x": 0.2744252873563218,
|
| 82 |
+
"bin_acc_y": 0.2600574712643678,
|
| 83 |
+
"mouse_r2_x": -0.07995778121935126,
|
| 84 |
+
"mouse_r2_y": -0.6140172129594248,
|
| 85 |
+
"mouse_r2_min": -0.6140172129594248
|
| 86 |
+
}
|
| 87 |
+
},
|
| 88 |
+
"all_hard_passed": false
|
| 89 |
+
}
|
retired-training/synthetic-idm/smoke-400-step/gates_report.md
ADDED
|
@@ -0,0 +1,23 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Phase 0 gate report
|
| 2 |
+
|
| 3 |
+
| gate | value | threshold | status |
|
| 4 |
+
|---|---|---|---|
|
| 5 |
+
| val.key_exact | 0.2414 | 0.50 | FAIL |
|
| 6 |
+
| val.mouse_r2_min | -0.8383 | 0.50 | FAIL |
|
| 7 |
+
| val.key_macro_f1 | 0.2748 | 0.40 | info |
|
| 8 |
+
| zero_shot.key_exact | 0.1509 | — | info |
|
| 9 |
+
| zero_shot.key_macro_f1 | 0.2120 | — | info |
|
| 10 |
+
| zero_shot.mouse_r2_min | -0.6140 | — | info |
|
| 11 |
+
|
| 12 |
+
## per-key F1 (val) — distribution-edge check
|
| 13 |
+
|
| 14 |
+
| VK | F1 |
|
| 15 |
+
|---|---|
|
| 16 |
+
| 87 | 0.0 |
|
| 17 |
+
| 65 | 0.0 |
|
| 18 |
+
| 83 | 0.0 |
|
| 19 |
+
| 68 | 0.0 |
|
| 20 |
+
| 2 | 0.6486 |
|
| 21 |
+
| 1 | 1.0 |
|
| 22 |
+
|
| 23 |
+
**HARD GATE FAILURE**
|
retired-training/synthetic-idm/smoke-400-step/model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:80f5721d5f4d0bd1187a82d2818caa7789b50200cf38ef380d88ce3d7c0dd129
|
| 3 |
+
size 2520856
|
retired-training/synthetic-idm/smoke-400-step/train_log.jsonl
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{"step": 1, "loss": 4.025543689727783, "bce": 0.8291335701942444, "ce_bins": 6.095488548278809, "reg": 0.07433290779590607, "lr": 2.9999537364671845e-05, "sec": 0.4}
|
| 2 |
+
{"step": 25, "loss": 2.825584650039673, "bce": 0.42105308175086975, "ce_bins": 4.782382011413574, "reg": 0.006670249626040459, "lr": 0.00029711779206048454, "sec": 8.1}
|
| 3 |
+
{"step": 50, "loss": 2.6539554595947266, "bce": 0.32013505697250366, "ce_bins": 4.644176006317139, "reg": 0.005866216029971838, "lr": 0.000288581929876693, "sec": 22.8}
|
| 4 |
+
{"step": 75, "loss": 2.476438522338867, "bce": 0.28110796213150024, "ce_bins": 4.364477157592773, "reg": 0.006546053569763899, "lr": 0.0002747204418453818, "sec": 31.0}
|
| 5 |
+
{"step": 100, "loss": 2.3145804405212402, "bce": 0.2978273332118988, "ce_bins": 4.014360427856445, "reg": 0.004786489065736532, "lr": 0.00025606601717798207, "sec": 39.1}
|
| 6 |
+
{"step": 125, "loss": 2.487971782684326, "bce": 0.25723305344581604, "ce_bins": 4.4292497634887695, "reg": 0.008056859485805035, "lr": 0.0002333355349529403, "sec": 47.2}
|
| 7 |
+
{"step": 150, "loss": 2.535987615585327, "bce": 0.24830186367034912, "ce_bins": 4.526930809020996, "reg": 0.012110074982047081, "lr": 0.00020740251485476345, "sec": 55.3}
|
| 8 |
+
{"step": 175, "loss": 2.4687187671661377, "bce": 0.2903555631637573, "ce_bins": 4.316826820373535, "reg": 0.009974876418709755, "lr": 0.00017926354830241924, "sec": 64.1}
|
| 9 |
+
{"step": 200, "loss": 2.2310945987701416, "bce": 0.28719213604927063, "ce_bins": 3.8625564575195312, "reg": 0.006312177050858736, "lr": 0.00015, "sec": 73.4}
|
| 10 |
+
{"step": 225, "loss": 2.0925910472869873, "bce": 0.2512870728969574, "ce_bins": 3.6600873470306396, "reg": 0.005630181171000004, "lr": 0.00012073645169758076, "sec": 81.3}
|
| 11 |
+
{"step": 250, "loss": 2.5086100101470947, "bce": 0.28716185688972473, "ce_bins": 4.411448955535889, "reg": 0.00786182563751936, "lr": 9.259748514523653e-05, "sec": 89.1}
|
| 12 |
+
{"step": 275, "loss": 2.1734466552734375, "bce": 0.2514239251613617, "ce_bins": 3.809532642364502, "reg": 0.008628210984170437, "lr": 6.66644650470597e-05, "sec": 97.5}
|
| 13 |
+
{"step": 300, "loss": 2.3453588485717773, "bce": 0.24166502058506012, "ce_bins": 4.179871082305908, "reg": 0.006879130378365517, "lr": 4.3933982822017876e-05, "sec": 105.6}
|
| 14 |
+
{"step": 325, "loss": 2.397913932800293, "bce": 0.23968416452407837, "ce_bins": 4.298135757446289, "reg": 0.004580970853567123, "lr": 2.5279558154618197e-05, "sec": 113.5}
|
| 15 |
+
{"step": 350, "loss": 1.989343285560608, "bce": 0.2549160420894623, "ce_bins": 3.443016529083252, "reg": 0.006459500640630722, "lr": 1.1418070123306989e-05, "sec": 121.3}
|
| 16 |
+
{"step": 375, "loss": 2.3613739013671875, "bce": 0.2576085031032562, "ce_bins": 4.183338165283203, "reg": 0.006048179231584072, "lr": 2.882207939515435e-06, "sec": 129.2}
|
| 17 |
+
{"step": 400, "loss": 1.9816786050796509, "bce": 0.24057845771312714, "ce_bins": 3.468719959259033, "reg": 0.0033700931817293167, "lr": 0.0, "sec": 137.0}
|
retired-training/synthetic-idm/smoke-600-step/config.json
ADDED
|
@@ -0,0 +1,53 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"historical_config": {
|
| 3 |
+
"run_name": "smoke",
|
| 4 |
+
"seed": 0,
|
| 5 |
+
"data": {
|
| 6 |
+
"roots": [
|
| 7 |
+
"data/synth_smoke"
|
| 8 |
+
],
|
| 9 |
+
"holdout_games": [
|
| 10 |
+
"synth_canyon"
|
| 11 |
+
],
|
| 12 |
+
"val_fraction": 0.2,
|
| 13 |
+
"window": 5,
|
| 14 |
+
"stride": 2,
|
| 15 |
+
"input_res": [
|
| 16 |
+
96,
|
| 17 |
+
96
|
| 18 |
+
],
|
| 19 |
+
"allow_method_validation_only": false
|
| 20 |
+
},
|
| 21 |
+
"model": {
|
| 22 |
+
"trunk": "tiny",
|
| 23 |
+
"d_model": 128,
|
| 24 |
+
"n_layers": 2,
|
| 25 |
+
"n_heads": 4
|
| 26 |
+
},
|
| 27 |
+
"train": {
|
| 28 |
+
"batch_size": 32,
|
| 29 |
+
"max_steps": 600,
|
| 30 |
+
"lr": 0.0003,
|
| 31 |
+
"weight_decay": 0.01,
|
| 32 |
+
"log_every": 25,
|
| 33 |
+
"num_workers": 0,
|
| 34 |
+
"loss_weights": {
|
| 35 |
+
"keys": 1.0,
|
| 36 |
+
"bins": 0.5,
|
| 37 |
+
"delta": 2.0
|
| 38 |
+
}
|
| 39 |
+
},
|
| 40 |
+
"gates": {
|
| 41 |
+
"key_macro_f1_min": 0.22,
|
| 42 |
+
"bin_acc_min": 0.25
|
| 43 |
+
},
|
| 44 |
+
"output": {
|
| 45 |
+
"dir": "runs"
|
| 46 |
+
}
|
| 47 |
+
},
|
| 48 |
+
"step": 600,
|
| 49 |
+
"source_checkpoint_sha256": "5bf1b333fe664cb90571381d4e5492ce8cf264d152e338c380fcb92f7a901821",
|
| 50 |
+
"includes_original_tiny_encoder": true,
|
| 51 |
+
"trained_tensor_count": 52,
|
| 52 |
+
"archive_scope": "historical synthetic pipeline smoke experiment; not a general gaming control model"
|
| 53 |
+
}
|
retired-training/synthetic-idm/smoke-600-step/config.yaml
ADDED
|
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
allow_method_validation_only: false
|
| 3 |
+
holdout_games:
|
| 4 |
+
- synth_canyon
|
| 5 |
+
input_res:
|
| 6 |
+
- 96
|
| 7 |
+
- 96
|
| 8 |
+
roots:
|
| 9 |
+
- data/synth_smoke
|
| 10 |
+
stride: 2
|
| 11 |
+
val_fraction: 0.2
|
| 12 |
+
window: 5
|
| 13 |
+
gates:
|
| 14 |
+
bin_acc_min: 0.25
|
| 15 |
+
key_macro_f1_min: 0.22
|
| 16 |
+
model:
|
| 17 |
+
d_model: 128
|
| 18 |
+
n_heads: 4
|
| 19 |
+
n_layers: 2
|
| 20 |
+
trunk: tiny
|
| 21 |
+
output:
|
| 22 |
+
dir: runs
|
| 23 |
+
run_name: smoke
|
| 24 |
+
seed: 0
|
| 25 |
+
train:
|
| 26 |
+
batch_size: 32
|
| 27 |
+
log_every: 25
|
| 28 |
+
loss_weights:
|
| 29 |
+
bins: 0.5
|
| 30 |
+
delta: 2.0
|
| 31 |
+
keys: 1.0
|
| 32 |
+
lr: 0.0003
|
| 33 |
+
max_steps: 600
|
| 34 |
+
num_workers: 0
|
| 35 |
+
weight_decay: 0.01
|
retired-training/synthetic-idm/smoke-600-step/gates_report.json
ADDED
|
@@ -0,0 +1,105 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"gates": [
|
| 3 |
+
{
|
| 4 |
+
"name": "val.key_exact",
|
| 5 |
+
"value": 0.1788793103448276,
|
| 6 |
+
"threshold": null,
|
| 7 |
+
"passed": null,
|
| 8 |
+
"level": "hard"
|
| 9 |
+
},
|
| 10 |
+
{
|
| 11 |
+
"name": "val.mouse_r2_min",
|
| 12 |
+
"value": -0.044929768690012084,
|
| 13 |
+
"threshold": null,
|
| 14 |
+
"passed": null,
|
| 15 |
+
"level": "hard"
|
| 16 |
+
},
|
| 17 |
+
{
|
| 18 |
+
"name": "val.key_macro_f1",
|
| 19 |
+
"value": 0.24808114767074585,
|
| 20 |
+
"threshold": 0.22,
|
| 21 |
+
"passed": true,
|
| 22 |
+
"level": "hard"
|
| 23 |
+
},
|
| 24 |
+
{
|
| 25 |
+
"name": "val.bin_acc_min",
|
| 26 |
+
"value": 0.2974137931034483,
|
| 27 |
+
"threshold": 0.25,
|
| 28 |
+
"passed": true,
|
| 29 |
+
"level": "hard"
|
| 30 |
+
},
|
| 31 |
+
{
|
| 32 |
+
"name": "zero_shot.key_exact",
|
| 33 |
+
"value": 0.10847701149425287,
|
| 34 |
+
"threshold": null,
|
| 35 |
+
"passed": null,
|
| 36 |
+
"level": "info"
|
| 37 |
+
},
|
| 38 |
+
{
|
| 39 |
+
"name": "zero_shot.key_macro_f1",
|
| 40 |
+
"value": 0.16931970417499542,
|
| 41 |
+
"threshold": null,
|
| 42 |
+
"passed": null,
|
| 43 |
+
"level": "info"
|
| 44 |
+
},
|
| 45 |
+
{
|
| 46 |
+
"name": "zero_shot.mouse_r2_min",
|
| 47 |
+
"value": -0.00924660839428193,
|
| 48 |
+
"threshold": null,
|
| 49 |
+
"passed": null,
|
| 50 |
+
"level": "info"
|
| 51 |
+
}
|
| 52 |
+
],
|
| 53 |
+
"reports": {
|
| 54 |
+
"val": {
|
| 55 |
+
"n": 464,
|
| 56 |
+
"key_exact": 0.1788793103448276,
|
| 57 |
+
"key_macro_f1": 0.24808114767074585,
|
| 58 |
+
"per_key_f1": {
|
| 59 |
+
"1": 1.0,
|
| 60 |
+
"2": 0.963,
|
| 61 |
+
"87": 0.2698,
|
| 62 |
+
"65": 0.0,
|
| 63 |
+
"83": 0.0,
|
| 64 |
+
"68": 0.0,
|
| 65 |
+
"49": 0.0,
|
| 66 |
+
"52": 0.0,
|
| 67 |
+
"53": 0.0
|
| 68 |
+
},
|
| 69 |
+
"bin_acc_x": 0.2974137931034483,
|
| 70 |
+
"bin_acc_y": 0.35560344827586204,
|
| 71 |
+
"mouse_r2_x": -0.007033857668732324,
|
| 72 |
+
"mouse_r2_y": -0.044929768690012084,
|
| 73 |
+
"mouse_r2_min": -0.044929768690012084,
|
| 74 |
+
"delta_head_r2_x": -0.05320218332663473,
|
| 75 |
+
"delta_head_r2_y": -0.0814627712136955
|
| 76 |
+
},
|
| 77 |
+
"zero_shot": {
|
| 78 |
+
"n": 1392,
|
| 79 |
+
"key_exact": 0.10847701149425287,
|
| 80 |
+
"key_macro_f1": 0.16931970417499542,
|
| 81 |
+
"per_key_f1": {
|
| 82 |
+
"1": 1.0,
|
| 83 |
+
"2": 0.8551,
|
| 84 |
+
"87": 0.172,
|
| 85 |
+
"65": 0.0,
|
| 86 |
+
"83": 0.0,
|
| 87 |
+
"68": 0.0047,
|
| 88 |
+
"49": 0.0,
|
| 89 |
+
"50": 0.0,
|
| 90 |
+
"51": 0.0,
|
| 91 |
+
"52": 0.0,
|
| 92 |
+
"53": 0.0,
|
| 93 |
+
"54": 0.0
|
| 94 |
+
},
|
| 95 |
+
"bin_acc_x": 0.2952586206896552,
|
| 96 |
+
"bin_acc_y": 0.2988505747126437,
|
| 97 |
+
"mouse_r2_x": 0.0014671553341127908,
|
| 98 |
+
"mouse_r2_y": -0.00924660839428193,
|
| 99 |
+
"mouse_r2_min": -0.00924660839428193,
|
| 100 |
+
"delta_head_r2_x": -0.019640838042877196,
|
| 101 |
+
"delta_head_r2_y": -0.024218440263336305
|
| 102 |
+
}
|
| 103 |
+
},
|
| 104 |
+
"all_hard_passed": true
|
| 105 |
+
}
|
retired-training/synthetic-idm/smoke-600-step/gates_report.md
ADDED
|
@@ -0,0 +1,27 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Phase 0 gate report
|
| 2 |
+
|
| 3 |
+
| gate | value | threshold | status |
|
| 4 |
+
|---|---|---|---|
|
| 5 |
+
| val.key_exact | 0.1789 | — | info |
|
| 6 |
+
| val.mouse_r2_min | -0.0449 | — | info |
|
| 7 |
+
| val.key_macro_f1 | 0.2481 | 0.22 | PASS |
|
| 8 |
+
| val.bin_acc_min | 0.2974 | 0.25 | PASS |
|
| 9 |
+
| zero_shot.key_exact | 0.1085 | — | info |
|
| 10 |
+
| zero_shot.key_macro_f1 | 0.1693 | — | info |
|
| 11 |
+
| zero_shot.mouse_r2_min | -0.0092 | — | info |
|
| 12 |
+
|
| 13 |
+
## per-key F1 (val) — distribution-edge check
|
| 14 |
+
|
| 15 |
+
| VK | F1 |
|
| 16 |
+
|---|---|
|
| 17 |
+
| 65 | 0.0 |
|
| 18 |
+
| 83 | 0.0 |
|
| 19 |
+
| 68 | 0.0 |
|
| 20 |
+
| 49 | 0.0 |
|
| 21 |
+
| 52 | 0.0 |
|
| 22 |
+
| 53 | 0.0 |
|
| 23 |
+
| 87 | 0.2698 |
|
| 24 |
+
| 2 | 0.963 |
|
| 25 |
+
| 1 | 1.0 |
|
| 26 |
+
|
| 27 |
+
**ALL HARD GATES PASSED**
|
retired-training/synthetic-idm/smoke-600-step/model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e49e68d8585927e44e673107f4804151bfc391c985eb1a1c29533cee91f090a5
|
| 3 |
+
size 2546680
|
retired-training/synthetic-idm/smoke-600-step/train_log.jsonl
ADDED
|
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{"step": 1, "loss": 3.9986166954040527, "bce": 0.6944006085395813, "ce_bins": 6.319253921508789, "reg": 0.07229459285736084, "lr": 1.9999862922474263e-05, "sec": 0.3}
|
| 2 |
+
{"step": 25, "loss": 2.9051527976989746, "bce": 0.4195733070373535, "ce_bins": 4.695088863372803, "reg": 0.06901752948760986, "lr": 0.00025888783197859535, "sec": 7.9}
|
| 3 |
+
{"step": 50, "loss": 2.425509452819824, "bce": 0.3490763008594513, "ce_bins": 3.874476671218872, "reg": 0.06959731876850128, "lr": 0.0002948888739433602, "sec": 15.8}
|
| 4 |
+
{"step": 75, "loss": 2.6434264183044434, "bce": 0.2896054685115814, "ce_bins": 4.416299819946289, "reg": 0.07283559441566467, "lr": 0.000288581929876693, "sec": 23.7}
|
| 5 |
+
{"step": 100, "loss": 2.03243088722229, "bce": 0.2654474973678589, "ce_bins": 3.3827075958251953, "reg": 0.03781478479504585, "lr": 0.0002799038105676658, "sec": 31.7}
|
| 6 |
+
{"step": 125, "loss": 2.4845476150512695, "bce": 0.26088932156562805, "ce_bins": 4.120233058929443, "reg": 0.08177090436220169, "lr": 0.00026900300104368524, "sec": 39.6}
|
| 7 |
+
{"step": 150, "loss": 2.6293509006500244, "bce": 0.2595902979373932, "ce_bins": 4.282679557800293, "reg": 0.1142103299498558, "lr": 0.00025606601717798207, "sec": 47.6}
|
| 8 |
+
{"step": 175, "loss": 2.6190521717071533, "bce": 0.2593246400356293, "ce_bins": 4.357151985168457, "reg": 0.09057582169771194, "lr": 0.00024131421435130807, "sec": 55.5}
|
| 9 |
+
{"step": 200, "loss": 2.5147273540496826, "bce": 0.23799912631511688, "ce_bins": 4.236259460449219, "reg": 0.0792992040514946, "lr": 0.000225, "sec": 67.3}
|
| 10 |
+
{"step": 225, "loss": 2.3425166606903076, "bce": 0.2648026943206787, "ce_bins": 3.972464084625244, "reg": 0.045740995556116104, "lr": 0.00020740251485476345, "sec": 80.4}
|
| 11 |
+
{"step": 250, "loss": 2.5899147987365723, "bce": 0.28132426738739014, "ce_bins": 4.26145076751709, "reg": 0.08893252909183502, "lr": 0.0001888228567653781, "sec": 88.4}
|
| 12 |
+
{"step": 275, "loss": 2.206843376159668, "bce": 0.258464515209198, "ce_bins": 3.541125774383545, "reg": 0.08890792727470398, "lr": 0.00016957892883300775, "sec": 96.3}
|
| 13 |
+
{"step": 300, "loss": 1.9897438287734985, "bce": 0.21222329139709473, "ce_bins": 3.2697672843933105, "reg": 0.07131843268871307, "lr": 0.00015, "sec": 104.2}
|
| 14 |
+
{"step": 325, "loss": 2.2631309032440186, "bce": 0.24488191306591034, "ce_bins": 3.782269239425659, "reg": 0.06355711072683334, "lr": 0.00013042107116699228, "sec": 112.3}
|
| 15 |
+
{"step": 350, "loss": 2.0472748279571533, "bce": 0.2769976854324341, "ce_bins": 3.3380484580993652, "reg": 0.05062646418809891, "lr": 0.00011117714323462186, "sec": 120.3}
|
| 16 |
+
{"step": 375, "loss": 1.9838820695877075, "bce": 0.2607121169567108, "ce_bins": 3.262740135192871, "reg": 0.045899905264377594, "lr": 9.259748514523653e-05, "sec": 128.2}
|
| 17 |
+
{"step": 400, "loss": 2.4052536487579346, "bce": 0.24486057460308075, "ce_bins": 3.970672130584717, "reg": 0.08752842992544174, "lr": 7.500000000000002e-05, "sec": 136.0}
|
| 18 |
+
{"step": 425, "loss": 1.8080203533172607, "bce": 0.2707543671131134, "ce_bins": 2.9010634422302246, "reg": 0.04336714372038841, "lr": 5.8685785648691894e-05, "sec": 143.9}
|
| 19 |
+
{"step": 450, "loss": 1.814149260520935, "bce": 0.26432695984840393, "ce_bins": 2.786057472229004, "reg": 0.07839677482843399, "lr": 4.3933982822017876e-05, "sec": 151.9}
|
| 20 |
+
{"step": 475, "loss": 1.922350525856018, "bce": 0.22440381348133087, "ce_bins": 3.1092822551727295, "reg": 0.07165275514125824, "lr": 3.099699895631474e-05, "sec": 160.3}
|
| 21 |
+
{"step": 500, "loss": 1.8275529146194458, "bce": 0.2697175443172455, "ce_bins": 2.856165885925293, "reg": 0.06487618386745453, "lr": 2.009618943233419e-05, "sec": 168.8}
|
| 22 |
+
{"step": 525, "loss": 2.0043110847473145, "bce": 0.2471693903207779, "ce_bins": 3.262516975402832, "reg": 0.06294164806604385, "lr": 1.1418070123306989e-05, "sec": 176.8}
|
| 23 |
+
{"step": 550, "loss": 1.7204042673110962, "bce": 0.24311597645282745, "ce_bins": 2.836681604385376, "reg": 0.02947373129427433, "lr": 5.11112605663977e-06, "sec": 184.8}
|
| 24 |
+
{"step": 575, "loss": 2.0978994369506836, "bce": 0.23447467386722565, "ce_bins": 3.548307418823242, "reg": 0.04463551566004753, "lr": 1.2832707939284427e-06, "sec": 192.9}
|
| 25 |
+
{"step": 600, "loss": 1.968416452407837, "bce": 0.26815176010131836, "ce_bins": 3.141531229019165, "reg": 0.06474950909614563, "lr": 0.0, "sec": 200.8}
|
retired-training/tiny-vlm-smoke/NOTICE
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Historical project-generated adapter for yujiepan/qwen2-vl-tiny-random. Eight synthetic debug steps; saved revision unknown; no useful-model or independent-evaluation claim. Upstream license was not declared in the reviewed model card. Do not infer Apache-2.0 from architecture. Base weights and downloaded tokenizer assets are excluded. Original scientific values and split designation are unchanged.
|
retired-training/tiny-vlm-smoke/README.md
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Historical tiny random VLM adapter smoke test
|
| 2 |
+
|
| 3 |
+
This 9,408-byte LoRA adapter contains 16 F32 tensors produced by an eight-step synthetic pipeline smoke run. Its recorded base is `yujiepan/qwen2-vl-tiny-random`; the original saved base revision is null. The upstream author describes the base as a randomly initialized reduced Qwen2-VL configuration for debugging. No base-model weights or downloaded tokenizer vocabulary are included here.
|
| 4 |
+
|
| 5 |
+
The historical configuration explicitly used `train_split: test`. The recorded first-five and last-five losses are 11.9103 and 11.9108. These facts do not constitute independent held-out evaluation or demonstrate useful model quality. This fixture documents pipeline behavior only.
|
| 6 |
+
|
| 7 |
+
Static review verified all 16 tensor layouts and bytes, finite values, and complete source SHA-256 without importing Torch or executing saved code. The original adapter and small configuration/log/summary files are preserved exactly.
|
| 8 |
+
|
| 9 |
+
The upstream model card at reference revision `b4499b5f4e1c7e7e2ed2bcc098dee6ffef9a4cbd` did not declare a license in the checked metadata. That current reference is provenance context, not a recovered historical training revision. No upstream license is inferred from the Qwen architecture, and this fixture does not relicense third-party material.
|
| 10 |
+
|
| 11 |
+
Archived as historical pipeline evidence with the provenance and limitations above.
|
retired-training/tiny-vlm-smoke/SOURCE_MAPPING.json
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"source_bytes": 9408,
|
| 3 |
+
"source_sha256": "90401af987608f78eb365adb88a410049446494eb927ed9268d3985f001ced16",
|
| 4 |
+
"tensor_count": 16,
|
| 5 |
+
"historical_base_revision": null,
|
| 6 |
+
"current_reference_revision": "b4499b5f4e1c7e7e2ed2bcc098dee6ffef9a4cbd",
|
| 7 |
+
"upstream_card_url": "https://huggingface.co/yujiepan/qwen2-vl-tiny-random/blob/b4499b5f4e1c7e7e2ed2bcc098dee6ffef9a4cbd/README.md",
|
| 8 |
+
"upstream_declared_license": null,
|
| 9 |
+
"files": [
|
| 10 |
+
{
|
| 11 |
+
"path": "summary.json",
|
| 12 |
+
"bytes": 67,
|
| 13 |
+
"sha256": "d61c869616146f0189390fbdfd05ece3401e4e7bb8cc39791cd6fe6d55ead308"
|
| 14 |
+
},
|
| 15 |
+
{
|
| 16 |
+
"path": "config.yaml",
|
| 17 |
+
"bytes": 384,
|
| 18 |
+
"sha256": "6d9184dc72a1e8d06744d71be5ce53d9861882c419fbdf02484c16fe19b169cf"
|
| 19 |
+
},
|
| 20 |
+
{
|
| 21 |
+
"path": "adapter_model.safetensors",
|
| 22 |
+
"bytes": 9408,
|
| 23 |
+
"sha256": "90401af987608f78eb365adb88a410049446494eb927ed9268d3985f001ced16"
|
| 24 |
+
},
|
| 25 |
+
{
|
| 26 |
+
"path": "adapter_config.json",
|
| 27 |
+
"bytes": 1058,
|
| 28 |
+
"sha256": "f023abc0f62e07ac60aebd696b0ff728e5624d5fc4bf3be0ea595c628d6fa760"
|
| 29 |
+
},
|
| 30 |
+
{
|
| 31 |
+
"path": "train_log.jsonl",
|
| 32 |
+
"bytes": 317,
|
| 33 |
+
"sha256": "29f5ff696a09718573343ac022fb2a86eb46839437b8c833982be956444f0410"
|
| 34 |
+
}
|
| 35 |
+
],
|
| 36 |
+
"historical_context_only": true
|
| 37 |
+
}
|
retired-training/tiny-vlm-smoke/adapter_config.json
ADDED
|
@@ -0,0 +1,45 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": "yujiepan/qwen2-vl-tiny-random",
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": true,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 16,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0.05,
|
| 22 |
+
"lora_ga_config": null,
|
| 23 |
+
"megatron_config": null,
|
| 24 |
+
"megatron_core": "megatron.core",
|
| 25 |
+
"modules_to_save": null,
|
| 26 |
+
"peft_type": "LORA",
|
| 27 |
+
"peft_version": "0.19.1",
|
| 28 |
+
"qalora_group_size": 16,
|
| 29 |
+
"r": 8,
|
| 30 |
+
"rank_pattern": {},
|
| 31 |
+
"revision": null,
|
| 32 |
+
"target_modules": [
|
| 33 |
+
"v_proj",
|
| 34 |
+
"q_proj",
|
| 35 |
+
"k_proj",
|
| 36 |
+
"o_proj"
|
| 37 |
+
],
|
| 38 |
+
"target_parameters": null,
|
| 39 |
+
"task_type": "CAUSAL_LM",
|
| 40 |
+
"trainable_token_indices": null,
|
| 41 |
+
"use_bdlora": null,
|
| 42 |
+
"use_dora": false,
|
| 43 |
+
"use_qalora": false,
|
| 44 |
+
"use_rslora": false
|
| 45 |
+
}
|
retired-training/tiny-vlm-smoke/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90401af987608f78eb365adb88a410049446494eb927ed9268d3985f001ced16
|
| 3 |
+
size 9408
|
retired-training/tiny-vlm-smoke/config.yaml
ADDED
|
@@ -0,0 +1,26 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
bench_dir: data/bench_synth
|
| 3 |
+
labels:
|
| 4 |
+
- data/bench_synth/labels.jsonl
|
| 5 |
+
train_split: test
|
| 6 |
+
eval:
|
| 7 |
+
max_new_tokens: 64
|
| 8 |
+
gates: {}
|
| 9 |
+
model:
|
| 10 |
+
lora_alpha: 16
|
| 11 |
+
lora_r: 8
|
| 12 |
+
lora_targets:
|
| 13 |
+
- q_proj
|
| 14 |
+
- k_proj
|
| 15 |
+
- v_proj
|
| 16 |
+
- o_proj
|
| 17 |
+
name: yujiepan/qwen2-vl-tiny-random
|
| 18 |
+
output:
|
| 19 |
+
dir: runs
|
| 20 |
+
run_name: vl-smoke
|
| 21 |
+
seed: 0
|
| 22 |
+
train:
|
| 23 |
+
grad_accum: 2
|
| 24 |
+
log_every: 2
|
| 25 |
+
lr: 0.0001
|
| 26 |
+
max_steps: 8
|
retired-training/tiny-vlm-smoke/summary.json
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"steps": 8,
|
| 3 |
+
"loss_first5": 11.9103,
|
| 4 |
+
"loss_last5": 11.9108
|
| 5 |
+
}
|
retired-training/tiny-vlm-smoke/train_log.jsonl
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{"step": 1, "loss": 11.9102, "lr": 9.619397662556435e-05, "sec": 0.1}
|
| 2 |
+
{"step": 2, "loss": 11.9111, "lr": 8.535533905932738e-05, "sec": 0.2}
|
| 3 |
+
{"step": 4, "loss": 11.9101, "lr": 5e-05, "sec": 0.3}
|
| 4 |
+
{"step": 6, "loss": 11.9122, "lr": 1.4644660940672627e-05, "sec": 0.3}
|
| 5 |
+
{"step": 8, "loss": 11.9113, "lr": 0.0, "sec": 0.4}
|