Nicholas0228 commited on
Commit
5a3e1bf
·
verified ·
1 Parent(s): 85b9c9e

Add exact c3-3 gradient-fixed CR10 2k strict M1 inference checkpoint

Browse files
.gitattributes CHANGED
@@ -115,3 +115,5 @@ c1-1/cr10_staged_cosine/packed_temporal_grid/iter_000004000/model/.metadata filt
115
  c1-1/cr10_staged_cosine/packed_temporal_grid/iter_000004000/model/__0_0.distcp filter=lfs diff=lfs merge=lfs -text
116
  c1-1/cr10_staged_cosine/packed_temporal_grid/iter_000004000/optim_compressor/.metadata filter=lfs diff=lfs merge=lfs -text
117
  c1-1/cr10_staged_cosine/packed_temporal_grid/iter_000004000/optim_compressor/__0_0.distcp filter=lfs diff=lfs merge=lfs -text
 
 
 
115
  c1-1/cr10_staged_cosine/packed_temporal_grid/iter_000004000/model/__0_0.distcp filter=lfs diff=lfs merge=lfs -text
116
  c1-1/cr10_staged_cosine/packed_temporal_grid/iter_000004000/optim_compressor/.metadata filter=lfs diff=lfs merge=lfs -text
117
  c1-1/cr10_staged_cosine/packed_temporal_grid/iter_000004000/optim_compressor/__0_0.distcp filter=lfs diff=lfs merge=lfs -text
118
+ c3-3/cr10_fullprefix_gradctxfix/iter_000002000/model/.metadata filter=lfs diff=lfs merge=lfs -text
119
+ c3-3/cr10_fullprefix_gradctxfix/iter_000002000/model/__0_0.distcp filter=lfs diff=lfs merge=lfs -text
c3-3/cr10_fullprefix_gradctxfix/iter_000002000/README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # CR10 strict M=1: gradient-fixed c3-3 compressor, iteration 2000
2
+
3
+ This is the exact inference checkpoint used by the CR10 strict M=1 comparison.
4
+ It is not the older c3-3 CR4/packed checkpoint or the c1-1 CR10 checkpoint.
5
+ The run name ends in `raw_10k`, but the supplied checkpoint is iteration **2000**.
6
+
7
+ ## Code
8
+
9
+ Repository: https://github.com/a-little-hoof/video-compress
10
+
11
+ Pinned commit: `757194f78bad10f50d660d14342a5f18b82470f0`
12
+
13
+ Branch: `exp/relax-official-shared-c3-20260909`
14
+
15
+ The GitHub repository requires its own access authorization. Hugging Face read
16
+ access does not automatically grant GitHub access.
17
+
18
+ Entry point: `scripts/context_compression/generate_mbencht_c3_3_continuations.py`.
19
+ The M=1 implementation is `generate_strict_relax_history_slot`; its exact method
20
+ identifier is `c3_relax_slot_h1_cr10_matched_interval_replacement`.
21
+ Raw matched control: `c3_relax_slot_h1_raw_control`.
22
+ Released-policy adaptation: `c3_relax_forcing4_official_shared_frame`.
23
+ The runtime is `rcm/inference/wan2pt1_t2v_causal_extrapolation_infer.py`.
24
+
25
+ ## Required separate generator
26
+
27
+ Repository: `worstcoder/rcm-Wan`
28
+
29
+ Revision: `142d77a331f1516fea772607c1bf25a2785a2505`
30
+
31
+ Filename: `Causal_rCM_Wan2.1_T2V_1.3B_480p_TF-dCM-init_SF-DMD_c3-3_step4.pt`
32
+
33
+ SHA256: `cc53e27e4501f58f43d1ca01dc2e5dde4df946ce5c85ab79695a902d929df008`
34
+
35
+ Do not substitute the similarly named TF-sCM-init generator. The VAE and text
36
+ encoder are `Wan2.1_VAE.pth` and `models_t5_umt5-xxl-enc-bf16.pth` in
37
+ `worstcoder/Wan`, revision `18554de6b48df8ab2ae274972a076b27ad5cb602`.
38
+
39
+ ## Loading
40
+
41
+ Download this entire checkpoint directory, including hidden `model/.metadata`
42
+ and all `model/*.distcp` files. Pass its parent-of-model directory to
43
+ `--packed_compressor_ckpt`, with `--checkpoint_iteration 2000 --memory_ratio 0.1`.
44
+ Use `--model_size 1.3B --max_memory_tokens_per_frame 1024`.
45
+ The pinned `generate_compressed_context.py::load_compressor_weights` supports
46
+ this distributed-checkpoint layout. Optimizer state is not required for inference
47
+ and is not included. This package is not a resumable training checkpoint.
48
+
49
+ ## What M=1 means
50
+
51
+ At 832x480, active past context is two raw sink frames, one selected compressed
52
+ 1560-token frame-equivalent unit, and one raw recent frame: 6240 past KV tokens
53
+ per layer. The current c3 chunk adds three latent frames. CR10 is the compressor
54
+ ratio, not the number of active memory slots.
55
+
56
+ Compress each complete 21-latent-frame block once. Contextualize the full
57
+ compressed archive bidirectionally before selecting the one active unit;
58
+ retain residual tokens for contextualization but not as selectable full units.
59
+ The historical M=1 method selects independently per layer and freezes selected
60
+ history KV between 21-frame boundaries. It uses raw bootstrap through frame 42.
61
+
62
+ The released Relax adaptation differs in layer-shared selection, candidate
63
+ grid, prototype reduction, reservoir policy, and three-frame refresh cadence.
64
+ Changing those is an inference ablation, not an identical reproduction of the
65
+ historical M=1 result. Keep the generator, checkpoint, prompts/noise, active
66
+ context budget, and scoring protocol matched when testing individual changes.
67
+
68
+ File hashes are supplied in `sha256_manifest.json`. No credentials, private
69
+ launchers, or new training/evaluation results are included in this package.
c3-3/cr10_fullprefix_gradctxfix/iter_000002000/inference_config.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "checkpoint_iteration": 2000,
3
+ "checkpoint_layout": "pytorch_distributed_checkpoint",
4
+ "fps": 16,
5
+ "generation_protocol": "official_continuous_seed0_v1",
6
+ "max_memory_tokens_per_frame": 1024,
7
+ "memory_ratio": 0.1,
8
+ "method": "c3_relax_slot_h1_cr10_matched_interval_replacement",
9
+ "mid_t": [
10
+ "15/16",
11
+ "5/6",
12
+ "5/8"
13
+ ],
14
+ "model_size": "1.3B",
15
+ "num_steps": 4,
16
+ "seed": 0,
17
+ "sigma_max": 1600
18
+ }
c3-3/cr10_fullprefix_gradctxfix/iter_000002000/model/.metadata ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:332c50d8c03789f83eb2ab0cd5a4bc67ed92de7fa7701f6434ee2bce4f2bffa5
3
+ size 481484
c3-3/cr10_fullprefix_gradctxfix/iter_000002000/model/__0_0.distcp ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8868b1111579eabe4f783f930e5c7e24d76da3e6d79a736fa5ae515d3eea3107
3
+ size 5681533593
c3-3/cr10_fullprefix_gradctxfix/iter_000002000/model/__1_0.distcp ADDED
File without changes
c3-3/cr10_fullprefix_gradctxfix/iter_000002000/model/__2_0.distcp ADDED
File without changes
c3-3/cr10_fullprefix_gradctxfix/iter_000002000/model/__3_0.distcp ADDED
File without changes
c3-3/cr10_fullprefix_gradctxfix/iter_000002000/sha256_manifest.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "files": [
3
+ {
4
+ "path": "model/.metadata",
5
+ "sha256": "332c50d8c03789f83eb2ab0cd5a4bc67ed92de7fa7701f6434ee2bce4f2bffa5",
6
+ "size": 481484
7
+ },
8
+ {
9
+ "path": "model/__0_0.distcp",
10
+ "sha256": "8868b1111579eabe4f783f930e5c7e24d76da3e6d79a736fa5ae515d3eea3107",
11
+ "size": 5681533593
12
+ },
13
+ {
14
+ "path": "model/__1_0.distcp",
15
+ "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
16
+ "size": 0
17
+ },
18
+ {
19
+ "path": "model/__2_0.distcp",
20
+ "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
21
+ "size": 0
22
+ },
23
+ {
24
+ "path": "model/__3_0.distcp",
25
+ "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
26
+ "size": 0
27
+ }
28
+ ],
29
+ "inference_only": true,
30
+ "iteration": 2000,
31
+ "schema": "c3-strict-m1-checkpoint-handoff/v1",
32
+ "source_commit": "757194f78bad10f50d660d14342a5f18b82470f0",
33
+ "variant": "c3-3 CR10 full-prefix memory-only gradient-fixed"
34
+ }