vv137 commited on
Commit
89c389f
·
verified ·
1 Parent(s): 4cb0b28

Add df3-stage1-r19 step 120000 (EMA shadow) safetensors + model card

Browse files
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - protein-structure-prediction
4
+ - alphafold3
5
+ - deepfold3
6
+ ---
7
+
8
+ # DeepFold3
9
+
10
+ Weights for DeepFold3, a PyTorch biomolecular complex structure predictor architecturally equivalent to AlphaFold 3.
11
+ Each `.safetensors` file embeds its architectural `ModelConfig` as JSON in the header (`model_cfg_json`), so
12
+ `deepfold3 inference` rebuilds the trained architecture without a sidecar config.
13
+
14
+ ## Checkpoints
15
+
16
+ | File | Run | Step | Snapshot | Params | SHA-256 |
17
+ | --- | --- | --- | --- | --- | --- |
18
+ | `df3-stage1-r19/checkpoint_120000.safetensors` | df3-stage1-r19 | 120,000 | EMA shadow (decay 0.999) | 310,190,170 (fp32) | `aef0468336c0a0ed7ecdadbb5397cfbfe3de0c552b72957dc77b6d1fea29ba2e` |
19
+
20
+ ## df3-stage1-r19 @ 120k
21
+
22
+ **Architecture (r19).** The trunk has no triangle attention and no single track: each PairFormer block is
23
+ TriMulOutgoing + TriMulIncoming (plain AF3 TriangleMul) + FFN, following the pair-track design of
24
+ arXiv:2510.18870. Diffusion conditioning does not consume the trunk single (`conditioning_use_trunk_single: false`).
25
+ The confidence-head and template PairFormers are unchanged from AF3.
26
+
27
+ | | |
28
+ | --- | --- |
29
+ | pair / single / MSA channels | 256 / 384 / 128 |
30
+ | PairFormer layers | 48 |
31
+ | MSA module layers | 4 |
32
+ | Diffusion transformer blocks | 24 |
33
+ | Confidence PairFormer layers | 4 |
34
+ | Recycles | 10 |
35
+
36
+ **Training.**
37
+
38
+ - Stage 0 from scratch (`configs/df3-stage0-r19.yaml`) to step 71,000, then stage 1 (`configs/stage1.yaml`:
39
+ 512-token crop, bond loss on, shape-complementarity loss 0.03) resumed from that checkpoint.
40
+ - AdamW, lr 9e-4, EMA decay 0.999, 112 GPUs.
41
+ - Dataset mix (weights at step 120k): OpenFold3 `pdb_training_set` 0.5, OF3 long monomers 0.2, AFDB (NVIDIA)
42
+ 0.15, TEDdymer 0.1, OF3 short monomers 0.05. The weighted PDB set was `patchr` until step 20,000.
43
+ - Step 120,000 is the optimizer step (`effective_step`). The checkpoint's `global_step` is 169,000 because stage 1
44
+ accumulates 2 micro-batches per step.
45
+
46
+ **Export.** `deepfold3 export --snapshot auto` from `runs/df3-stage1-r19/checkpoint_120000.pt` (commit `131baf6`).
47
+ The run is AdamW + EMA, so `auto` selects the EMA shadow (the deployment snapshot used by inference and eval).
48
+ Verified bitwise-identical to the checkpoint's shadow overlay; loads into `DeepFold3` with no missing or
49
+ unexpected keys.
50
+
51
+ ## Usage
52
+
53
+ ```bash
54
+ hf download vv137/deepfold3 df3-stage1-r19/checkpoint_120000.safetensors --local-dir weights/
55
+ deepfold3 inference --json input.json --output out/ \
56
+ --params weights/df3-stage1-r19/checkpoint_120000.safetensors
57
+ ```
df3-stage1-r19/checkpoint_120000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aef0468336c0a0ed7ecdadbb5397cfbfe3de0c552b72957dc77b6d1fea29ba2e
3
+ size 1241052144