Add df3-stage1-r19 step 120000 (EMA shadow) safetensors + model card
Browse files- README.md +57 -0
- df3-stage1-r19/checkpoint_120000.safetensors +3 -0
README.md
ADDED
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- protein-structure-prediction
|
| 4 |
+
- alphafold3
|
| 5 |
+
- deepfold3
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
# DeepFold3
|
| 9 |
+
|
| 10 |
+
Weights for DeepFold3, a PyTorch biomolecular complex structure predictor architecturally equivalent to AlphaFold 3.
|
| 11 |
+
Each `.safetensors` file embeds its architectural `ModelConfig` as JSON in the header (`model_cfg_json`), so
|
| 12 |
+
`deepfold3 inference` rebuilds the trained architecture without a sidecar config.
|
| 13 |
+
|
| 14 |
+
## Checkpoints
|
| 15 |
+
|
| 16 |
+
| File | Run | Step | Snapshot | Params | SHA-256 |
|
| 17 |
+
| --- | --- | --- | --- | --- | --- |
|
| 18 |
+
| `df3-stage1-r19/checkpoint_120000.safetensors` | df3-stage1-r19 | 120,000 | EMA shadow (decay 0.999) | 310,190,170 (fp32) | `aef0468336c0a0ed7ecdadbb5397cfbfe3de0c552b72957dc77b6d1fea29ba2e` |
|
| 19 |
+
|
| 20 |
+
## df3-stage1-r19 @ 120k
|
| 21 |
+
|
| 22 |
+
**Architecture (r19).** The trunk has no triangle attention and no single track: each PairFormer block is
|
| 23 |
+
TriMulOutgoing + TriMulIncoming (plain AF3 TriangleMul) + FFN, following the pair-track design of
|
| 24 |
+
arXiv:2510.18870. Diffusion conditioning does not consume the trunk single (`conditioning_use_trunk_single: false`).
|
| 25 |
+
The confidence-head and template PairFormers are unchanged from AF3.
|
| 26 |
+
|
| 27 |
+
| | |
|
| 28 |
+
| --- | --- |
|
| 29 |
+
| pair / single / MSA channels | 256 / 384 / 128 |
|
| 30 |
+
| PairFormer layers | 48 |
|
| 31 |
+
| MSA module layers | 4 |
|
| 32 |
+
| Diffusion transformer blocks | 24 |
|
| 33 |
+
| Confidence PairFormer layers | 4 |
|
| 34 |
+
| Recycles | 10 |
|
| 35 |
+
|
| 36 |
+
**Training.**
|
| 37 |
+
|
| 38 |
+
- Stage 0 from scratch (`configs/df3-stage0-r19.yaml`) to step 71,000, then stage 1 (`configs/stage1.yaml`:
|
| 39 |
+
512-token crop, bond loss on, shape-complementarity loss 0.03) resumed from that checkpoint.
|
| 40 |
+
- AdamW, lr 9e-4, EMA decay 0.999, 112 GPUs.
|
| 41 |
+
- Dataset mix (weights at step 120k): OpenFold3 `pdb_training_set` 0.5, OF3 long monomers 0.2, AFDB (NVIDIA)
|
| 42 |
+
0.15, TEDdymer 0.1, OF3 short monomers 0.05. The weighted PDB set was `patchr` until step 20,000.
|
| 43 |
+
- Step 120,000 is the optimizer step (`effective_step`). The checkpoint's `global_step` is 169,000 because stage 1
|
| 44 |
+
accumulates 2 micro-batches per step.
|
| 45 |
+
|
| 46 |
+
**Export.** `deepfold3 export --snapshot auto` from `runs/df3-stage1-r19/checkpoint_120000.pt` (commit `131baf6`).
|
| 47 |
+
The run is AdamW + EMA, so `auto` selects the EMA shadow (the deployment snapshot used by inference and eval).
|
| 48 |
+
Verified bitwise-identical to the checkpoint's shadow overlay; loads into `DeepFold3` with no missing or
|
| 49 |
+
unexpected keys.
|
| 50 |
+
|
| 51 |
+
## Usage
|
| 52 |
+
|
| 53 |
+
```bash
|
| 54 |
+
hf download vv137/deepfold3 df3-stage1-r19/checkpoint_120000.safetensors --local-dir weights/
|
| 55 |
+
deepfold3 inference --json input.json --output out/ \
|
| 56 |
+
--params weights/df3-stage1-r19/checkpoint_120000.safetensors
|
| 57 |
+
```
|
df3-stage1-r19/checkpoint_120000.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aef0468336c0a0ed7ecdadbb5397cfbfe3de0c552b72957dc77b6d1fea29ba2e
|
| 3 |
+
size 1241052144
|