Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,61 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
library_name: fairseq
|
| 4 |
+
datasets:
|
| 5 |
+
- charlesnovak/InstructPro2Bench
|
| 6 |
+
tags:
|
| 7 |
+
- biology
|
| 8 |
+
- protein-design
|
| 9 |
+
- ligand-binding
|
| 10 |
+
- antibody-design
|
| 11 |
+
- pytorch
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# InstructPro2
|
| 15 |
+
|
| 16 |
+
Model weights for **[InstructPro2: Natural Language and Biological Grounding Guided De Novo Protein Design](https://arxiv.org/abs/2610.19592)** — a 3.2B protein design model that generates sequences from natural-language function descriptions, optionally conditioned on a ligand or an antigen.
|
| 17 |
+
|
| 18 |
+
Code: [chovak/InstructPro2](https://github.com/chovak/InstructPro2) ·
|
| 19 |
+
Data: [charlesnovak/InstructPro2Bench](https://huggingface.co/datasets/charlesnovak/InstructPro2Bench) ·
|
| 20 |
+
Paper: [arXiv:2610.19592](https://arxiv.org/abs/2610.19592)
|
| 21 |
+
|
| 22 |
+
## Download
|
| 23 |
+
|
| 24 |
+
```bash
|
| 25 |
+
export WORK_ROOT=/path/to/workspace # default: ~/instructpro2
|
| 26 |
+
huggingface-cli download charlesnovak/InstructPro2 --local-dir $WORK_ROOT/model
|
| 27 |
+
```
|
| 28 |
+
|
| 29 |
+
## Checkpoints
|
| 30 |
+
|
| 31 |
+
| File / Directory | Parameters | Use |
|
| 32 |
+
|---|---:|---|
|
| 33 |
+
| `instructpro2_stage1.pt` | 2.87B | Pretrained on InstructPro2Bench. Text-conditioned generation, and the starting point for finetuning. |
|
| 34 |
+
| `instructpro2_stage2_ligand.pt` | 3.22B | Ligand-binding protein design, conditioned on SMILES. |
|
| 35 |
+
| `instructpro2_stage2_antibody.pt` | 3.22B | Antibody design — HCDR1–3 infilling conditioned on an antigen. |
|
| 36 |
+
| `progen2/progen2-large-BFD90/` | 2.7B | Base ProGen2 decoder configuration and weights ([Nijkamp et al., 2023](https://arxiv.org/abs/2206.13517); BSD-3-Clause), used for model initialization and Stage 1 pretraining. |
|
| 37 |
+
|
| 38 |
+
The Stage 2 checkpoints are larger because they carry the gated cross-attention adapters and the frozen ChemBERTa and ESM-2 encoders.
|
| 39 |
+
|
| 40 |
+
## Use
|
| 41 |
+
|
| 42 |
+
Pass a checkpoint to the scripts in the code repository:
|
| 43 |
+
|
| 44 |
+
```bash
|
| 45 |
+
MODEL_CHECKPOINT=$WORK_ROOT/model/instructpro2_stage1.pt bash validate_stage1.sh
|
| 46 |
+
MODEL_CHECKPOINT=$WORK_ROOT/model/instructpro2_stage2_ligand.pt bash eval_ligand.sh
|
| 47 |
+
MODEL_CHECKPOINT=$WORK_ROOT/model/instructpro2_stage2_antibody.pt bash eval_antibody.sh
|
| 48 |
+
```
|
| 49 |
+
|
| 50 |
+
The scripts set the architecture mode and the generation settings for each checkpoint; see the [code repository's README](https://github.com/chovak/InstructPro2).
|
| 51 |
+
|
| 52 |
+
## Citation
|
| 53 |
+
|
| 54 |
+
```bibtex
|
| 55 |
+
@article{instructpro2,
|
| 56 |
+
title = {InstructPro2: Natural Language and Biological Grounding Guided De Novo Protein Design},
|
| 57 |
+
author = {Charles Novak and Zhenqiao Song and Chuan Li and Jianwen Xie and Lei Li},
|
| 58 |
+
journal = {arXiv preprint arXiv:2610.19592},
|
| 59 |
+
year = {2026}
|
| 60 |
+
}
|
| 61 |
+
```
|