Instructions to use Synthyra/DPLM2-3B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Synthyra/DPLM2-3B with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, EsmForDPLM2 tokenizer = AutoTokenizer.from_pretrained("Synthyra/DPLM2-3B", trust_remote_code=True) model = EsmForDPLM2.from_pretrained("Synthyra/DPLM2-3B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Improve generated model cards
Browse filesAdd-only FastPLMs files-only publication. Checkpoint weights and complete-artifact attestations are unchanged.
README.md
CHANGED
|
@@ -8,29 +8,21 @@ tags:
|
|
| 8 |
|
| 9 |
<!-- Generated from src/fastplms/models.toml. Do not edit. -->
|
| 10 |
|
| 11 |
-
#
|
| 12 |
|
| 13 |
-
|
| 14 |
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
`AutoModelForMaskedLM`, `AutoModelForSequenceClassification`,
|
| 19 |
-
`AutoModelForTokenClassification`.
|
| 20 |
|
| 21 |
-
|
|
|
|
|
|
|
| 22 |
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
| Token classification | Supported: base weights with an untrained task head |
|
| 27 |
-
| PEFT fine-tuning | Supported pattern: preserve the separately trained `classifier` |
|
| 28 |
-
| Embeddings | Supported: shared ordered embedding API |
|
| 29 |
-
| Test-time training | Supported: low-rank masked-residue adaptation |
|
| 30 |
-
| Attention variants | Supported: `sdpa` |
|
| 31 |
-
| Compliance | Declared: exact release evidence is required |
|
| 32 |
-
|
| 33 |
-
A supported interface is not a pretrained downstream predictor. Classification heads start untrained. Compliance metadata does not show that a local build passed its release gate.
|
| 34 |
|
| 35 |
## Install and platform requirements
|
| 36 |
|
|
@@ -44,9 +36,14 @@ python -m pip install -r \
|
|
| 44 |
The FastPLMs implementation itself is embedded in the model repository.
|
| 45 |
Transformers loads it through `trust_remote_code=True`.
|
| 46 |
|
| 47 |
-
This model requires Python 3.11-3.14, PyTorch 2.13, and Transformers 5.13.
|
| 48 |
-
|
| 49 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
## Quick start
|
| 52 |
|
|
@@ -64,16 +61,16 @@ model = AutoModel.from_pretrained(
|
|
| 64 |
For offline validation, replace `model_id` with the manifest-built
|
| 65 |
`dist/hub/DPLM2-3B` path. Pass `local_files_only=True`.
|
| 66 |
|
| 67 |
-
## Attention
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 68 |
|
| 69 |
-
The quick start selects `sdpa` explicitly. Declared variants are `sdpa`. An unavailable requested backend raises. It does
|
| 70 |
-
not silently change implementation.
|
| 71 |
`output_attentions=True` can use the documented one-call eager fallback to
|
| 72 |
materialize attention tensors. The configured backend does not change.
|
| 73 |
|
| 74 |
-
This family declares the `compliance` tier. Release evidence identifies the
|
| 75 |
-
checkpoint, backend, dtype, hardware, inputs, and reference revision.
|
| 76 |
-
|
| 77 |
## Dataset embeddings
|
| 78 |
|
| 79 |
The shared embedding mixin keeps input order and biological-position masking.
|
|
@@ -244,24 +241,28 @@ The pinned official DPLM2-3B sampler fails before generation, so live
|
|
| 244 |
generation equivalence cannot be established for this checkpoint. State,
|
| 245 |
tokenizer, and inference parity remain required.
|
| 246 |
|
| 247 |
-
##
|
| 248 |
|
| 249 |
-
-
|
| 250 |
-
-
|
| 251 |
-
-
|
| 252 |
-
- Attention
|
| 253 |
-
- Precision
|
| 254 |
- BF16 execution: `fp32_parameters_autocast`
|
| 255 |
- Generation contract: `official_unavailable`
|
| 256 |
-
-
|
| 257 |
- Weight publication allowed: `true`
|
| 258 |
- Weight license status: `resolved`
|
| 259 |
- Redistributable: `true`
|
| 260 |
- Complete weight publication required: `false`
|
| 261 |
|
| 262 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
| 263 |
|
| 264 |
-
- FastPLMs
|
| 265 |
- Runtime revision: recorded separately in the built artifact and published commit
|
| 266 |
- Runtime source identities: recorded in `source-record.json`
|
| 267 |
- Canonical transformed state identity: recorded in `source-record.json`
|
|
@@ -274,14 +275,13 @@ tokenizer, and inference parity remain required.
|
|
| 274 |
- Release tiers: `check`, `compliance`, `feature`, `artifact`, `benchmark`
|
| 275 |
- Unresolved required file identities: `0`
|
| 276 |
|
| 277 |
-
|
| 278 |
-
|
| 279 |
-
|
| 280 |
-
## Validation boundary
|
| 281 |
|
| 282 |
Declared tiers compare configuration, tokenizer behavior, state, and
|
| 283 |
-
representative inference with the pinned reference.
|
| 284 |
-
|
|
|
|
| 285 |
|
| 286 |
## License
|
| 287 |
|
|
|
|
| 8 |
|
| 9 |
<!-- Generated from src/fastplms/models.toml. Do not edit. -->
|
| 10 |
|
| 11 |
+
# DPLM2-3B
|
| 12 |
|
| 13 |
+
## Model overview
|
| 14 |
|
| 15 |
+
`Synthyra/DPLM2-3B` packages the `airkingbd/dplm2_3b` checkpoint with the
|
| 16 |
+
FastPLMs runtime for Hugging Face Transformers. It accepts tokenized amino-acid
|
| 17 |
+
and structure tracks with explicit modality boundaries.
|
|
|
|
|
|
|
| 18 |
|
| 19 |
+
The repository uses the standard Transformers loading interface with
|
| 20 |
+
`trust_remote_code=True`. See Technical details for each registered class and
|
| 21 |
+
whether its weights come from the checkpoint.
|
| 22 |
|
| 23 |
+
The sequence- and token-classification classes reuse the pretrained backbone,
|
| 24 |
+
but their task heads are newly initialized. Fine-tune those heads before
|
| 25 |
+
interpreting their logits as predictions.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
|
| 27 |
## Install and platform requirements
|
| 28 |
|
|
|
|
| 36 |
The FastPLMs implementation itself is embedded in the model repository.
|
| 37 |
Transformers loads it through `trust_remote_code=True`.
|
| 38 |
|
| 39 |
+
This model requires Python 3.11-3.14, PyTorch 2.13, and Transformers 5.13.
|
| 40 |
+
|
| 41 |
+
The CPU gate covers small offline tests. Published checkpoint throughput and
|
| 42 |
+
parity require the documented device tier.
|
| 43 |
+
|
| 44 |
+
The Hub quick start needs network access for the first download. For an
|
| 45 |
+
air-gapped run, build the manifest-pinned local artifact first and use the
|
| 46 |
+
offline example.
|
| 47 |
|
| 48 |
## Quick start
|
| 49 |
|
|
|
|
| 61 |
For offline validation, replace `model_id` with the manifest-built
|
| 62 |
`dist/hub/DPLM2-3B` path. Pass `local_files_only=True`.
|
| 63 |
|
| 64 |
+
## Attention backends
|
| 65 |
+
|
| 66 |
+
The quick start uses `sdpa`.
|
| 67 |
+
|
| 68 |
+
Available backends are `sdpa`. Requesting an unavailable backend raises instead
|
| 69 |
+
of silently changing implementation.
|
| 70 |
|
|
|
|
|
|
|
| 71 |
`output_attentions=True` can use the documented one-call eager fallback to
|
| 72 |
materialize attention tensors. The configured backend does not change.
|
| 73 |
|
|
|
|
|
|
|
|
|
|
| 74 |
## Dataset embeddings
|
| 75 |
|
| 76 |
The shared embedding mixin keeps input order and biological-position masking.
|
|
|
|
| 241 |
generation equivalence cannot be established for this checkpoint. State,
|
| 242 |
tokenizer, and inference parity remain required.
|
| 243 |
|
| 244 |
+
## Technical details
|
| 245 |
|
| 246 |
+
- Inputs: Tokenized amino-acid and structure tracks with explicit modality boundaries
|
| 247 |
+
- Transformers classes: `AutoConfig`, `AutoModel`, `AutoModelForMaskedLM`, `AutoModelForSequenceClassification`, `AutoModelForTokenClassification`
|
| 248 |
+
- Checkpoint weights: `AutoConfig` = `FastPLMs extension`, `AutoModel` = `pretrained`, `AutoModelForMaskedLM` = `pretrained`, `AutoModelForSequenceClassification` = `base weights + untrained task head`, `AutoModelForTokenClassification` = `base weights + untrained task head`
|
| 249 |
+
- Attention backends: `sdpa`
|
| 250 |
+
- Precision: `default`
|
| 251 |
- BF16 execution: `fp32_parameters_autocast`
|
| 252 |
- Generation contract: `official_unavailable`
|
| 253 |
+
- Dependencies: `core`
|
| 254 |
- Weight publication allowed: `true`
|
| 255 |
- Weight license status: `resolved`
|
| 256 |
- Redistributable: `true`
|
| 257 |
- Complete weight publication required: `false`
|
| 258 |
|
| 259 |
+
## Validation and provenance
|
| 260 |
+
|
| 261 |
+
FastPLMs pins the checkpoint, upstream source revisions, state transformation,
|
| 262 |
+
and required files in `models.toml`. Built artifacts record exact source
|
| 263 |
+
identities and conversion details in `source-record.json`.
|
| 264 |
|
| 265 |
+
- FastPLMs checkpoint: `Synthyra/DPLM2-3B`
|
| 266 |
- Runtime revision: recorded separately in the built artifact and published commit
|
| 267 |
- Runtime source identities: recorded in `source-record.json`
|
| 268 |
- Canonical transformed state identity: recorded in `source-record.json`
|
|
|
|
| 275 |
- Release tiers: `check`, `compliance`, `feature`, `artifact`, `benchmark`
|
| 276 |
- Unresolved required file identities: `0`
|
| 277 |
|
| 278 |
+
Release validation includes the `compliance` tier. Its evidence identifies the
|
| 279 |
+
checkpoint, backend, dtype, hardware, inputs, and reference revision.
|
|
|
|
|
|
|
| 280 |
|
| 281 |
Declared tiers compare configuration, tokenizer behavior, state, and
|
| 282 |
+
representative inference with the pinned reference. A nonzero unresolved count
|
| 283 |
+
blocks release. Metadata alone does not show that a build passed, that a backend
|
| 284 |
+
is faster, or that an output is biologically valid.
|
| 285 |
|
| 286 |
## License
|
| 287 |
|