lhallee commited on
Commit
a9dcd0b
·
verified ·
1 Parent(s): 2152003

Improve generated model cards

Browse files

Add-only FastPLMs files-only publication. Checkpoint weights and complete-artifact attestations are unchanged.

Files changed (1) hide show
  1. README.md +43 -43
README.md CHANGED
@@ -8,29 +8,21 @@ tags:
8
 
9
  <!-- Generated from src/fastplms/models.toml. Do not edit. -->
10
 
11
- # Synthyra/DPLM2-3B
12
 
13
- This checkpoint contains the FastPLMs `DPLM2` implementation.
14
 
15
- Accepted inputs are tokenized amino-acid and structure tracks with explicit
16
- modality boundaries.
17
- Supported Transformers entry points are `AutoConfig`, `AutoModel`,
18
- `AutoModelForMaskedLM`, `AutoModelForSequenceClassification`,
19
- `AutoModelForTokenClassification`.
20
 
21
- ## Capabilities
 
 
22
 
23
- | Feature | Status |
24
- | --- | --- |
25
- | Sequence classification | Supported: base weights with an untrained task head |
26
- | Token classification | Supported: base weights with an untrained task head |
27
- | PEFT fine-tuning | Supported pattern: preserve the separately trained `classifier` |
28
- | Embeddings | Supported: shared ordered embedding API |
29
- | Test-time training | Supported: low-rank masked-residue adaptation |
30
- | Attention variants | Supported: `sdpa` |
31
- | Compliance | Declared: exact release evidence is required |
32
-
33
- A supported interface is not a pretrained downstream predictor. Classification heads start untrained. Compliance metadata does not show that a local build passed its release gate.
34
 
35
  ## Install and platform requirements
36
 
@@ -44,9 +36,14 @@ python -m pip install -r \
44
  The FastPLMs implementation itself is embedded in the model repository.
45
  Transformers loads it through `trust_remote_code=True`.
46
 
47
- This model requires Python 3.11-3.14, PyTorch 2.13, and Transformers 5.13. The CPU gate covers small offline tests. Published checkpoint throughput and parity require the documented device tier. The Hub quick start needs network access for
48
- the first download. For an air-gapped run, build the manifest-pinned local
49
- artifact first and use the offline example.
 
 
 
 
 
50
 
51
  ## Quick start
52
 
@@ -64,16 +61,16 @@ model = AutoModel.from_pretrained(
64
  For offline validation, replace `model_id` with the manifest-built
65
  `dist/hub/DPLM2-3B` path. Pass `local_files_only=True`.
66
 
67
- ## Attention and compliance
 
 
 
 
 
68
 
69
- The quick start selects `sdpa` explicitly. Declared variants are `sdpa`. An unavailable requested backend raises. It does
70
- not silently change implementation.
71
  `output_attentions=True` can use the documented one-call eager fallback to
72
  materialize attention tensors. The configured backend does not change.
73
 
74
- This family declares the `compliance` tier. Release evidence identifies the
75
- checkpoint, backend, dtype, hardware, inputs, and reference revision.
76
-
77
  ## Dataset embeddings
78
 
79
  The shared embedding mixin keeps input order and biological-position masking.
@@ -244,24 +241,28 @@ The pinned official DPLM2-3B sampler fails before generation, so live
244
  generation equivalence cannot be established for this checkpoint. State,
245
  tokenizer, and inference parity remain required.
246
 
247
- ## Runtime contract
248
 
249
- - Public input: Tokenized amino-acid and structure tracks with explicit modality boundaries
250
- - Advertised AutoClasses: `AutoConfig`, `AutoModel`, `AutoModelForMaskedLM`, `AutoModelForSequenceClassification`, `AutoModelForTokenClassification`
251
- - AutoClass weight status: `AutoConfig` = `FastPLMs extension`, `AutoModel` = `pretrained`, `AutoModelForMaskedLM` = `pretrained`, `AutoModelForSequenceClassification` = `base weights + untrained task head`, `AutoModelForTokenClassification` = `base weights + untrained task head`
252
- - Attention implementations: `sdpa`
253
- - Precision policies: `default`
254
  - BF16 execution: `fp32_parameters_autocast`
255
  - Generation contract: `official_unavailable`
256
- - Artifact dependency set: `core`
257
  - Weight publication allowed: `true`
258
  - Weight license status: `resolved`
259
  - Redistributable: `true`
260
  - Complete weight publication required: `false`
261
 
262
- ## Release record
 
 
 
 
263
 
264
- - FastPLMs weights: `Synthyra/DPLM2-3B`
265
  - Runtime revision: recorded separately in the built artifact and published commit
266
  - Runtime source identities: recorded in `source-record.json`
267
  - Canonical transformed state identity: recorded in `source-record.json`
@@ -274,14 +275,13 @@ tokenizer, and inference parity remain required.
274
  - Release tiers: `check`, `compliance`, `feature`, `artifact`, `benchmark`
275
  - Unresolved required file identities: `0`
276
 
277
- The source record records exact file identities, conversion, source revisions,
278
- legal texts, schema, and attestations. A nonzero unresolved count blocks a release.
279
-
280
- ## Validation boundary
281
 
282
  Declared tiers compare configuration, tokenizer behavior, state, and
283
- representative inference with the pinned reference. Metadata does not show that
284
- a build passed, that a backend is faster, or that an output is biologically valid.
 
285
 
286
  ## License
287
 
 
8
 
9
  <!-- Generated from src/fastplms/models.toml. Do not edit. -->
10
 
11
+ # DPLM2-3B
12
 
13
+ ## Model overview
14
 
15
+ `Synthyra/DPLM2-3B` packages the `airkingbd/dplm2_3b` checkpoint with the
16
+ FastPLMs runtime for Hugging Face Transformers. It accepts tokenized amino-acid
17
+ and structure tracks with explicit modality boundaries.
 
 
18
 
19
+ The repository uses the standard Transformers loading interface with
20
+ `trust_remote_code=True`. See Technical details for each registered class and
21
+ whether its weights come from the checkpoint.
22
 
23
+ The sequence- and token-classification classes reuse the pretrained backbone,
24
+ but their task heads are newly initialized. Fine-tune those heads before
25
+ interpreting their logits as predictions.
 
 
 
 
 
 
 
 
26
 
27
  ## Install and platform requirements
28
 
 
36
  The FastPLMs implementation itself is embedded in the model repository.
37
  Transformers loads it through `trust_remote_code=True`.
38
 
39
+ This model requires Python 3.11-3.14, PyTorch 2.13, and Transformers 5.13.
40
+
41
+ The CPU gate covers small offline tests. Published checkpoint throughput and
42
+ parity require the documented device tier.
43
+
44
+ The Hub quick start needs network access for the first download. For an
45
+ air-gapped run, build the manifest-pinned local artifact first and use the
46
+ offline example.
47
 
48
  ## Quick start
49
 
 
61
  For offline validation, replace `model_id` with the manifest-built
62
  `dist/hub/DPLM2-3B` path. Pass `local_files_only=True`.
63
 
64
+ ## Attention backends
65
+
66
+ The quick start uses `sdpa`.
67
+
68
+ Available backends are `sdpa`. Requesting an unavailable backend raises instead
69
+ of silently changing implementation.
70
 
 
 
71
  `output_attentions=True` can use the documented one-call eager fallback to
72
  materialize attention tensors. The configured backend does not change.
73
 
 
 
 
74
  ## Dataset embeddings
75
 
76
  The shared embedding mixin keeps input order and biological-position masking.
 
241
  generation equivalence cannot be established for this checkpoint. State,
242
  tokenizer, and inference parity remain required.
243
 
244
+ ## Technical details
245
 
246
+ - Inputs: Tokenized amino-acid and structure tracks with explicit modality boundaries
247
+ - Transformers classes: `AutoConfig`, `AutoModel`, `AutoModelForMaskedLM`, `AutoModelForSequenceClassification`, `AutoModelForTokenClassification`
248
+ - Checkpoint weights: `AutoConfig` = `FastPLMs extension`, `AutoModel` = `pretrained`, `AutoModelForMaskedLM` = `pretrained`, `AutoModelForSequenceClassification` = `base weights + untrained task head`, `AutoModelForTokenClassification` = `base weights + untrained task head`
249
+ - Attention backends: `sdpa`
250
+ - Precision: `default`
251
  - BF16 execution: `fp32_parameters_autocast`
252
  - Generation contract: `official_unavailable`
253
+ - Dependencies: `core`
254
  - Weight publication allowed: `true`
255
  - Weight license status: `resolved`
256
  - Redistributable: `true`
257
  - Complete weight publication required: `false`
258
 
259
+ ## Validation and provenance
260
+
261
+ FastPLMs pins the checkpoint, upstream source revisions, state transformation,
262
+ and required files in `models.toml`. Built artifacts record exact source
263
+ identities and conversion details in `source-record.json`.
264
 
265
+ - FastPLMs checkpoint: `Synthyra/DPLM2-3B`
266
  - Runtime revision: recorded separately in the built artifact and published commit
267
  - Runtime source identities: recorded in `source-record.json`
268
  - Canonical transformed state identity: recorded in `source-record.json`
 
275
  - Release tiers: `check`, `compliance`, `feature`, `artifact`, `benchmark`
276
  - Unresolved required file identities: `0`
277
 
278
+ Release validation includes the `compliance` tier. Its evidence identifies the
279
+ checkpoint, backend, dtype, hardware, inputs, and reference revision.
 
 
280
 
281
  Declared tiers compare configuration, tokenizer behavior, state, and
282
+ representative inference with the pinned reference. A nonzero unresolved count
283
+ blocks release. Metadata alone does not show that a build passed, that a backend
284
+ is faster, or that an output is biologically valid.
285
 
286
  ## License
287