Instructions to use Synthyra/ESM2-650M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Synthyra/ESM2-650M with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="Synthyra/ESM2-650M", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForMaskedLM model = AutoModelForMaskedLM.from_pretrained("Synthyra/ESM2-650M", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update FastPLMs runtime files
Browse filesAdd-only FastPLMs files-only publication. Checkpoint weights and complete-artifact attestations are unchanged.
- README.md +4 -5
- config.json +3 -3
- runtime-attestation.json +5 -5
README.md
CHANGED
|
@@ -19,11 +19,11 @@ Supported Transformers entry points are `AutoConfig`, `AutoModel`,
|
|
| 19 |
|
| 20 |
## Install and platform requirements
|
| 21 |
|
| 22 |
-
Install
|
| 23 |
|
| 24 |
```bash
|
| 25 |
python -m pip install \
|
| 26 |
-
"fastplms @ git+https://github.com/Synthyra/FastPLMs.git
|
| 27 |
```
|
| 28 |
|
| 29 |
Python 3.11-3.14, PyTorch 2.13, and Transformers 5.13 are required. Eager, SDPA, and Flex use the core install. FlashAttention requires the `flash` extra, compatible CUDA hardware, and BF16 execution. The Hub quick start below requires network
|
|
@@ -175,9 +175,8 @@ head.
|
|
| 175 |
## Release record
|
| 176 |
|
| 177 |
- FastPLMs weights: `Synthyra/ESM2-650M`
|
| 178 |
-
- Runtime revision:
|
| 179 |
-
-
|
| 180 |
-
- Runtime bundle SHA-256: `0e9cee71faeeb3dd6406d10d4107c209b10379ab0ee07d0115b13102b6525460`
|
| 181 |
- Generator/schema version and complete/runtime-only attestations: recorded in `provenance.json`
|
| 182 |
- Official checkpoint: `facebook/esm2_t33_650M_UR50D`
|
| 183 |
- Artifact source: `fast`
|
|
|
|
| 19 |
|
| 20 |
## Install and platform requirements
|
| 21 |
|
| 22 |
+
Install the current FastPLMs package:
|
| 23 |
|
| 24 |
```bash
|
| 25 |
python -m pip install \
|
| 26 |
+
"fastplms @ git+https://github.com/Synthyra/FastPLMs.git"
|
| 27 |
```
|
| 28 |
|
| 29 |
Python 3.11-3.14, PyTorch 2.13, and Transformers 5.13 are required. Eager, SDPA, and Flex use the core install. FlashAttention requires the `flash` extra, compatible CUDA hardware, and BF16 execution. The Hub quick start below requires network
|
|
|
|
| 175 |
## Release record
|
| 176 |
|
| 177 |
- FastPLMs weights: `Synthyra/ESM2-650M`
|
| 178 |
+
- Runtime revision: recorded separately in the built artifact and published commit
|
| 179 |
+
- Source-tree and runtime-bundle SHA-256: recorded in `provenance.json`
|
|
|
|
| 180 |
- Generator/schema version and complete/runtime-only attestations: recorded in `provenance.json`
|
| 181 |
- Official checkpoint: `facebook/esm2_t33_650M_UR50D`
|
| 182 |
- Artifact source: `fast`
|
config.json
CHANGED
|
@@ -19,10 +19,10 @@
|
|
| 19 |
"fastplms_checkpoint_repo_id": "Synthyra/ESM2-650M",
|
| 20 |
"fastplms_checkpoint_revision": "ca0718a5d52b80d5c60dd76860e55e061a95fb0a",
|
| 21 |
"fastplms_model_id": "esm2_650m",
|
| 22 |
-
"fastplms_release_tool_revision": "
|
| 23 |
-
"fastplms_release_tool_sha256": "
|
| 24 |
"fastplms_runtime_bundle_sha256": "0e9cee71faeeb3dd6406d10d4107c209b10379ab0ee07d0115b13102b6525460",
|
| 25 |
-
"fastplms_runtime_revision": "
|
| 26 |
"fastplms_source_tree_sha256": "fb8779cf2f90db290a898b170b6c6d2ebe9835b89dc946cc99a94417cb586aa4",
|
| 27 |
"fastplms_weights_revision": "ca0718a5d52b80d5c60dd76860e55e061a95fb0a",
|
| 28 |
"hidden_act": "gelu",
|
|
|
|
| 19 |
"fastplms_checkpoint_repo_id": "Synthyra/ESM2-650M",
|
| 20 |
"fastplms_checkpoint_revision": "ca0718a5d52b80d5c60dd76860e55e061a95fb0a",
|
| 21 |
"fastplms_model_id": "esm2_650m",
|
| 22 |
+
"fastplms_release_tool_revision": "95691a87c781f052f65b6ab3ca99dfce4ebb59c7",
|
| 23 |
+
"fastplms_release_tool_sha256": "19b4247aba04a74de5069397518374ab2c3b9e0ce18ba9f36de34f0f4c5d1ceb",
|
| 24 |
"fastplms_runtime_bundle_sha256": "0e9cee71faeeb3dd6406d10d4107c209b10379ab0ee07d0115b13102b6525460",
|
| 25 |
+
"fastplms_runtime_revision": "95691a87c781f052f65b6ab3ca99dfce4ebb59c7",
|
| 26 |
"fastplms_source_tree_sha256": "fb8779cf2f90db290a898b170b6c6d2ebe9835b89dc946cc99a94417cb586aa4",
|
| 27 |
"fastplms_weights_revision": "ca0718a5d52b80d5c60dd76860e55e061a95fb0a",
|
| 28 |
"hidden_act": "gelu",
|
runtime-attestation.json
CHANGED
|
@@ -3,9 +3,9 @@
|
|
| 3 |
"LICENSES/FastPLMs-Apache-2.0.txt": "sha256:2d2b50c7b1414bff1189a1db1f0cfb92e3e064b50f4c2b1019827b683e1b629a",
|
| 4 |
"LICENSES/fair-esm/LICENSE": "sha256:da6d3703ed11cbe42bd212c725957c98da23cbff1998c05fa4b3d976d1a58e93",
|
| 5 |
"LICENSES/fair-esm/PROVENANCE.md": "sha256:950adb94daf15e646ddf226dacfe2a8e77801aa0793e439a9a3490a48eb666e7",
|
| 6 |
-
"README.md": "sha256:
|
| 7 |
"THIRD_PARTY_NOTICES.md": "sha256:25704b3c76404696cae52e7fca13088d329f70f412687340351259e86cd62baa",
|
| 8 |
-
"config.json": "sha256:
|
| 9 |
"fastplms/__init__.py": "sha256:4fb3196022ca8ec699d59d09bdbc5f0184195552b773698ab9b061fe3cd7df12",
|
| 10 |
"fastplms/attention/__init__.py": "sha256:f60b9fecfb4bcb37a4e7c26dc2f752b9035f9cbad627b4a84213f3a92ec88f7d",
|
| 11 |
"fastplms/attention/_core.py": "sha256:8f7ec5b65bd8b6c6fa4951d50d1c0e499abf03ae00914794b51fc410201e3e33",
|
|
@@ -33,10 +33,10 @@
|
|
| 33 |
},
|
| 34 |
"model_id": "esm2_650m",
|
| 35 |
"redistributable": true,
|
| 36 |
-
"release_tool_revision": "
|
| 37 |
-
"release_tool_sha256": "
|
| 38 |
"runtime_bundle_sha256": "0e9cee71faeeb3dd6406d10d4107c209b10379ab0ee07d0115b13102b6525460",
|
| 39 |
-
"runtime_revision": "
|
| 40 |
"schema_version": 2,
|
| 41 |
"scope": "runtime-only",
|
| 42 |
"source_tree_sha256": "fb8779cf2f90db290a898b170b6c6d2ebe9835b89dc946cc99a94417cb586aa4",
|
|
|
|
| 3 |
"LICENSES/FastPLMs-Apache-2.0.txt": "sha256:2d2b50c7b1414bff1189a1db1f0cfb92e3e064b50f4c2b1019827b683e1b629a",
|
| 4 |
"LICENSES/fair-esm/LICENSE": "sha256:da6d3703ed11cbe42bd212c725957c98da23cbff1998c05fa4b3d976d1a58e93",
|
| 5 |
"LICENSES/fair-esm/PROVENANCE.md": "sha256:950adb94daf15e646ddf226dacfe2a8e77801aa0793e439a9a3490a48eb666e7",
|
| 6 |
+
"README.md": "sha256:75c71120474d027c121e8e77780eb732dc92dc74c609df3c098f673391fcb72f",
|
| 7 |
"THIRD_PARTY_NOTICES.md": "sha256:25704b3c76404696cae52e7fca13088d329f70f412687340351259e86cd62baa",
|
| 8 |
+
"config.json": "sha256:9240140eb2575c3f373479ac060b14d50a0bf0d61133b95def32922c17cb92e4",
|
| 9 |
"fastplms/__init__.py": "sha256:4fb3196022ca8ec699d59d09bdbc5f0184195552b773698ab9b061fe3cd7df12",
|
| 10 |
"fastplms/attention/__init__.py": "sha256:f60b9fecfb4bcb37a4e7c26dc2f752b9035f9cbad627b4a84213f3a92ec88f7d",
|
| 11 |
"fastplms/attention/_core.py": "sha256:8f7ec5b65bd8b6c6fa4951d50d1c0e499abf03ae00914794b51fc410201e3e33",
|
|
|
|
| 33 |
},
|
| 34 |
"model_id": "esm2_650m",
|
| 35 |
"redistributable": true,
|
| 36 |
+
"release_tool_revision": "95691a87c781f052f65b6ab3ca99dfce4ebb59c7",
|
| 37 |
+
"release_tool_sha256": "19b4247aba04a74de5069397518374ab2c3b9e0ce18ba9f36de34f0f4c5d1ceb",
|
| 38 |
"runtime_bundle_sha256": "0e9cee71faeeb3dd6406d10d4107c209b10379ab0ee07d0115b13102b6525460",
|
| 39 |
+
"runtime_revision": "95691a87c781f052f65b6ab3ca99dfce4ebb59c7",
|
| 40 |
"schema_version": 2,
|
| 41 |
"scope": "runtime-only",
|
| 42 |
"source_tree_sha256": "fb8779cf2f90db290a898b170b6c6d2ebe9835b89dc946cc99a94417cb586aa4",
|