Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,22 @@ frameworks:
|
|
| 11 |
- pytorch
|
| 12 |
---
|
| 13 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
# TinyProteinTransformer (TPT)
|
| 15 |
|
| 16 |
TinyProteinTransformer (TPT) is a lightweight CNN-Transformer hybrid encoder designed for microbial smORF-encoded small proteins. It was pretrained on the Global Microbial smORF Catalog (GMSC, >280M sequences) using masked language modeling combined with contrastive learning, producing compact yet expressive residue-level and sequence-level protein representations.
|
|
|
|
| 11 |
- pytorch
|
| 12 |
---
|
| 13 |
|
| 14 |
+
```
|
| 15 |
+
╔═══════════════════════════════════════════════╗
|
| 16 |
+
║ ║
|
| 17 |
+
║ _______ _____ _______ ║
|
| 18 |
+
║ |__ __| __ \__ __| ║
|
| 19 |
+
║ | | | |__) | | | ║
|
| 20 |
+
║ | | | ___/ | | ║
|
| 21 |
+
║ | | | | | | ║
|
| 22 |
+
║ |_| |_| |_| ║
|
| 23 |
+
║ ║
|
| 24 |
+
║ ▸ TINY PROTEIN TRANSFORMER ◂ ║
|
| 25 |
+
║ ║
|
| 26 |
+
╚═══════════════════════════════════════════════╝
|
| 27 |
+
```
|
| 28 |
+
|
| 29 |
+
|
| 30 |
# TinyProteinTransformer (TPT)
|
| 31 |
|
| 32 |
TinyProteinTransformer (TPT) is a lightweight CNN-Transformer hybrid encoder designed for microbial smORF-encoded small proteins. It was pretrained on the Global Microbial smORF Catalog (GMSC, >280M sequences) using masked language modeling combined with contrastive learning, producing compact yet expressive residue-level and sequence-level protein representations.
|