Model card aligned with the paper
Browse files
README.md
CHANGED
|
@@ -10,10 +10,11 @@ tags:
|
|
| 10 |
|
| 11 |
# TabOmics v2
|
| 12 |
|
| 13 |
-
TabOmics is a tabular foundation model for wide omics data. It is pretrained on synthetic tables and uses
|
| 14 |
-
learning: given
|
| 15 |
-
with no training or tuning on your data. It is designed for wide tables (thousands of features, few samples, as
|
| 16 |
-
omics), also works on ordinary tables, and provides
|
|
|
|
| 17 |
|
| 18 |
```python
|
| 19 |
from tabomics import Classifier
|
|
@@ -21,4 +22,14 @@ clf = Classifier(model="v2").fit(X_train, y_train)
|
|
| 21 |
proba = clf.predict_proba(X_test)
|
| 22 |
```
|
| 23 |
|
| 24 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
|
| 11 |
# TabOmics v2
|
| 12 |
|
| 13 |
+
TabOmics is a tabular foundation model for wide omics data. It is pretrained only on synthetic tables and uses
|
| 14 |
+
in-context learning: given labeled training rows and unlabeled test rows, it predicts the test rows in a single forward
|
| 15 |
+
pass, with no training or tuning on your data. It is designed for wide tables (thousands of features, few samples, as
|
| 16 |
+
in omics), processes every feature jointly, also works on ordinary tables, and provides sample embeddings and feature
|
| 17 |
+
importance from the same forward pass.
|
| 18 |
|
| 19 |
```python
|
| 20 |
from tabomics import Classifier
|
|
|
|
| 22 |
proba = clf.predict_proba(X_test)
|
| 23 |
```
|
| 24 |
|
| 25 |
+
## Model details
|
| 26 |
+
|
| 27 |
+
- Classifier of up to 10 classes.
|
| 28 |
+
- A Transformer of 12 blocks, each with attention between features, attention between rows and an MLP;
|
| 29 |
+
embedding size 192, 6 attention heads, 7.3M parameters.
|
| 30 |
+
- Pretrained only on synthetic tables; the recipes of the published models are in `configs/` of the repository.
|
| 31 |
+
Standardized features are clipped at 10 at inference.
|
| 32 |
+
- `n_estimators` averages ensemble members: forward passes on copies of the table with the columns reordered and the
|
| 33 |
+
categories and classes renumbered at random (1 by default).
|
| 34 |
+
|
| 35 |
+
Code, documentation and license: https://github.com/lbotecur/tabomics (GNU General Public License v3.0 or later).
|