lbotecur commited on
Commit
b29cf16
·
verified ·
1 Parent(s): d4be934

Model card aligned with the paper

Browse files
Files changed (1) hide show
  1. README.md +16 -5
README.md CHANGED
@@ -10,10 +10,11 @@ tags:
10
 
11
  # TabOmics v2
12
 
13
- TabOmics is a tabular foundation model for wide omics data. It is pretrained on synthetic tables and uses in-context
14
- learning: given labelled training rows and unlabelled test rows, it predicts the test rows in a single forward pass,
15
- with no training or tuning on your data. It is designed for wide tables (thousands of features, few samples, as in
16
- omics), also works on ordinary tables, and provides row embeddings and feature importance.
 
17
 
18
  ```python
19
  from tabomics import Classifier
@@ -21,4 +22,14 @@ clf = Classifier(model="v2").fit(X_train, y_train)
21
  proba = clf.predict_proba(X_test)
22
  ```
23
 
24
- Code, documentation and licence: https://github.com/lbotecur/tabomics (GNU General Public License v3.0 or later).
 
 
 
 
 
 
 
 
 
 
 
10
 
11
  # TabOmics v2
12
 
13
+ TabOmics is a tabular foundation model for wide omics data. It is pretrained only on synthetic tables and uses
14
+ in-context learning: given labeled training rows and unlabeled test rows, it predicts the test rows in a single forward
15
+ pass, with no training or tuning on your data. It is designed for wide tables (thousands of features, few samples, as
16
+ in omics), processes every feature jointly, also works on ordinary tables, and provides sample embeddings and feature
17
+ importance from the same forward pass.
18
 
19
  ```python
20
  from tabomics import Classifier
 
22
  proba = clf.predict_proba(X_test)
23
  ```
24
 
25
+ ## Model details
26
+
27
+ - Classifier of up to 10 classes.
28
+ - A Transformer of 12 blocks, each with attention between features, attention between rows and an MLP;
29
+ embedding size 192, 6 attention heads, 7.3M parameters.
30
+ - Pretrained only on synthetic tables; the recipes of the published models are in `configs/` of the repository.
31
+ Standardized features are clipped at 10 at inference.
32
+ - `n_estimators` averages ensemble members: forward passes on copies of the table with the columns reordered and the
33
+ categories and classes renumbered at random (1 by default).
34
+
35
+ Code, documentation and license: https://github.com/lbotecur/tabomics (GNU General Public License v3.0 or later).