Instructions to use ctheodoris/Geneformer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ctheodoris/Geneformer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="ctheodoris/Geneformer")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("ctheodoris/Geneformer") model = AutoModelForMaskedLM.from_pretrained("ctheodoris/Geneformer", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit History
-
Fixed error with perturbing individual genes and updated ways to specify cell_states_to_model (#146)
- Fixed error with perturbing individual genes and updated ways to specify cell_states_to_model (771c8bd01b1754c4387d742680e65c34697a2336) - Fix isp perturb_group dims, reformat cell states dict to keyed, add attn mask (c2679c41d352513a56feb5490c5302c6f25ae7ba) Co-authored-by: David Wen <davidjwen@users.noreply.huggingface.co>9169bfd
-
Rename heatmap legend to be correct label
Christina Theodorisbadcca6 -
Add function to extract and plot cell embeddings
Christina Theodorisd154fee
-
Update isp to allow modeling single perturbation in multiple cells as batches
Christina Theodorisacd253c
-
Change list of individual IDs to set to ensure unique before subsetting into train/valid/test sets
Christina Theodoris45b9d69
-
Add note to recommend tuning hyperparameters for downstream applications
Christina Theodoris98ce6d7
-
Add instructions to convert gene annotations w/ Ensembl Biomart
Christina Theodoris77eb432
-
Remove unused evalset variable from cell classification example
Christina Theodoris879a878
-
Update links including unsorted example lengths file
Christina Theodorisf0b6641
-
Add uniform max len for padding for predictions
Christina Theodoris67f674c
-
Add example code for obtaining non-zero median digests
Christina Theodoris67b7f01
-
Add further explanation regarding input file format for transcriptome tokenizer
Christina Theodorisc34ead6
-
Update instructions in tokenizing example to clarify requirement for Ensembl ID
Christina Theodorisd468697 -
Update instructions in tokenizing example to clarify requirement for Ensembl ID
Christina Theodorise606e1c
-
Add further explanation to tokenizer example script and updated tokenizer to match loompy raised error
Christina Theodoris78dd83b
-
Move example input files to dataset repository to include example datasets for fine-tuning
Christina Theodoris875ef33 -
Add example for tokenizing .loom dataset
Christina Theodorisf89f796 -
Update gene classification example to create directory after training arguments are defined
Christina Theodorisebe5ee8 -
Subclass collator for cell classification
Christina Theodoris402ba9b
-
Update pretrainer for transformers==4.28.0
Christina Theodorisb925dcc
-
Add example input labels for distinguishing bivalent promoters.
Christina Theodoris996d3e5 -
Add in silico perturbation example notebook.
Christina Theodoris1c2f864
-
Add example input files for gene classification of TF dosage sensitivity
Christina Theodoris0710c44
-
Add example for hyperparameter optimization for disease classifier
Christina Theodoris79a0c41
-
Add data collator for gene classification and example for gene classification
Christina Theodorisedacd12
-
Add data collator for cell classification and example for cell classification
Christina Theodoris088ea6e
-
Add Geneformer trainer and pretraining example
Christina Theodorisbcc03e8