Instructions to use ctheodoris/Geneformer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ctheodoris/Geneformer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="ctheodoris/Geneformer")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("ctheodoris/Geneformer") model = AutoModelForMaskedLM.from_pretrained("ctheodoris/Geneformer", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit History
-
anndata_tokenizer (#170)
- Added anndata tokenizer and switched to Dataset.from_generator (b6ca56647a16de97f6f95785eb76cb1a965f9960) - Generalized (5cb733f4fed85e1568ba9671e5b1f9babd7b8491) - Addressed issues for tokenizer, anndata tokenizer now uses a fraction of memory (b24676d0956565ff7b4f8b57d1e936ad17f8740e) - Fixed issues (94e8d231c41a89232a55c064e5c8ea95edd51d2e) - Fixed issue, loom and h5ad now produce same checksums (9c62f4c6e3ab0afd1943079306655bd20eba2246) - Rename loom tokenizer function and modify example notebook for adata. (4fdb85061180ccf022ab761c2557be6ba67d848e) Co-authored-by: Rico Meinl <ricomnl@users.noreply.huggingface.co>4302f48
-
Add instructions to convert gene annotations w/ Ensembl Biomart
Christina Theodoris77eb432
-
Add further explanation regarding input file format for transcriptome tokenizer
Christina Theodorisc34ead6
-
Update instructions in tokenizing example to clarify requirement for Ensembl ID
Christina Theodorisd468697 -
Update instructions in tokenizing example to clarify requirement for Ensembl ID
Christina Theodorise606e1c
-
Add further explanation to tokenizer example script and updated tokenizer to match loompy raised error
Christina Theodoris78dd83b
-
Add example for tokenizing .loom dataset
Christina Theodorisf89f796