jmschr commited on
Commit
41b798f
·
verified ·
1 Parent(s): 9a8cb3e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +83 -0
README.md ADDED
@@ -0,0 +1,83 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ pipeline_tag: other
4
+ tags:
5
+ - genomics
6
+ - chromatin-accessibility
7
+ - atac-seq
8
+ - dnase-seq
9
+ - sequence-to-function
10
+ - encode
11
+ ---
12
+
13
+ # Cherimoya Accessibility aTlas (CATv1)
14
+
15
+ This is the first release of the **Cherimoya Accessibility aTlas (CATv1)**: a collection of over 1,000 Cherimoya models trained on DNase-seq and ATAC-seq experiments from the ENCODE Project. Cherimoya models are state-of-the-art predictors of local chromatin accessibility, mapping a DNA sequence to a base-resolution accessibility profile together with its total read count.
16
+
17
+ This release covers **1,518 ENCODE experiments** (1,149 DNase-seq and 369 ATAC-seq). Every experiment is trained and evaluated across **5 folds** (`fold_0`–`fold_4`) of a chromosome-held-out cross-validation. Each model predicts accessibility for a **single experiment**, so download only the model(s) you need.
18
+
19
+ ## Model description
20
+
21
+ Each Cherimoya model is a compact residual convolutional network (~0.6M parameters; 9 layers, 128 filters) in the BPNet / ChromBPNet family. It takes a one-hot DNA sequence of `in_window=2114` bp and produces two outputs over the central `out_window=1000` bp: a **profile** head (base-resolution logits, shape `(N, 1, 1000)`) describing the shape of the accessibility signal, and a **count** head (log total counts, shape `(N, 1)`) describing the overall magnitude. The published checkpoints are the exponential-moving-average (EMA) shadow weights selected on validation performance.
22
+
23
+ ## Training data
24
+
25
+ Models are trained on the human genome (**GRCh38 / hg38**) against the observed ENCODE accessibility signal for each experiment. Training loci are the experiment's peak regions plus GC-matched background (non-peak) negatives, with ENCODE blacklist regions excluded. The five folds partition the genome by chromosome, so for every fold the validation chromosomes are held out of training; reported metrics are therefore **validation-set** performance, not a separate test set.
26
+
27
+ ## Repository layout
28
+
29
+ Files are organized one directory per experiment, `<encid>/`:
30
+
31
+ | file | description |
32
+ |---|---|
33
+ | `cherimoya.fold_<i>.torch` | the model checkpoint (EMA shadow weights) |
34
+ | `cherimoya.fold_<i>.performance.tsv` | validation metrics for that fold |
35
+ | `cherimoya.fold_<i>.log` | training log |
36
+ | `cherimoya.fold_<i>.fit.json` / `.evaluate.json` | training / evaluation settings |
37
+
38
+ `performance.tsv` has one row with columns (fixed order): `profile_mnll profile_jsd profile_pearson profile_spearman count_pearson count_spearman count_mse`; the headline metrics are `profile_pearson` (profile shape) and `count_pearson` (total accessibility).
39
+
40
+ Experiment-level metadata is in `CATv1-metadata.tsv` (keyed by `experiment_accession`), and `manifest.csv` lists exactly which experiments and folds are included. Each `experiment_accession` is the source ENCODE experiment the models were trained on (`https://www.encodeproject.org/experiments/<experiment_accession>/`), and the paired `annotation_accession` points to the ENCODE ChromBPNet model annotation for that same experiment (`https://www.encodeproject.org/annotations/<annotation_accession>/`).
41
+
42
+ ## Which model should I use?
43
+
44
+ Pick the experiment that matches your assay and biosample using `CATv1-metadata.tsv`, then download that experiment's checkpoint(s). The five folds are cross-validation replicates of the same experiment: use a single fold (e.g. `fold_0`), or average the predictions of all five folds for a more robust estimate. A model only reflects the experiment it was trained on, so do not use it for a different cell type or assay.
45
+
46
+ ## Intended uses and limitations
47
+
48
+ Beyond profile and count prediction, the models support downstream sequence analyses such as attribution, motif marginalization, and in-silico mutagenesis. They are **human (GRCh38) only**, are specific to the experiment they were trained on, and report validation (not test) metrics.
49
+
50
+ ## Installation
51
+
52
+ ```bash
53
+ pip install cherimoya # PyPI (Python 3.10+)
54
+ ```
55
+
56
+ Install-from-source, Docker images, and GPU/Triton notes: https://github.com/jmschrei/cherimoya
57
+
58
+ ## Usage
59
+
60
+ ```python
61
+ import torch
62
+ from huggingface_hub import hf_hub_download
63
+ from cherimoya import Cherimoya
64
+
65
+ path = hf_hub_download("programmable-genomics/CATv1", "<encid>/cherimoya.fold_0.torch")
66
+ model = Cherimoya.load(path, device="cuda", compile=False).eval()
67
+
68
+ # Input: one-hot DNA, shape (batch, 4, in_window=2114), ACGT channels.
69
+ X = torch.zeros(2, 4, 2114, device="cuda")
70
+ X[:, 0] = 1.0 # placeholder: replace with your encoded sequences
71
+
72
+ # Option A: call the model directly.
73
+ profile_logits, log_counts = model(X) # (N,1,1000), (N,1)
74
+ profile = torch.softmax(profile_logits.float(), dim=-1)
75
+
76
+ # Option B: via tangermeme (auto-batches, handles device/dtype).
77
+ from tangermeme.predict import predict
78
+ profile_logits, log_counts = predict(model, X, device="cuda", batch_size=64)
79
+ ```
80
+
81
+ ## Contact
82
+
83
+ Jacob Schreiber <jacob.schreiber@umassmed.edu> — Programmable Genomics Laboratory @ UMass Chan.