locus / locus-2m /README.md
esirvan's picture
LoCUS release weights
83cfd16 verified
|
Raw History Blame Contribute Delete
523 Bytes
---
library_name: locus
tags:
- dna
- genomics
- locally-consistent-parsing
---
# locus-2m
LoCUS-2M: width 128, 4 kb context.
- Segments: lcp (level 2)
- Width 128, 4 heads, base attention radii [32, 128], 6 segment layers
- Pretrained for 359,466 steps on GRCh38 chromosomes 3-22, crops of 256-4096 bp
## Use
```python
import locus
model = locus.load("locus-2m")
vectors = model.embed(["ACGT" * 100])
```
Code, fine-tuning recipes and the scripts that reproduce every result of the paper: see the LoCUS repository.