|
Download README.md from DabinJeong/LocoGen: direct link, hf CLI and curl.
- Browser
- Download file 4.38 kB
-
https://huggingface.co/DabinJeong/LocoGen/resolve/main/README.md
- Command line
-
hf download hf://DabinJeong/LocoGen/README.md
-
curl -L -o README.md https://huggingface.co/DabinJeong/LocoGen/resolve/main/README.md
4.38 kB
| license: mit | |
| library_name: pytorch | |
| tags: | |
| - biology | |
| - dna | |
| - genomics | |
| - regulatory-dna | |
| - enhancer | |
| - discrete-diffusion | |
| - guided-generation | |
| # LocoGen | |
| Separator weights for **LocoGen**: locality-controlled guidance for masked | |
| discrete diffusion of regulatory DNA. LocoGen samples enhancer sequences from a | |
| *frozen* MDLM backbone, with no fine-tuning, by localizing the guidance gradient | |
| to invariant regulatory positions using a V-REx-trained masked separator. | |
| Code: https://github.com/Lotfollahi-lab/LocoGen | |
| ## What this repository contains | |
| Only the **masked separator** — the component trained in LocoGen's Stage 1. | |
| One checkpoint per cell line. | |
| | File | Cell line | Params | | |
| | --- | --- | --- | | |
| | `hepg2/masked_separator.ckpt` | HepG2 | 11,135,495 | | |
| | `k562/masked_separator.ckpt` | K562 | 11,135,495 | | |
| | `sknsh/masked_separator.ckpt` | SK-N-SH | 11,135,495 | | |
| Each is a plain `{"model": state_dict}` payload (316 tensors, ~45 MB). | |
| ## What it does *not* contain | |
| LocoGen runs on the **DRAKES** MDLM backbone and uses the DRAKES reward oracles. | |
| Those are a separate release and are not redistributed here. You need them to | |
| sample anything. Fetch both as described in the | |
| [LocoGen README](https://github.com/Lotfollahi-lab/LocoGen#external-dependencies-one-time): | |
| - `mdlm/outputs_gosai/pretrained.ckpt` — frozen MDLM backbone | |
| - `mdlm/outputs_gosai/lightning_logs/reward_oracle_ft.ckpt` — guidance oracle | |
| - `mdlm/outputs_gosai/lightning_logs/reward_oracle_eval.ckpt` — held-out scoring | |
| - `mdlm/gosai_data/processed_data/gosai_all.csv` — Gosai dataset | |
| ## Architecture comes from the config, not the checkpoint | |
| The loader builds the model from a YAML config and then loads these weights into | |
| it. The checkpoint carries no architecture metadata, so you must pass the | |
| matching config from the code repository: | |
| | Checkpoint | `--ms_config` | `target_idx` | | |
| | --- | --- | --- | | |
| | `hepg2/masked_separator.ckpt` | `configs/enhancer_gosai_masked_separator_hepg2.yaml` | 0 | | |
| | `k562/masked_separator.ckpt` | `configs/enhancer_gosai_masked_separator_k562.yaml` | 1 | | |
| | `sknsh/masked_separator.ckpt` | `configs/enhancer_gosai_masked_separator_sknsh.yaml` | 2 | | |
| At inference only the architecture fields and `target_idx` are read; the | |
| training-side loss weights in those configs do not affect sampling. | |
| ## Usage | |
| Download a checkpoint and point the LocoGen sampler at it: | |
| ```bash | |
| export LOCOGEN_DRAKES_REPO=/path/to/DRAKES/drakes_dna | |
| export LOCOGEN_DRAKES_DATA=/path/to/data_and_model/ | |
| CKPT=$(python -c "from huggingface_hub import hf_hub_download; \ | |
| print(hf_hub_download('DabinJeong/LocoGen', 'hepg2/masked_separator.ckpt'))") | |
| ``` | |
| Then run Stage 2 sampling. These are the full reference settings — `--lam` and | |
| `--alpha_ratio` alone are not sufficient to reproduce the reported numbers: | |
| ```bash | |
| python -u -m scripts.drakes_backbone.mood_guided_sample_mdlm \ | |
| --name locogen_hepg2 \ | |
| --cell_type hepg2 \ | |
| --ms_config ./configs/enhancer_gosai_masked_separator.yaml \ | |
| --ms_ckpt "$CKPT" \ | |
| --lam 0.7 \ | |
| --alpha_ratio 3.0 \ | |
| --alpha_cap 20.0 \ | |
| --ood_sil_localized true \ | |
| --ood_sil_threshold 0.5 \ | |
| --sil_t_threshold 0.3 \ | |
| --num_samples 640 \ | |
| --batch_size 64 \ | |
| --seed 0 | |
| ``` | |
| `--num_steps` is left at its default of 128, as in the original runs. | |
| For K562 or SK-N-SH, swap `--cell_type`, `--ms_config` and `--ms_ckpt` together — | |
| the oracle head is selected by `--cell_type`, so a mismatched pair silently | |
| scores against the wrong cell line. | |
| The run writes `sequences.csv` (one row per generated 200 nt sequence) and a | |
| `summary.json`. Reported results average over seeds 0, 1 and 2. | |
| Loading the weights directly, without the sampler: | |
| ```python | |
| import torch | |
| from huggingface_hub import hf_hub_download | |
| from omegaconf import OmegaConf | |
| from locogen.model.masked_separator import MaskedSeparatorModel | |
| ckpt = hf_hub_download("DabinJeong/LocoGen", "hepg2/masked_separator.ckpt") | |
| cfg = OmegaConf.load("configs/enhancer_gosai_masked_separator.yaml") | |
| model = MaskedSeparatorModel(cfg) | |
| model.load_state_dict(torch.load(ckpt, map_location="cpu")["model"]) | |
| model.eval() | |
| # x: (B, 200, 4) soft one-hot -> M: (B, 200) mask in [0, 1] | |
| M = model.separator(x) | |
| ``` | |
| ## Citation | |
| LocoGen, Dabin Jeong. See the | |
| [code repository](https://github.com/DabinJeong/LocoGen) for the current | |
| reference and publication status. | |