lewtun HF Staff Claude Opus 5.5 commited on
Commit
e9e1a97
Β·
verified Β·
1 Parent(s): 07c88a2

Fix links to the tech report and Carbon evals

Browse files

The Carbon GitHub repo moved its code into a `carbon/` directory, so the `evaluation/` links 404 and `tech-report.pdf` is gone. This points the eval links at `carbon/evaluation/` and the tech report at bioRxiv. It also fixes the Carbon-8B and Carbon-500M links, which pointed at the org page.

πŸ€– Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -39,8 +39,8 @@ A generative DNA foundation model from the **Carbon** family.
39
 
40
  **Carbon-3B** is a 3B-parameter decoder-only autoregressive genomic foundation model trained on DNA and RNA sequences, with a primary focus on eukaryotes. It has a native context length of **32,768 6-mer tokens (β‰ˆ 197k DNA base pairs)** and extends to **65,536 tokens (β‰ˆ 393 kbp)** at inference time via YaRN. Carbon-3B is designed to be both strong and efficient: on generative tasks (sequence recovery), variant-effect prediction, and motif-perturbation discrimination, it matches the capability of substantially larger single-nucleotide baselines such as Evo2-7B while running several times faster.
41
 
42
- Carbon-3B is the **flagship** model of the Carbon family. We also release [**Carbon-8B**](https://huggingface.co/HuggingFaceBio/) for users who need additional capability at higher inference cost, and [**Carbon-500M**](https://huggingface.co/HuggingFaceBio/) β€” a small generative model intended for speculative decoding alongside Carbon-3B (or Carbon-8B).
43
- - Technical report: https://github.com/huggingface/carbon/blob/main/tech-report.pdf
44
  - Demo: https://huggingface.co/spaces/HuggingFaceBio/carbon-demo
45
 
46
  ### Key features
@@ -144,7 +144,7 @@ def score(seq: str) -> float:
144
  return logp.mean().item()
145
  ```
146
 
147
- For batched scoring with attention masking and full reproducible evaluation pipelines (sequence recovery, ClinVar / BRCA2 / TraitGym VEP, triplet-expansion / synonymous codon replacement, Genomic-NIAH), use the official scripts in the [Carbon evaluation directory](https://github.com/huggingface/carbon/tree/main/evaluation) β€” see [`perturbation_tasks.py`](https://github.com/huggingface/carbon/blob/main/evaluation/perturbation_tasks.py) for the canonical `score_hf` implementation and [`README.md`](https://github.com/huggingface/carbon/blob/main/evaluation/README.md) for run instructions across all tasks.
148
 
149
  ### Long context: extending to 65,536 tokens (β‰ˆ 393 kbp) with YaRN
150
 
@@ -273,7 +273,7 @@ print(f"reference preferred: {scores[0] > scores[1]}")
273
 
274
  ## Evaluation
275
 
276
- All evaluations are zero-shot and use the [public Carbon evaluation pipeline](https://github.com/huggingface/carbon/tree/main/evaluation). The suite covers seven tasks across four capability families:
277
 
278
  | Family | Task | Metric |
279
  |---|---|---|
 
39
 
40
  **Carbon-3B** is a 3B-parameter decoder-only autoregressive genomic foundation model trained on DNA and RNA sequences, with a primary focus on eukaryotes. It has a native context length of **32,768 6-mer tokens (β‰ˆ 197k DNA base pairs)** and extends to **65,536 tokens (β‰ˆ 393 kbp)** at inference time via YaRN. Carbon-3B is designed to be both strong and efficient: on generative tasks (sequence recovery), variant-effect prediction, and motif-perturbation discrimination, it matches the capability of substantially larger single-nucleotide baselines such as Evo2-7B while running several times faster.
41
 
42
+ Carbon-3B is the **flagship** model of the Carbon family. We also release [**Carbon-8B**](https://huggingface.co/HuggingFaceBio/Carbon-8B) for users who need additional capability at higher inference cost, and [**Carbon-500M**](https://huggingface.co/HuggingFaceBio/Carbon-500M) β€” a small generative model intended for speculative decoding alongside Carbon-3B (or Carbon-8B).
43
+ - Technical report: https://www.biorxiv.org/content/10.64898/2026.05.22.727119v1
44
  - Demo: https://huggingface.co/spaces/HuggingFaceBio/carbon-demo
45
 
46
  ### Key features
 
144
  return logp.mean().item()
145
  ```
146
 
147
+ For batched scoring with attention masking and full reproducible evaluation pipelines (sequence recovery, ClinVar / BRCA2 / TraitGym VEP, triplet-expansion / synonymous codon replacement, Genomic-NIAH), use the official scripts in the [Carbon evaluation directory](https://github.com/huggingface/carbon/tree/main/carbon/evaluation) β€” see [`perturbation_tasks.py`](https://github.com/huggingface/carbon/blob/main/carbon/evaluation/perturbation_tasks.py) for the canonical `score_hf` implementation and [`README.md`](https://github.com/huggingface/carbon/blob/main/carbon/evaluation/README.md) for run instructions across all tasks.
148
 
149
  ### Long context: extending to 65,536 tokens (β‰ˆ 393 kbp) with YaRN
150
 
 
273
 
274
  ## Evaluation
275
 
276
+ All evaluations are zero-shot and use the [public Carbon evaluation pipeline](https://github.com/huggingface/carbon/tree/main/carbon/evaluation). The suite covers seven tasks across four capability families:
277
 
278
  | Family | Task | Metric |
279
  |---|---|---|