Hugging Face's logo

afg1
/
RNAMamba-14M

Feature Extraction
Transformers
Safetensors
mamba
Generated from Trainer
Model card Files
xet
 Community
RNAMamba-14M

Commit History

  1. contrastive pretraining (pious-haze-45)

    Andrew Green
    3987233

  2. Reset to last good pretrained version

    Andrew Green
    84f48a4

  3. re-finetuned on deduplicated similarity data

    Andrew Green
    579981a

  1. Prototype after contrastive learning first pass. Unlikely to be good due to data duplication

    Andrew Green
    519ad17

  2. Updated pretrained model on 4 epochs (58,500 steps)

    Andrew Green
    7341c83

  1. Updated model with better pretraining. 30% MLM rate and shuffled source data

    Andrew Green
    c65927d

  2. Upload model

    afg1
    Verified signature
    10e91d9

  3. Upload model

    afg1
    Verified signature
    cd68b5d

  4. Upload model

    afg1
    Verified signature
    101372f

  5. Upload model

    afg1
    Verified signature
    79da6c6

  6. Upload model

    afg1
    Verified signature
    9472c5e

  7. Upload model

    afg1
    Verified signature
    b49ae26

  1. Update README.md

    afg1
    Verified signature
    53e89e4

  2. Move MLM readme into this repo.

    afg1
    Verified signature
    bc15b88

  3. Should be a base model with no MLM head

    Andrew Green
    cb63d3a

  4. initial commit

    afg1
    Verified signature
    edb8f38