59.4 GB
35 files
Updated 1 day ago
Name
Size
scheduler
text_encoder
text_encoder_2
tokenizer
tokenizer_2
transformer
vae
.gitattributes1.52 kB
xet
HuggingFace_datasets_krea2_turbo_t2i.json68.5 kB
xet
LICENSE.md18.6 kB
xet
README.md878 Bytes
xet
ae.safetensors335 MB
xet
captions.csv79.5 MB
xet
captions.parquet30.2 MB
xet
dev_grid.jpg1.3 MB
xet
flux1-dev.safetensors23.8 GB
xet
heretic_75k_v3_final.parquet148 MB
xet
heretic_75k_v7_master.parquet154 MB
xet
model_index.json536 Bytes
xet
pytorch_model.bin1.14 GB
xet
README.md

Winner-RWKV-7-285M-20260601

RWKV-7 checkpoint trained in Jellyfish042/GatedDeltaNet-2.

  • Architecture: RWKV-7 TimeMix, rwkv7_time_1024x12
  • Parameters printed by the training script: 219,611,136
  • Pretraining data: globally shuffled FineWeb-Edu packed 100B-token run
  • Sequence length: 4096
  • Global batch size: 1024
  • Seed: 3407
  • Checkpoint file: pytorch_model.bin

This is a project checkpoint from pretrain.py, not a Hugging Face Transformers checkpoint.

lm-eval-harness snapshot

Task Metric Value
lambada_openai acc 0.3728
lambada_openai perplexity 25.6649
wikitext word_perplexity 24.0226
wikitext byte_perplexity 1.8121
wikitext bits_per_byte 0.8577
Total size
59.4 GB
Files
35
Last updated
Nov 9
Pre-warmed CDN
US EU US EU

Contributors