Hugging Face's logo

harrisonvanderbyl
/
rwkv7_bigstate_1b

Model card Files
xet
 Community

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

RWKV7 BigState 1B (step 1500 checkpoint)

Stripped checkpoint: model weights in bf16, no optimizer state or grads.

  • step: 1500
  • val_loss @ 1500: 3.1697 (ppl 23.8)
  • params: 3.174B total
  • trained on 8x MI325X, seq_len 4096

Config is embedded in the .pt payload under key "config".

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support