File size: 377 Bytes
d890d8d 325866a d890d8d 325866a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 | ---
license: apache-2.0
datasets:
- starhopp3r/TinyChat
language:
- en
pipeline_tag: text-generation
---
# ReFORM C10 Model
ReFORM is a reccurent transformer architecture based on RoPE Transformer that uses Huginn-like tricks mixed with RWKV and other stuff: token shifting, latent thinking vector, vector-mixing, etc.
So, it's ~10M model trained ~10 minutes on RTX 5070 TI.
|