Text Generation
English
File size: 377 Bytes
d890d8d
 
325866a
 
 
 
 
d890d8d
325866a
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
---
license: apache-2.0
datasets:
- starhopp3r/TinyChat
language:
- en
pipeline_tag: text-generation
---
# ReFORM C10 Model

ReFORM is a reccurent transformer architecture based on RoPE Transformer that uses Huginn-like tricks mixed with RWKV and other stuff: token shifting, latent thinking vector, vector-mixing, etc.

So, it's ~10M model trained ~10 minutes on RTX 5070 TI.