ykyao commited on
Commit
ab4a275
·
verified ·
1 Parent(s): 3817cd0

Align model card introduction with ARLoop-1.2B

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -13,9 +13,9 @@ tags:
13
 
14
  # ARLoop-0.6B
15
 
16
- ARLoop is a recurrent causal language model with attention residuals. This release
17
- contains the final checkpoint of the three-stage, approximately 180B-token training run.
18
- It is a **base pretrained model** for text completion, not a chat/SFT model.
19
 
20
  Training code: [ykyaol7/ARLoop](https://github.com/ykyaol7/ARLoop).
21
 
 
13
 
14
  # ARLoop-0.6B
15
 
16
+ ARLoop is a fully-open pretrained looped transformer with attention residuals. This release
17
+ contains the final checkpoint of the 0.6B, 180B-token training run.
18
+ It is a **base pretrained model**, intended for text completion, which can be used for mid-training and post-training.
19
 
20
  Training code: [ykyaol7/ARLoop](https://github.com/ykyaol7/ARLoop).
21