Hugging Face's logo

SlayerLab
/
Slayer149

Text Generation
PyTorch
Safetensors
English
gollem
tiny-lm
muon
value-residual
continued-pretraining
glint-tiny-ml-leaderboard
Model card Files
xet
 Community
kacperwikiel commited on
Commit
7857dd2
·
verified ·
1 Parent(s): 3f431df

Name the model Slayer149

Browse files
Files changed (2) hide show
  1. NOTICE +1 -1
  2. README.md +3 -3
NOTICE CHANGED
@@ -1,4 +1,4 @@
1
- GoLLeM-149M-20B
2
 
3
  Weights and architecture derive from SlayerLab/gollem-v5-ckpts
4
  revision 963440ce6ab4ada7e95da4c1faa28ebb00c082d4, published under Apache-2.0.
 
1
+ Slayer149
2
 
3
  Weights and architecture derive from SlayerLab/gollem-v5-ckpts
4
  revision 963440ce6ab4ada7e95da4c1faa28ebb00c082d4, published under Apache-2.0.
README.md CHANGED
@@ -14,7 +14,7 @@ tags:
14
  - glint-tiny-ml-leaderboard
15
  ---
16
 
17
- # GoLLeM 149M — 20B-token continuation
18
 
19
  A **148,910,738-parameter English causal language model**, grown from the GoLLeM-v5
20
  122.8M final checkpoint and continued for **20,000,014,336 additional tokens**.
@@ -57,8 +57,8 @@ it is not packaged for `transformers.AutoModelForCausalLM`.
57
 
58
  ```bash
59
  pip install huggingface-hub
60
- hf download SlayerLab/gollem-149m-20b --local-dir gollem-149m-20b
61
- cd gollem-149m-20b
62
  pip install -r requirements.txt
63
  python generate.py --prompt "The scientific method is" --max-new-tokens 64
64
  ```
 
14
  - glint-tiny-ml-leaderboard
15
  ---
16
 
17
+ # Slayer149 — 149M English language model
18
 
19
  A **148,910,738-parameter English causal language model**, grown from the GoLLeM-v5
20
  122.8M final checkpoint and continued for **20,000,014,336 additional tokens**.
 
57
 
58
  ```bash
59
  pip install huggingface-hub
60
+ hf download SlayerLab/Slayer149 --local-dir Slayer149
61
+ cd Slayer149
62
  pip install -r requirements.txt
63
  python generate.py --prompt "The scientific method is" --max-new-tokens 64
64
  ```