GODELEV commited on
Commit
f5d1d6d
·
verified ·
1 Parent(s): 73dbdd8

step 200 | val_ppl=45.49

Browse files
README.md CHANGED
@@ -25,9 +25,9 @@ Small language model (9.9M parameters) trained from scratch.
25
  | Total parameters | 9.902M |
26
 
27
  ## Training
28
- - Tokens seen: 141,419,520
29
- - Val loss: inf
30
- - Val PPL: inf
31
 
32
  ## Usage
33
  ```python
 
25
  | Total parameters | 9.902M |
26
 
27
  ## Training
28
+ - Tokens seen: 471,398,400
29
+ - Val loss: 3.8175
30
+ - Val PPL: 45.49
31
 
32
  ## Usage
33
  ```python
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b687326d79592e4596afff27ed591d6689f3605fbafa7b9ff0532f3d24141a28
3
  size 39621248
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9de947ef8478ee61b29d5959a37907690d3db9ebc45e79a16a34f79de35d9c64
3
  size 39621248
resume/ckpt.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:11db9c36edb1cff345de6ddfa015e5b39a6a54bf19994ecf61f4857f2dc1337d
3
- size 122094365
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b790d48ea299b83280b7df95f2be2e0040b3d52dfec1a8e1c905a1a0e235ea53
3
+ size 122094685
resume/latest_step.txt CHANGED
@@ -1 +1 @@
1
- 60
 
1
+ 200
training_meta.json CHANGED
@@ -1,8 +1,8 @@
1
  {
2
- "step": 60,
3
- "val_loss": Infinity,
4
- "val_ppl": Infinity,
5
  "params_M": 9.902,
6
- "pushed_at": "2026-06-11T06:10:41.431405",
7
- "tokens_seen": 141419520
8
  }
 
1
  {
2
+ "step": 200,
3
+ "val_loss": 3.8174806594848634,
4
+ "val_ppl": 45.48946039640565,
5
  "params_M": 9.902,
6
+ "pushed_at": "2026-06-11T07:42:55.482805",
7
+ "tokens_seen": 471398400
8
  }