Safetensors
GGUF
English
gemma3_text
base
sml
void
pretrained-from-scratch
appvoid commited on
Commit
b16fb7a
·
verified ·
1 Parent(s): f213bc4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -9
README.md CHANGED
@@ -44,15 +44,17 @@ tags:
44
 
45
  <img src="https://huggingface.co/appvoid/void.0-preview/resolve/main/logo.png"/>
46
 
47
- Introducing **void**: our first ever language model, trained from scratch with a novel hybrid tokenizer on 300M high-quality tokens (total of 2 epochs on a B300) using 4096 as context window. Total cost was $23 dollars. It has around 140m parameters. Future releases are expected to be published in the following weeks/months.
48
-
49
- | Benchmark | Accuracy | Normalized |
50
- | ------------- | -------: | ---------: |
51
- | ARC Challenge | 25.17% | 27.22% |
52
- | ARC Easy | 45.03% | 43.01% |
53
- | HellaSwag | 31.57% | 35.77% |
54
- | PIQA | 61.15% | 60.12% |
55
- | WinoGrande | 53.12% | — |
 
 
56
 
57
  If you want to sponsor future model releases, you can get information on how to make contributions here: [CEAMFA](https://huggingface.co/CEAMFA)
58
 
 
44
 
45
  <img src="https://huggingface.co/appvoid/void.0-preview/resolve/main/logo.png"/>
46
 
47
+ Introducing **void**: our first ever language model, trained from scratch with a novel hybrid tokenizer on 300M high-quality tokens (total of 2 epochs on a B300) using 4096 as context window. Total cost was $23 dollars. 132m parameters. Future releases are expected to be published in the following weeks/months.
48
+
49
+ | Benchmark | Accuracy | Normalized |
50
+ | ------------- | ---------: | ---------: |
51
+ | ARC Challenge | 25.17% | 27.22% |
52
+ | ARC Easy | 45.03% | 43.01% |
53
+ | HellaSwag | 31.57% | 35.77% |
54
+ | PIQA | 61.15% | 60.12% |
55
+ | WinoGrande | 53.12% | — |
56
+ | ArithMark | 35.20% | 35.20% |
57
+
58
 
59
  If you want to sponsor future model releases, you can get information on how to make contributions here: [CEAMFA](https://huggingface.co/CEAMFA)
60