Text Generation
Safetensors
English
llama
conversational
Eval Results (legacy)
WildMann commited on
Commit
bb38e98
·
verified ·
1 Parent(s): eca202a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +123 -0
README.md CHANGED
@@ -1,3 +1,126 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # 🐺 Wildalign-350M-base
2
  ### Experimental Exotic Autoregressive Language Model
3
 
 
1
+ ---
2
+ pipeline_tag: text-generation
3
+ license: apache-2.0
4
+ datasets:
5
+ - HuggingFaceTB/finemath
6
+ - HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
7
+ language:
8
+ - en
9
+ model-index:
10
+ - name: Wildalign-350M-base
11
+ results:
12
+ - task:
13
+ type: arc_challenge
14
+ name: ARC Challenge
15
+ dataset:
16
+ type: arc_challenge
17
+ name: ARC Challenge
18
+ version: 1
19
+ metrics:
20
+ - name: acc
21
+ type: acc
22
+ value: 0.2082
23
+ stderr: ± 0.0119
24
+ verified: false
25
+ - name: acc_norm
26
+ type: acc_norm
27
+ value: 0.2543
28
+ stderr: ± 0.0127
29
+ verified: false
30
+ - task:
31
+ type: arc_easy
32
+ name: ARC Easy
33
+ dataset:
34
+ type: arc_easy
35
+ name: ARC Easy
36
+ version: 1
37
+ metrics:
38
+ - name: acc
39
+ type: acc
40
+ value: 0.5442
41
+ stderr: ± 0.0102
42
+ verified: false
43
+ - name: acc_norm
44
+ type: acc_norm
45
+ value: 0.4701
46
+ stderr: ± 0.0102
47
+ verified: false
48
+ - task:
49
+ type: boolq
50
+ name: BoolQ
51
+ dataset:
52
+ type: boolq
53
+ name: BoolQ
54
+ version: 2
55
+ metrics:
56
+ - name: acc
57
+ type: acc
58
+ value: 0.6049
59
+ stderr: ± 0.0086
60
+ verified: false
61
+ - task:
62
+ type: hellaswag
63
+ name: HellaSwag
64
+ dataset:
65
+ type: hellaswag
66
+ name: HellaSwag
67
+ version: 1
68
+ metrics:
69
+ - name: acc
70
+ type: acc
71
+ value: 0.2984
72
+ stderr: ± 0.0046
73
+ verified: false
74
+ - name: acc_norm
75
+ type: acc_norm
76
+ value: 0.3292
77
+ stderr: ± 0.0047
78
+ verified: false
79
+ - task:
80
+ type: piqa
81
+ name: PIQA
82
+ dataset:
83
+ type: piqa
84
+ name: PIQA
85
+ version: 1
86
+ metrics:
87
+ - name: acc
88
+ type: acc
89
+ value: 0.6496
90
+ stderr: ± 0.0111
91
+ verified: false
92
+ - name: acc_norm
93
+ type: acc_norm
94
+ value: 0.6311
95
+ stderr: ± 0.0113
96
+ verified: false
97
+ - task:
98
+ type: truthfulqa_mc2
99
+ name: TruthfulQA MC2
100
+ dataset:
101
+ type: truthfulqa_mc2
102
+ name: TruthfulQA MC2
103
+ version: 3
104
+ metrics:
105
+ - name: acc
106
+ type: acc
107
+ value: 0.4118
108
+ stderr: ± 0.0148
109
+ verified: false
110
+ - task:
111
+ type: winogrande
112
+ name: Winogrande
113
+ dataset:
114
+ type: winogrande
115
+ name: Winogrande
116
+ version: 1
117
+ metrics:
118
+ - name: acc
119
+ type: acc
120
+ value: 0.5233
121
+ stderr: ± 0.0140
122
+ verified: false
123
+ ---
124
  # 🐺 Wildalign-350M-base
125
  ### Experimental Exotic Autoregressive Language Model
126