tinynext / v2 /web /parity.json
cfahlgren1's picture
cfahlgren1 HF Staff
make the 3b-token run v2 and add the size comparison
a739c7e verified
Raw History Blame Contribute Delete
365 Bytes
{
"parity_prompts": 300,
"parity_steps_per_prompt": 5,
"web_sizes": {
"graph_mb": 0.195,
"weights_q8_mb": 13.32,
"expanded_mb": 50.14,
"tensors": 33
},
"float": {
"megabytes": 60.81,
"same_first_token": 1.0,
"same_five_greedy_tokens": 1.0
},
"web_q8": {
"megabytes": 13.32,
"same_first_token": 0.96,
"same_five_greedy_tokens": 0.8967
}
}