weight-space-programming / code /results /lab6 /equivalence.json
thegovind's picture
Publish the weight-space programming labs
bb102c0 verified
Raw History Blame Contribute Delete
577 Bytes
{
"fp32_hook_vs_edit_max_abs_logit_diff": 0.00774073600769043,
"fp32_base_vs_edit_max_abs_logit_diff": 11.400428771972656,
"fp32_hook_vs_edit_mean_kl": 1.4145876470195162e-08,
"fp32_base_vs_edit_mean_kl": 0.017754986882209778,
"bf16_hook_vs_released_file_max_abs_logit_diff": 0.4375,
"bf16_hook_vs_released_file_mean_kl": 0.0005393166793510318,
"bf16_base_vs_released_file_mean_kl": 0.018422264605760574,
"bf16_same_top_token_hook_vs_file": 0.9940000176429749,
"fp64_one_layer_max_abs_diff": 3.3306690738754696e-16,
"fp64_one_layer_output_scale": 0.6499163133384407
}