higher-order-pruner / pruner_config.json
Angshul's picture
Upload 11 files
cdfcfcf verified
Raw History Blame Contribute Delete
332 Bytes
{
"format": "higher-order-pruner-v1",
"method": "diagonal-higher-order-kfac",
"defaults": {
"sparsity": 0.5,
"probes": 2,
"finite_difference_relative_step": 0.02,
"cubic_cap": 0.5,
"damping_ratio": 0.01,
"trust_ratio": 0.01,
"backtracking": [1.0, 0.5, 0.25, 0.125, 0.0625],
"seed": 91000
}
}