tahamajs/RR / Docs /module_metadata /kronecker_compressor.json
tahamajs's picture
download
raw
997 Bytes
{
"module_name": "kronecker_compressor",
"class_name": "KroneckerCompressor",
"category": "compression",
"family": "compression",
"params": [
"model",
"rank",
"cfg",
"target_layers"
],
"ops": [
"linear",
"matmul",
"norm",
"softmax"
],
"docstring": "Compresses a model by replacing every eligible nn.Linear layer with a\nKronecker product decomposition (A \u2297 B), falling back to low-rank SVD\nwhen dimensions do not allow composite factorization.\n\nArgs:\n model: PyTorch model to compress (optional if instantiated as standalone engine).\n rank: Rank parameter used for fallback or rank constraints.\n cfg: Optional configuration object.\n target_layers: Optional list of layer names or substrings to compress.\n **kwargs: Additional parameters passed to BaseCompressor.",
"rank": 32,
"d_state": 1,
"num_experts": 1,
"top_k": 1,
"sparsity_pct": 0.0,
"bits": 4,
"hash_val": 31449554991466721592349915429805639819
}

Xet Storage Details

Size:
997 Bytes
·
Xet hash:
ca37dc9a994c309875f0696fbde434baf24a8f9cc5ef62fdafff445770441a79

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.