tahamajs's picture
download
raw
542 Bytes
{
"module_name": "cure",
"class_name": "CURMoECompressor",
"category": "compression",
"family": "compression",
"params": [
"model",
"rank"
],
"ops": [
"linear",
"matmul",
"norm",
"softmax"
],
"docstring": "Compresses expert layers using CUR decomposition.\n\nArgs:\n model: PyTorch model.\n rank: rank for CUR decomposition (default 32).",
"rank": 32,
"d_state": 1,
"num_experts": 1,
"top_k": 1,
"sparsity_pct": 0.0,
"bits": 4,
"hash_val": 48636905497270217657428130389052632860
}

Xet Storage Details

Size:
542 Bytes
·
Xet hash:
dff07f81d4f0772dee22057a19f6483bc6f90932891c9b98b5ac83a5ae9725f9

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.