tahamajs/RR / Docs /module_metadata /a3_compressor.json
tahamajs's picture
download
raw
670 Bytes
{
"module_name": "a3_compressor",
"class_name": "A3Compressor",
"category": "compression",
"family": "compression",
"params": [
"in_features",
"out_features",
"rank",
"bias",
"dtype",
"device",
"model",
"use_fisher",
"recalibrate_ln",
"target_attention_only",
"tokenizer",
"calibration_loader",
"calibration_texts"
],
"ops": [
"linear"
],
"docstring": "A3 Compressor: Activation-Aware SVD with Fisher weighting and LayerNorm recalibration.",
"rank": 32,
"d_state": 1,
"num_experts": 1,
"top_k": 1,
"sparsity_pct": 0.0,
"bits": 4,
"hash_val": 13214063829052852525787076530711509430
}

Xet Storage Details

Size:
670 Bytes
·
Xet hash:
989e1fe04dac288a4d9a571f6a72366ebddb8102801cfa9f04e03c36774be3c1

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.