tahamajs/RR / Docs /module_metadata /hashed_linear.json
tahamajs's picture
download
raw
583 Bytes
{
"module_name": "hashed_linear",
"class_name": "HashedLinear",
"category": "compression",
"family": "compression",
"params": [
"in_features",
"out_features",
"n_buckets",
"bias",
"use_sign",
"dtype",
"device"
],
"ops": [
"reshape",
"linear",
"view"
],
"docstring": "Linear layer with weight sharing via a compact parameter hash table.\nW_{i, j} = xi(i, j) * w[h(i, j)]",
"rank": 16,
"d_state": 1,
"num_experts": 1,
"top_k": 1,
"sparsity_pct": 0.0,
"bits": 4,
"hash_val": 2102369884844023837251539501486711264
}

Xet Storage Details

Size:
583 Bytes
·
Xet hash:
1481d7f7b23221fcbfb95eea7ba93a1f09cbaa4bbb699e28eacb1665ae8df9f4

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.