Tfloow
/

OmniQuant

Weight-Quantization

Model card Files Files and versions

1.65 GB

Ctrl+K

Ctrl+K

1 contributor

History: 13 commits

Tfloow's picture

Upload Llama-2-13b-hf-w4a16g128.pth

7fade90 verified about 4 hours ago

.gitattributes

1.52 kB
initial commit 6 months ago
Llama-2-13b-hf-w4a16g128.pth

397 MB
xet

Upload Llama-2-13b-hf-w4a16g128.pth about 4 hours ago
Llama-2-7b-hf-w4a16g128.pth

203 MB
xet

Upload folder using huggingface_hub 6 months ago
Llama-3.1-8B-w4a16g128.pth

218 MB
xet

Upload folder using huggingface_hub 6 months ago
Llama-3.2-1B-w4a16g128.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
30.5 MB
xet

Upload Llama-3.2-1B-w4a16g128.pth 6 months ago
Llama-3.2-3B-w4a16g128.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
88.2 MB
xet

Upload folder using huggingface_hub 6 months ago
Qwen2.5-0.5B-w4a16g128.pth

11.3 MB
xet

Upload folder using huggingface_hub 6 months ago
Qwen2.5-14B-w4a16g128.pth

413 MB
xet

Upload folder using huggingface_hub 6 months ago
Qwen2.5-3B-w4a16g128.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
86.9 MB
xet

Upload folder using huggingface_hub 6 months ago
Qwen2.5-7B-w4a16g128.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
204 MB
xet

Upload folder using huggingface_hub 6 months ago
README.md

914 Bytes
Update README.md 6 months ago