Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
androidli
/
laya-multilingual-onnx-int4
Like
3
ONNX
multilingual
Chinese
English
onnxruntime
int4
4-bit precision
weight-only-quantization
MatMulNBits
GatherBlockQuantized
system-one
decision-model
cpu-inference
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
laya-multilingual-onnx-int4
/
scripts
22.4 kB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
androidli
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
ad024da
verified
26 days ago
emb_quant.py
Safe
8.94 kB
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
export_onnx.py
Safe
3.05 kB
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
int4_quantize.py
Safe
2.41 kB
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
onnx_acceptance.py
Safe
6.28 kB
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
strip_value_info.py
Safe
1.69 kB
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
