Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
androidli
/
laya-multilingual-onnx-int4
Like
3
ONNX
multilingual
Chinese
English
onnxruntime
int4
4-bit precision
weight-only-quantization
MatMulNBits
GatherBlockQuantized
system-one
decision-model
cpu-inference
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
laya-multilingual-onnx-int4
428 MB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
androidli
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
ad024da
verified
26 days ago
encoder
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
results
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
scripts
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
tokenizer
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
.gitattributes
Safe
1.74 kB
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
LICENSE
Safe
11.4 kB
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
README.md
Safe
5.53 kB
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
laya-multilingual-int4-blk32.onnx
Safe
161 kB
xet
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
laya-multilingual-int4-blk32.onnx.data
Safe
206 MB
xet
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
laya-multilingual-int4-layer32-vocab128.onnx
Safe
164 kB
xet
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
laya-multilingual-int4-layer32-vocab128.onnx.data
Safe
188 MB
xet
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
rl_agent_config.json
Safe
472 Bytes
laya multilingual ONNX int4 (MatMulNBits + GatherBlockQuantized), tokenizer/config + scripts
26 days ago
