Laya Multilingual GGUF
GGUF files of Laya Multilingual for llama.cpp's
llama-server (build b11404 or later), endpoint POST /v1/systemone.
| File | Size |
|---|---|
Laya-Multilingual-Q8_0.gguf |
357 MB |
Laya-Multilingual-F16-embdQ8.gguf (F16, token embeddings Q8_0) |
474 MB |
Laya-Multilingual-F16.gguf |
658 MB |
Laya-Multilingual-BF16.gguf |
658 MB |
llama-server -m Laya-Multilingual-Q8_0.gguf -c 1024 -b 1024 -ub 1024
Licence: Apache-2.0, as the original model.
- Downloads last month
- 684
Hardware compatibility
Log In to add your hardware
8-bit
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for andreilungeanu/laya-multilingual-GGUF
Base model
convaiinnovations/laya-multilingual