A collection of quantized LLMs in OpenVINO format
Jojo
jojo1899
AI & ML interests
None yet
Organizations
models 8
jojo1899/llama-3_1-8b-instruct-ov-int4
Updated • 7
jojo1899/Phi-3.5-mini-instruct-onnx-int4
Updated
jojo1899/Llama-2-13b-chat-hf-onnx-int4
Updated • 1
jojo1899/Llama-2-13b-chat-hf-ov-int4
Text Generation • Updated • 11
jojo1899/Phi-3.5-mini-instruct-ov-int4
Updated • 6
jojo1899/Mistral-7B-Instruct-v0.2-ov-int4
Text Generation • Updated • 11
jojo1899/Phi-3-mini-128k-instruct-ov-int4
Text Generation • Updated • 14
jojo1899/llama-3_1-8b-instruct-onnx-int4
Updated
datasets 0
None public yet