Add EuroLLM-1.7B-Instruct Q4_0 GGUF

311b30d verified 26 days ago

918 Bytes

license: apache-2.0
base_model: utter-project/EuroLLM-1.7B-Instruct
base_model_relation: quantized
language:
  - fr
  - en
tags:
  - gguf
  - llama.cpp
  - translation

EuroLLM-1.7B-Instruct, Q4_0 GGUF

Q4_0 quantization of utter-project/EuroLLM-1.7B-Instruct (revision a25c7fa65fc2a644e6270b8940dbe295b51da681), used for on-device French <-> English translation in the Gaby Translator app.

Converted to f16 with convert_hf_to_gguf.py, then quantized with llama-quantize (llama.cpp tag b11347, commit 5fc4f3c8c7103ffd0b7ff5ee4855bcc78a3ed5cd). No imatrix.
eurollm-1.7b-instruct-q4_0.gguf: 1002984736 bytes, SHA-256 6a07547f180dc16e14df1605ae3ba92c555665bd7d7f30ebcf267ff3146f073f.
Chat template: ChatML, end of turn <|im_end|>.

Licensed under Apache-2.0, as the original model. All credit for the model goes to the EuroLLM authors.