### GenAudit Mistral 7B GGUF
Inspired by this paper: https://genaudit.org/
Original Code here: https://github.com/kukrishna/genaudit
Converted to GGUF format for running it on Ollama/Llama.cpp so as to take advantage of VRAM offloading to RAM (something Huggingface transformers is unable to do for now).
Merged base mistral_v0.1_instruct with Qlora and quantised to Q4_k_s gguf format
You may find the base 16 bit model here (but further quantisation is advisable as their Qlora module was fine tuned on the 4bit nf4 base llm)
