Please provide gguf

#4
by hgeist - opened

These numbers look incredible and I was very surprised by the preview already.

Could you provide a Q8 and Q4 gguf please?

Thanks for the kind words! We expect to release both Q8 and Q4 GGUF versions tomorrow, along with llama.cpp support. Stay tuned!

Would you mind if I made a post about your model in r/LLocallaMa or would you rather wanna post about it yourself?

We’d love for the community to help spread the word, so please feel free to post! We’ll likely make a post ourselves as well.

Sign up or log in to comment