5 quants?
#1
by Orenguteng - opened
Possible please?
How are you going to run an unsupported model?
Oh didnt see it was unsupported
Orenguteng changed discussion status to closed
Ouch I've exactly tried to run it with LM-Studio and it failed ✌️
I want to use llamacpp for starcoder model however it throws error for starcoder2, is it not supported by llamacpp python?
@madhucharan You need to check if the version of llamacpp python you are using is running a commit after they added support.