New discussion

AWQ INT4?

#11 opened about 5 hours ago by
garrettkolson

app for this model

#10 opened about 7 hours ago by
akhaliq

We are waiting for Dflash2...

#9 opened about 8 hours ago by
naildirect

llama.cpp build

👍 3
1
#8 opened about 8 hours ago by
ClaudioItaly

Apple Silicon

2
#6 opened about 12 hours ago by
devi9br

Recommendation for 8gb vram?

1
#5 opened about 13 hours ago by
idkgoogleit

Please provide gguf

🔥 3
3
#4 opened about 15 hours ago by
hgeist