mradermacher

/

model_requests

Like 221

https://huggingface.co/swiss-ai/Apertus-v1.5-8B

Please consider the new Apertus releases (i'll post the 70B separately)

Thank you!

Gated, sorry

they're both Apache 2.0, do you have any qualms about quantizing from a copied repo?

https://huggingface.co/buckets/xdavxd/Apertus-v1.5-8B
https://huggingface.co/buckets/xdavxd/Apertus-v1.5-70B

sounds good

It's queued! =)

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Apertus-v1.5-8B-GGUF for quants to appear.

You are THE BEST. Thanks!!

i think it didn't run, maybe because i cloned the repo into a bucket? it's public but idk, maybe your automation doesnt like it

I didnt use your bucket, I used my access key
Apertus-v1.5-8B INFO:hf-to-gguf:Model architecture: Apertus1p5ForConditionalGeneration
Apertus-v1.5-8B ERROR:hf-to-gguf:Model Apertus1p5ForConditionalGeneration is not supported