Created ONNX version that seems to require a lot less VRAM

#17
by fwaris - opened

https://github.com/fwaris/Chroma_ONNX

Was able to run it on a 3080 with 16GB of VRAM (+ 2GB shared memory).

BTW thanks for sharing. This is a great model / system!

fwaris changed discussion status to closed

Sign up or log in to comment