fp16 version is slower
#2
by unreal79 - opened
Just my experience: fp16 version of the model is about 2 times slower. Can't see a difference in background removing results. Memory footprint difference is negligible in my case, so I consider the fp16 version as useless.
Overall the studioludens/birefnet-lite-512 is excellent! Very fast and gives good results (though results of onnx-community/BiRefNet_512x512-ONNX are better, but it's 3 times slower and eats more RAM).
Hey, thanks for the feedback. I guess the only upside for the fp16 version then is that it takes less bandwidth and VRAM. I haven't done a proper comparison on that yet.