Working without the Sdk?
#5
by meganoob1337 - opened
Hello,
i just wanted to ask if this Model works without the SDK?
im running it in vLLM (with Transformers and nightly vllm)
But when using it in my OCR workflow it seems to hang and not respond.
Is it because i'm trying it without your SDK?
EDIT:
And thank you for Creating this Model!
Yes, you can directly use the OpenAI format for requests. The SDK only handles more preprocessing; even without the SDK, you can still make requests directly using the OpenAI method
meganoob1337 changed discussion status to closed