How to use Qdrant/gte-base-onnx with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("Qdrant/gte-base-onnx") model = AutoModel.from_pretrained("Qdrant/gte-base-onnx", device_map="auto")
ONNX port of thenlper/gte-base for text classification and similarity searches.
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("Qdrant/gte-base-onnx") model = AutoModel.from_pretrained("Qdrant/gte-base-onnx", device_map="auto")