How to use PrimeQA/XOR-TyDi_monolingual_DPR_ctx_encoder with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, DPRContextEncoder tokenizer = AutoTokenizer.from_pretrained("PrimeQA/XOR-TyDi_monolingual_DPR_ctx_encoder") model = DPRContextEncoder.from_pretrained("PrimeQA/XOR-TyDi_monolingual_DPR_ctx_encoder", device_map="auto")
https://huggingface.co/PrimeQA/XOR-TyDi_monolingual_DPR_ctx_encoder/resolve/main/tokenizer.json
hf download hf://PrimeQA/XOR-TyDi_monolingual_DPR_ctx_encoder/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/PrimeQA/XOR-TyDi_monolingual_DPR_ctx_encoder/resolve/main/tokenizer.json
