How to use hmzprover/hpsearch-rerank-4b-state with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("hmzprover/hpsearch-rerank-4b-state") model = AutoModelForCausalLM.from_pretrained("hmzprover/hpsearch-rerank-4b-state", device_map="auto")
