Transformers How to use treehugg3/dbrx-base-tokenizer-llamacpp with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("treehugg3/dbrx-base-tokenizer-llamacpp", device_map="auto")
