How to use erbacher/VQ-PDETokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import Tokenizer model = Tokenizer.from_pretrained("erbacher/VQ-PDETokenizer", device_map="auto")
