How to use dspoka/units-gen-d-u with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, GenNumSIUnit tokenizer = AutoTokenizer.from_pretrained("dspoka/units-gen-d-u") model = GenNumSIUnit.from_pretrained("dspoka/units-gen-d-u", device_map="auto")
https://huggingface.co/dspoka/units-gen-d-u/resolve/main/tokenizer.json
hf download hf://dspoka/units-gen-d-u/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/dspoka/units-gen-d-u/resolve/main/tokenizer.json
