How to use CodeIsAbstract/HybridModelScratch with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import HybridFourierLM model = HybridFourierLM.from_pretrained("CodeIsAbstract/HybridModelScratch", device_map="auto")
https://huggingface.co/CodeIsAbstract/HybridModelScratch/resolve/7e24ce14e17e1b20690db2e179406c7a4b5fa6bf/last-checkpoint/tokenizer.json
hf download hf://CodeIsAbstract/HybridModelScratch@7e24ce14e17e1b20690db2e179406c7a4b5fa6bf/last-checkpoint/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/CodeIsAbstract/HybridModelScratch/resolve/7e24ce14e17e1b20690db2e179406c7a4b5fa6bf/last-checkpoint/tokenizer.json
