How to use markod0925/TinyToken-Italian with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("markod0925/TinyToken-Italian", device_map="auto")
GPT2 Tokenizer trained on [markod0925/TinyStories-Italian] dataset.
-
