legacy-datasets/mc4
Updated โข 2.45k โข 163
How to use ghofrani/FerdowsiLM with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("ghofrani/FerdowsiLM", device_map="auto")The community version of FerdowsiLM
FerdowsiLM is pretrained from-scratch on more than 250GB of preprocessed Farsi texts.
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ghofrani/FerdowsiLM", device_map="auto")