HuggingFaceFW/fineweb
Viewer โข Updated โข 52.5B โข 354k โข 3.75k
How to use EleutherAI/FineWeb-restricted with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("EleutherAI/FineWeb-restricted", device_map="auto")