HuggingFaceFW/fineweb
Viewer โข Updated โข 52.5B โข 302k โข 3.59k
How to use EleutherAI/FineWeb-restricted with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("EleutherAI/FineWeb-restricted", device_map="auto")
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("EleutherAI/FineWeb-restricted", device_map="auto")