How to use from the
Use from the
Transformers library
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Thouph/six_tokenizer_8934", device_map="auto")
Quick Links

Filtered the original strings so that only type 0, 5, 7 were left. Added a space before all strings.

Downloads last month
33
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support