How to use ProCreations/Zap with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="ProCreations/Zap")
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("ProCreations/Zap") model = AutoModelForTokenClassification.from_pretrained("ProCreations/Zap", device_map="auto")
e4805d0
1
2
3
4
5
6
7
{ "positions": 11605, "fp32_onnx_max_abs_logit_diff": 0.00010442733764648438, "bf16_torch_argmax_agreement": 0.9999138302455838, "fp32_onnx_argmax_agreement": 1.0, "int8_onnx_argmax_agreement": 0.999138302455838 }
