Instructions to use masakhane/generative_reader_nq_squad_v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use masakhane/generative_reader_nq_squad_v2 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("masakhane/generative_reader_nq_squad_v2") model = AutoModelForSeq2SeqLM.from_pretrained("masakhane/generative_reader_nq_squad_v2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download eval_results.json from masakhane/generative_reader_nq_squad_v2: direct link, hf CLI and curl.
- Browser
- Download file 502 Bytes
-
https://huggingface.co/masakhane/generative_reader_nq_squad_v2/resolve/main/eval_results.json
- Command line
-
hf download hf://masakhane/generative_reader_nq_squad_v2/eval_results.json
-
curl -L -o eval_results.json https://huggingface.co/masakhane/generative_reader_nq_squad_v2/resolve/main/eval_results.json
502 Bytes
| { | |
| "eval_HasAns_exact": 71.86234817813765, | |
| "eval_HasAns_f1": 77.47654791050284, | |
| "eval_HasAns_total": 5928, | |
| "eval_NoAns_exact": 68.27586206896552, | |
| "eval_NoAns_f1": 68.27586206896552, | |
| "eval_NoAns_total": 5945, | |
| "eval_best_exact": 70.06653752210899, | |
| "eval_best_exact_thresh": 0.0, | |
| "eval_best_f1": 72.86961812629183, | |
| "eval_best_f1_thresh": 0.0, | |
| "eval_exact": 70.06653752210899, | |
| "eval_f1": 72.86961812629174, | |
| "eval_samples": 12458, | |
| "eval_total": 11873 | |
| } |