Instructions to use xju-arlab/vbench-model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use xju-arlab/vbench-model with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Download multiple_objects/dev_metrics.jsonl from xju-arlab/vbench-model: direct link, hf CLI and curl.
- Browser
- Download file 693 Bytes
-
https://huggingface.co/xju-arlab/vbench-model/resolve/main/multiple_objects/dev_metrics.jsonl
- Command line
-
hf download hf://xju-arlab/vbench-model/multiple_objects/dev_metrics.jsonl
-
curl -L -o dev_metrics.jsonl https://huggingface.co/xju-arlab/vbench-model/resolve/main/multiple_objects/dev_metrics.jsonl
693 Bytes
| {"dev_exact_match": 0.8333333333333334, "dev_parseable_rate": 1.0, "dev_samples": 24, "step": 150} | |
| {"dev_exact_match": 0.8333333333333334, "dev_parseable_rate": 1.0, "dev_samples": 24, "step": 300} | |
| {"dev_exact_match": 0.9166666666666666, "dev_parseable_rate": 1.0, "dev_samples": 24, "step": 450} | |
| {"dev_exact_match": 0.9166666666666666, "dev_parseable_rate": 1.0, "dev_samples": 24, "step": 600} | |
| {"dev_exact_match": 0.9166666666666666, "dev_parseable_rate": 1.0, "dev_samples": 24, "step": 750} | |
| {"dev_exact_match": 0.9166666666666666, "dev_parseable_rate": 1.0, "dev_samples": 24, "step": 900} | |
| {"dev_exact_match": 0.9166666666666666, "dev_parseable_rate": 1.0, "dev_samples": 24, "step": 900} | |