Spaces:
Running
Running
| title: P-Bench | |
| emoji: 🥇 | |
| colorFrom: green | |
| colorTo: indigo | |
| sdk: gradio | |
| pinned: true | |
| license: apache-2.0 | |
| short_description: A cost/quality/speed Leaderboard for Inference Providers! | |
| sdk_version: 5.19.0 | |
| tags: | |
| - leaderboard | |
| # P-Bench | |
| Compare text-to-image, text-to-video, image-to-video, and video-to-video | |
| models on quality, speed, and price. This repo is the | |
| Gradio dashboard: leaderboards, Pareto plots, and side-by-side samples. | |
| The live Space is [PrunaAI/P-Bench](https://huggingface.co/spaces/PrunaAI/P-Bench). | |
| The current P-Video-2 Pro evaluation snapshots are | |
| `data/t2v-pro.csv` (text-to-video) and | |
| `data/i2v-pro.csv` (image-to-video). Both feed the leaderboards and | |
| price/time Pareto plots with Datapoint and Rapidata Elo. All | |
| models appear in the video-generation leaderboards, including variants with | |
| missing scores. Missing scores and ranks display as dashes; Pareto plots | |
| include only models with the required score and price or timing. Image-to-video | |
| sample media is not included in these exports. | |
| Rapidata Elo comes directly from these exports. | |
| ## Run locally | |
| From the repo root: | |
| ``` | |
| python -m venv .venv | |
| source .venv/bin/activate | |
| pip install "gradio==5.19.0" pandas -r requirements.txt | |
| python app.py | |
| ``` | |
| `requirements.txt` lists Plotly. Gradio and pandas are required locally; | |
| Hugging Face Spaces installs Gradio from the YAML `sdk_version` above. | |
| ## Deploy | |
| `origin` is the Space (`https://huggingface.co/spaces/PrunaAI/P-Bench`). | |
| Publish the current branch to the live app with: | |
| ``` | |
| git push origin HEAD:main | |
| ``` | |