Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -55,11 +55,11 @@ Accuracy PK — against `decider.serve` (decider-ai 1.9.0); both servers on one
|
|
| 55 |
|
| 56 |
Measured on one RTX 4090, end to end over HTTP, against the model author's own server (`decider.serve`). A ratio above 1x means Verdict is ahead.
|
| 57 |
|
| 58 |
-
| concurrency | Verdict
|
| 59 |
|---|---:|---:|---:|---:|---:|---:|
|
| 60 |
-
| 1 | 139.6 | 132.4 | 1.05x | 6.91
|
| 61 |
-
| 8 | 436.5 | 314.0 | 1.39x | 18.23
|
| 62 |
-
| 64 | 795.9 | 506.2 | 1.57x | 80.13
|
| 63 |
|
| 64 |
## License
|
| 65 |
|
|
|
|
| 55 |
|
| 56 |
Measured on one RTX 4090, end to end over HTTP, against the model author's own server (`decider.serve`). A ratio above 1x means Verdict is ahead.
|
| 57 |
|
| 58 |
+
| concurrency | Verdict rps | `decider.serve` rps | rps ratio | Verdict P50 / P99 (ms) | `decider.serve` P50 / P99 (ms) | P50 / P99 ratio |
|
| 59 |
|---|---:|---:|---:|---:|---:|---:|
|
| 60 |
+
| 1 | 139.6 | 132.4 | 1.05x | 6.91 / 7.88 | 7.51 / 7.94 | 1.09 / 1.01x |
|
| 61 |
+
| 8 | 436.5 | 314.0 | 1.39x | 18.23 / 20.17 | 25.41 / 26.87 | 1.39 / 1.33x |
|
| 62 |
+
| 64 | 795.9 | 506.2 | 1.57x | 80.13 / 85.43 | 112.91 / 436.79 | 1.41 / 5.11x |
|
| 63 |
|
| 64 |
## License
|
| 65 |
|