Organization card: simpler layout
Browse files- index.html +15 -18
index.html
CHANGED
|
@@ -4,25 +4,22 @@
|
|
| 4 |
<meta charset="utf-8">
|
| 5 |
<meta name="viewport" content="width=device-width, initial-scale=1">
|
| 6 |
<title>JevBench</title>
|
| 7 |
-
<link rel="stylesheet" href="style.css">
|
| 8 |
</head>
|
| 9 |
<body>
|
| 10 |
-
<
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
<
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
<a href="https://qub-ml.github.io/" target="_blank">ML Lab</a>, Queen's University Belfast.</p>
|
| 26 |
-
</div>
|
| 27 |
</body>
|
| 28 |
</html>
|
|
|
|
| 4 |
<meta charset="utf-8">
|
| 5 |
<meta name="viewport" content="width=device-width, initial-scale=1">
|
| 6 |
<title>JevBench</title>
|
|
|
|
| 7 |
</head>
|
| 8 |
<body>
|
| 9 |
+
<p><b>JevBench: metamorphic coherence testing for typed probabilistic decision models.</b></p>
|
| 10 |
+
<p>Typed decision models answer questions about a text with probability distributions over declared answers: yes or
|
| 11 |
+
no, one of several options, or a level on an ordered scale. JevBench tests whether those probabilities stay coherent
|
| 12 |
+
when a question is reworded, negated, logically combined with others, offered a different set of options, or asked
|
| 13 |
+
together with other questions: <b>50 metamorphic relations in five dimensions</b>, no gold labels needed, every test
|
| 14 |
+
frozen in advance. Across 21 openly released models, batch independence mostly holds, while additivity fails
|
| 15 |
+
broadly, above all under negation.</p>
|
| 16 |
+
<ul>
|
| 17 |
+
<li>π <b>Technical report</b>: <a href="https://www.alphaxiv.org/abs/2610.jevbench-metamorphic-coherence-testing" target="_blank">alphaXiv</a></li>
|
| 18 |
+
<li>ποΈ <b>Dataset</b>: <a href="https://huggingface.co/datasets/JevBench/jevbench" target="_blank">JevBench/jevbench</a>, 240 cases, 2,240 questions, frozen test suites and every evaluation report</li>
|
| 19 |
+
<li>π <b>Leaderboard</b>: <a href="https://jevbench.github.io" target="_blank">jevbench.github.io</a></li>
|
| 20 |
+
<li>π» <b>Code</b>: <a href="https://github.com/JevBench/jevbench" target="_blank">github.com/JevBench/jevbench</a>, <code>pip install jevbench</code></li>
|
| 21 |
+
</ul>
|
| 22 |
+
<p>Maintained by <a href="https://mrchenfeng.github.io/" target="_blank">Chen Feng</a>,
|
| 23 |
+
<a href="https://qub-ml.github.io/" target="_blank">ML Lab</a>, Queen's University Belfast.</p>
|
|
|
|
|
|
|
| 24 |
</body>
|
| 25 |
</html>
|