DrChenFeng commited on
Commit
58d14e9
Β·
verified Β·
1 Parent(s): 3f4be31

Organization card: simpler layout

Browse files
Files changed (1) hide show
  1. index.html +15 -18
index.html CHANGED
@@ -4,25 +4,22 @@
4
  <meta charset="utf-8">
5
  <meta name="viewport" content="width=device-width, initial-scale=1">
6
  <title>JevBench</title>
7
- <link rel="stylesheet" href="style.css">
8
  </head>
9
  <body>
10
- <div class="card">
11
- <h1>JevBench</h1>
12
- <p class="lead">Metamorphic coherence testing for typed probabilistic decision models.</p>
13
- <p>Typed decision models answer questions about a text with probability distributions over declared answers: yes or
14
- no, one of several options, or a level on an ordered scale. JevBench tests whether those probabilities stay coherent
15
- when a question is reworded, negated, logically combined with others, offered a different set of options, or asked
16
- together with other questions: 50 metamorphic relations in five dimensions, no gold labels needed, every test frozen
17
- in advance.</p>
18
- <table>
19
- <tr><td>πŸ“„ Technical report</td><td><a href="https://www.alphaxiv.org/abs/2610.jevbench-metamorphic-coherence-testing" target="_blank">alphaXiv</a></td></tr>
20
- <tr><td>πŸ—‚οΈ Dataset</td><td><a href="https://huggingface.co/datasets/JevBench/jevbench" target="_blank">JevBench/jevbench</a>: 240 cases, 2,240 questions, frozen test suites and every evaluation report</td></tr>
21
- <tr><td>πŸ† Leaderboard</td><td><a href="https://jevbench.github.io" target="_blank">jevbench.github.io</a>: 21 openly released models</td></tr>
22
- <tr><td>πŸ’» Code</td><td><a href="https://github.com/JevBench/jevbench" target="_blank">github.com/JevBench/jevbench</a> Β· <code>pip install jevbench</code></td></tr>
23
- </table>
24
- <p class="small">Maintained by <a href="https://mrchenfeng.github.io/" target="_blank">Chen Feng</a>,
25
- <a href="https://qub-ml.github.io/" target="_blank">ML Lab</a>, Queen's University Belfast.</p>
26
- </div>
27
  </body>
28
  </html>
 
4
  <meta charset="utf-8">
5
  <meta name="viewport" content="width=device-width, initial-scale=1">
6
  <title>JevBench</title>
 
7
  </head>
8
  <body>
9
+ <p><b>JevBench: metamorphic coherence testing for typed probabilistic decision models.</b></p>
10
+ <p>Typed decision models answer questions about a text with probability distributions over declared answers: yes or
11
+ no, one of several options, or a level on an ordered scale. JevBench tests whether those probabilities stay coherent
12
+ when a question is reworded, negated, logically combined with others, offered a different set of options, or asked
13
+ together with other questions: <b>50 metamorphic relations in five dimensions</b>, no gold labels needed, every test
14
+ frozen in advance. Across 21 openly released models, batch independence mostly holds, while additivity fails
15
+ broadly, above all under negation.</p>
16
+ <ul>
17
+ <li>πŸ“„ <b>Technical report</b>: <a href="https://www.alphaxiv.org/abs/2610.jevbench-metamorphic-coherence-testing" target="_blank">alphaXiv</a></li>
18
+ <li>πŸ—‚οΈ <b>Dataset</b>: <a href="https://huggingface.co/datasets/JevBench/jevbench" target="_blank">JevBench/jevbench</a>, 240 cases, 2,240 questions, frozen test suites and every evaluation report</li>
19
+ <li>πŸ† <b>Leaderboard</b>: <a href="https://jevbench.github.io" target="_blank">jevbench.github.io</a></li>
20
+ <li>πŸ’» <b>Code</b>: <a href="https://github.com/JevBench/jevbench" target="_blank">github.com/JevBench/jevbench</a>, <code>pip install jevbench</code></li>
21
+ </ul>
22
+ <p>Maintained by <a href="https://mrchenfeng.github.io/" target="_blank">Chen Feng</a>,
23
+ <a href="https://qub-ml.github.io/" target="_blank">ML Lab</a>, Queen's University Belfast.</p>
 
 
24
  </body>
25
  </html>