Spaces:
Running
Running
Restore original Dissei organization profile
Browse files- README.md +27 -50
- index.html +2 -106
README.md
CHANGED
|
@@ -8,53 +8,30 @@ pinned: false
|
|
| 8 |
---
|
| 9 |
|
| 10 |
# Dissei Data
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
| Model | Reward / 100 | Submitted |
|
| 39 |
-
|---|---|---|
|
| 40 |
-
| Claude Fable 5.1 | 60.73 | 7/7 |
|
| 41 |
-
| GPT-6 Astra | 52.45 | 7/7 |
|
| 42 |
-
| Claude Opus 5.5 | 52.17 | 7/7 |
|
| 43 |
-
| GLM-5.3 | 44.91 | 7/7 |
|
| 44 |
-
| Kimi K3 | 35.79 | 7/7 |
|
| 45 |
-
| Gemini 3.8 Flash | 9.01 | 1/7 |
|
| 46 |
-
|
| 47 |
-
Scores are the equal-weight mean of seven saved continuous task rewards, multiplied by 100—not accuracy. They come from the complete controlled-access tasks, not the public previews. The comparison uses Harbor 0.23.0 and the Terminus-2 JSON harness, with 20 dataroom calls, 40 agent turns per task, a 30-minute task limit and a 16,384-token output limit per request. The fixed judge is `gemini-3.1-pro-preview`, with low reasoning and one vote; agent reasoning is high.
|
| 48 |
-
|
| 49 |
-
**Interpretation matters.** Gemini 3.8 Flash submitted one of seven selected answers; six tasks reached the **40-turn-per-task cap**. Five tasks were rerun after a gateway authentication fix. GLM-5.3 includes one recovered task, with its earlier VM-interrupted recovery retained in the private record. These are single-case results with one selected outcome per task, no repeated-run error bars, and dependence on the judge, harness and provider framing. They are not an external certification or a ranking of general financial ability.
|
| 50 |
-
|
| 51 |
-
## Research access
|
| 52 |
-
|
| 53 |
-
We publish the sample questions, results and methodology so researchers can understand the work before requesting access. Full case evidence, execution environments, rubrics, reference answers, evaluator source and run records remain controlled-access materials.
|
| 54 |
-
|
| 55 |
-
After a mutual NDA and review terms are agreed, approved researchers can receive the exact evaluated task versions, submitted answers, trajectories, grading breakdowns and original failure/recovery records. The private **EBITDA PRIVATE** package contains the full sample write-up and saved evaluation records. Dissei grants access explicitly; signing an NDA does not automatically unlock a repository.
|
| 56 |
-
|
| 57 |
-
Evaluation access does not grant training or redistribution rights. Those rights, retention and permitted use are defined by agreement. We do not publish private benchmark files or raw trajectories on this organization card.
|
| 58 |
-
|
| 59 |
-
**Methods & findings:** [dissei.ai/research](https://dissei.ai/research)
|
| 60 |
-
**Contact:** [info@dissei.credit](mailto:info@dissei.credit) · [Request research access](https://dissei.ai/contact)
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
# Dissei Data
|
| 11 |
+
**Outcome-graded RL environments for institutional financial judgment.**
|
| 12 |
+
|
| 13 |
+
Dissei builds reinforcement-learning environments from real institutional credit
|
| 14 |
+
decisions — each one a documented transaction rebuilt as an agentic task, worked with
|
| 15 |
+
analyst tools and graded against what actually happened.
|
| 16 |
+
|
| 17 |
+
- **Point-in-time by construction.** A model sees only what was knowable at the decision
|
| 18 |
+
date; every exhibit is anchor-gated, so hindsight is excluded structurally — not by an
|
| 19 |
+
instruction it can ignore.
|
| 20 |
+
- **Graded, not checked.** Reward decomposes into fail-closed critical gates, an
|
| 21 |
+
expert-authored graded rubric, a contradiction penalty, and a retrieval modulator that
|
| 22 |
+
rewards grounding in the record.
|
| 23 |
+
- **Grading automation, disclosed.** Rubrics are authored and anchored by credit
|
| 24 |
+
practitioners who carried real risk; execution runs on LLM judges at temperature 0 that
|
| 25 |
+
apply the sealed rubric and never invent criteria. Answers are graded twice — against
|
| 26 |
+
best practice, and against the realized outcome.
|
| 27 |
+
- **Sealed by architecture.** Answer material is time-locked and anchor-gated; every asset
|
| 28 |
+
ships with a per-asset contamination statement and right-to-train lineage.
|
| 29 |
+
- **Operators, not an annotation farm.** The corpus is the by-product of an operating
|
| 30 |
+
lending business — incentive-bearing decisions with real consequences, not opinions
|
| 31 |
+
commissioned for a dataset.
|
| 32 |
+
|
| 33 |
+
Environments (RL post-training) and sealed evaluations are available to frontier labs
|
| 34 |
+
**under agreement**. We do not publish tasks, rubrics, graders, or leaderboards.
|
| 35 |
+
|
| 36 |
+
**Methods & findings:** https://dissei.ai/research
|
| 37 |
+
**Contact:** info@dissei.credit · Mutual NDA before anything sensitive.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
index.html
CHANGED
|
@@ -1,108 +1,4 @@
|
|
| 1 |
<!doctype html><html lang="en"><head><meta charset="utf-8"><title>Dissei Data</title>
|
| 2 |
<meta http-equiv="refresh" content="0; url=https://dissei.ai/research"></head>
|
| 3 |
-
<body>
|
| 4 |
-
<
|
| 5 |
-
<p><strong>We explore financial reasoning and analysis for institutional investment and credit decisions.</strong></p>
|
| 6 |
-
<p>Dissei develops task environments in which an agent reads transaction evidence, weighs trade-offs and produces an analytical judgment. Our work connects financial reasoning with evidence retrieval, tool use and rubric-based evaluation.</p>
|
| 7 |
-
<h2>EBTIDA — explore the sample</h2>
|
| 8 |
-
<p><a href="https://hub.harborframework.com/datasets/dissei/ebitda"><strong>Open the seven task previews and recorded results on Harbor</strong></a>.</p>
|
| 9 |
-
<p>EBTIDA presents seven questions from one completed private-equity transaction, one per reasoning family. It is a sample of a 70-task environment, not the full set or a claim about general financial ability. Company and person names are suppressed in the task material.</p>
|
| 10 |
-
<h3>Task questions</h3>
|
| 11 |
-
<table>
|
| 12 |
-
<thead>
|
| 13 |
-
<tr>
|
| 14 |
-
<th>Reasoning family</th>
|
| 15 |
-
<th>Information cutoff</th>
|
| 16 |
-
<th>Question</th>
|
| 17 |
-
</tr>
|
| 18 |
-
</thead>
|
| 19 |
-
<tbody>
|
| 20 |
-
<tr>
|
| 21 |
-
<td>Diagnostic</td>
|
| 22 |
-
<td>2021-12</td>
|
| 23 |
-
<td><a href="https://hub.harborframework.com/tasks/dissei/finance-preview-dg04">What diagnosis should you make of Company CI recent margin pressure at the anchor?</a></td>
|
| 24 |
-
</tr>
|
| 25 |
-
<tr>
|
| 26 |
-
<td>Predictive</td>
|
| 27 |
-
<td>2021-12</td>
|
| 28 |
-
<td><a href="https://hub.harborframework.com/tasks/dissei/finance-preview-pr02">Would you expect Company CI to be relatively resilient if demand conditions weakened after the anchor?</a></td>
|
| 29 |
-
</tr>
|
| 30 |
-
<tr>
|
| 31 |
-
<td>Explanatory</td>
|
| 32 |
-
<td>2022-06</td>
|
| 33 |
-
<td><a href="https://hub.harborframework.com/tasks/dissei/finance-preview-ex01">Why did Company CI recent margin pressure matter for the investment case at the anchor?</a></td>
|
| 34 |
-
</tr>
|
| 35 |
-
<tr>
|
| 36 |
-
<td>Quantitative</td>
|
| 37 |
-
<td>2022-06</td>
|
| 38 |
-
<td><a href="https://hub.harborframework.com/tasks/dissei/finance-preview-qn02">What does the segment-share exhibit imply about Company CI relative market position?</a></td>
|
| 39 |
-
</tr>
|
| 40 |
-
<tr>
|
| 41 |
-
<td>Counterfactual</td>
|
| 42 |
-
<td>2022-09</td>
|
| 43 |
-
<td><a href="https://hub.harborframework.com/tasks/dissei/finance-preview-cf01">Had Company BR declined to roll equity and provide a seller note, how would Company ED have had to reshape the capital structure to close at the same price, and how would risk-sharing shift?</a></td>
|
| 44 |
-
</tr>
|
| 45 |
-
<tr>
|
| 46 |
-
<td>Comparative</td>
|
| 47 |
-
<td>2022-09</td>
|
| 48 |
-
<td><a href="https://hub.harborframework.com/tasks/dissei/finance-preview-cp02">Company ED is negotiating to acquire Company CI at a $14 billion enterprise value. Measured against how public equity markets value comparable HVAC manufacturers, is that entry price attractive?</a></td>
|
| 49 |
-
</tr>
|
| 50 |
-
<tr>
|
| 51 |
-
<td>Strategic</td>
|
| 52 |
-
<td>2022-09</td>
|
| 53 |
-
<td><a href="https://hub.harborframework.com/tasks/dissei/finance-preview-st06">Which diligence workstream should Company ED treat as gating before signing the carve-out?</a></td>
|
| 54 |
-
</tr>
|
| 55 |
-
</tbody>
|
| 56 |
-
</table>
|
| 57 |
-
<p>Each public task page contains its question, brief and metadata. The previews do not include case evidence or answer keys and are not runnable evaluations.</p>
|
| 58 |
-
<h3>Recorded model results</h3>
|
| 59 |
-
<table>
|
| 60 |
-
<thead>
|
| 61 |
-
<tr>
|
| 62 |
-
<th>Model</th>
|
| 63 |
-
<th>Reward / 100</th>
|
| 64 |
-
<th>Submitted</th>
|
| 65 |
-
</tr>
|
| 66 |
-
</thead>
|
| 67 |
-
<tbody>
|
| 68 |
-
<tr>
|
| 69 |
-
<td>Claude Fable 5.1</td>
|
| 70 |
-
<td>60.73</td>
|
| 71 |
-
<td>7/7</td>
|
| 72 |
-
</tr>
|
| 73 |
-
<tr>
|
| 74 |
-
<td>GPT-6 Astra</td>
|
| 75 |
-
<td>52.45</td>
|
| 76 |
-
<td>7/7</td>
|
| 77 |
-
</tr>
|
| 78 |
-
<tr>
|
| 79 |
-
<td>Claude Opus 5.5</td>
|
| 80 |
-
<td>52.17</td>
|
| 81 |
-
<td>7/7</td>
|
| 82 |
-
</tr>
|
| 83 |
-
<tr>
|
| 84 |
-
<td>GLM-5.3</td>
|
| 85 |
-
<td>44.91</td>
|
| 86 |
-
<td>7/7</td>
|
| 87 |
-
</tr>
|
| 88 |
-
<tr>
|
| 89 |
-
<td>Kimi K3</td>
|
| 90 |
-
<td>35.79</td>
|
| 91 |
-
<td>7/7</td>
|
| 92 |
-
</tr>
|
| 93 |
-
<tr>
|
| 94 |
-
<td>Gemini 3.8 Flash</td>
|
| 95 |
-
<td>9.01</td>
|
| 96 |
-
<td>1/7</td>
|
| 97 |
-
</tr>
|
| 98 |
-
</tbody>
|
| 99 |
-
</table>
|
| 100 |
-
<p>Scores are the equal-weight mean of seven saved continuous task rewards, multiplied by 100—not accuracy. They come from the complete controlled-access tasks, not the public previews. The comparison uses Harbor 0.23.0 and the Terminus-2 JSON harness, with 20 dataroom calls, 40 agent turns per task, a 30-minute task limit and a 16,384-token output limit per request. The fixed judge is <code>gemini-3.1-pro-preview</code>, with low reasoning and one vote; agent reasoning is high.</p>
|
| 101 |
-
<p><strong>Interpretation matters.</strong> Gemini 3.8 Flash submitted one of seven selected answers; six tasks reached the <strong>40-turn-per-task cap</strong>. Five tasks were rerun after a gateway authentication fix. GLM-5.3 includes one recovered task, with its earlier VM-interrupted recovery retained in the private record. These are single-case results with one selected outcome per task, no repeated-run error bars, and dependence on the judge, harness and provider framing. They are not an external certification or a ranking of general financial ability.</p>
|
| 102 |
-
<h2>Research access</h2>
|
| 103 |
-
<p>We publish the sample questions, results and methodology so researchers can understand the work before requesting access. Full case evidence, execution environments, rubrics, reference answers, evaluator source and run records remain controlled-access materials.</p>
|
| 104 |
-
<p>After a mutual NDA and review terms are agreed, approved researchers can receive the exact evaluated task versions, submitted answers, trajectories, grading breakdowns and original failure/recovery records. The private <strong>EBITDA PRIVATE</strong> package contains the full sample write-up and saved evaluation records. Dissei grants access explicitly; signing an NDA does not automatically unlock a repository.</p>
|
| 105 |
-
<p>Evaluation access does not grant training or redistribution rights. Those rights, retention and permitted use are defined by agreement. We do not publish private benchmark files or raw trajectories on this organization card.</p>
|
| 106 |
-
<p><strong>Methods & findings:</strong> <a href="https://dissei.ai/research">dissei.ai/research</a><br />
|
| 107 |
-
<strong>Contact:</strong> <a href="mailto:info@dissei.credit">info@dissei.credit</a> · <a href="https://dissei.ai/contact">Request research access</a></p>
|
| 108 |
-
</body></html>
|
|
|
|
| 1 |
<!doctype html><html lang="en"><head><meta charset="utf-8"><title>Dissei Data</title>
|
| 2 |
<meta http-equiv="refresh" content="0; url=https://dissei.ai/research"></head>
|
| 3 |
+
<body><p>Dissei Data — outcome-graded RL environments for institutional financial judgment.
|
| 4 |
+
Methods & findings: <a href="https://dissei.ai/research">dissei.ai/research</a></p></body></html>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|