rdaum commited on
Commit
ad22086
·
verified ·
1 Parent(s): a221849

Remove Eider serving internals from model card

Browse files
Files changed (1) hide show
  1. README.md +3 -10
README.md CHANGED
@@ -39,7 +39,7 @@ Supply context, a question, and the allowed answers. The model scores those answ
39
  Use it for workflow routing, tool-call validation, evidence checks, rubric scoring, and action selection.
40
  Questions and answer meanings are supplied at request time, rather than fixed to a single classification task.
41
 
42
- The model was fine-tuned with PyTorch and evaluated using [Eider](https://github.com/rdaum/eider), a Rust/CUDA inference server optimized for DGX Spark.
43
  The GGUF also works with llama.cpp's native decision endpoint. Use the [Dory support PR](https://github.com/ggml-org/llama.cpp/pull/30306) branch or an upstream version that includes it once merged.
44
 
45
  ## Model and formats
@@ -92,13 +92,6 @@ The runtime enforces the answer type and option membership. The model supplies t
92
  This method supports the answer types above, rather than arbitrary JSON schemas.
93
  The exact prompt and label mapping matter; the GGUF includes the decision template.
94
 
95
- ### Eider serving
96
-
97
- Eider exposes `/v1/decisions` for a shared context and multiple typed questions.
98
- It processes the context once, then evaluates independent question branches in batches.
99
- Questions cannot attend to each other. Eider reuses cached context and reads only the vocabulary rows for answer labels.
100
- These optimizations reduce repeated work without requiring an Eider-specific classification head in the weights.
101
-
102
  ## Training data
103
 
104
  The following sources provide the decision questions and targets used for fine-tuning.
@@ -145,7 +138,7 @@ Within each comparison, base Dory and the fine-tune use the same quantization an
145
  The 512-question test set was scored after checkpoint selection on a separate 1,024-question validation set.
146
 
147
  Base Dory is the original NVIDIA BF16 model quantized with the same NVFP4 recipe used for this fine-tune.
148
- Both models use the same questions, typed-decision prompt, answer labels, two loops, and Eider executable.
149
  This comparison measures the effect of fine-tuning within this decision interface, rather than Dory’s performance with other prompting methods.
150
  [Comparison results and hashes](evaluation/base-comparison.json) record the matched setup.
151
 
@@ -159,7 +152,7 @@ This comparison measures the effect of fine-tuning within this decision interfac
159
  ### llama.cpp — Q8_0
160
 
161
  The native `/v1/systemone` endpoint scored both models with Q8_0 weights.
162
- All 512 prompt token sequences and answer-label mappings matched Eider for each model.
163
  This measures fine-tuning under llama.cpp; differences from the NVFP4 table can reflect both quantization and runtime arithmetic.
164
 
165
  | Test task | Questions | Base Dory accuracy | Typed Decisions accuracy | Base Brier ↓ | Typed Decisions Brier ↓ |
 
39
  Use it for workflow routing, tool-call validation, evidence checks, rubric scoring, and action selection.
40
  Questions and answer meanings are supplied at request time, rather than fixed to a single classification task.
41
 
42
+ The model was fine-tuned with PyTorch and evaluated using [Eider](https://github.com/rdaum/eider), optimized for DGX Spark.
43
  The GGUF also works with llama.cpp's native decision endpoint. Use the [Dory support PR](https://github.com/ggml-org/llama.cpp/pull/30306) branch or an upstream version that includes it once merged.
44
 
45
  ## Model and formats
 
92
  This method supports the answer types above, rather than arbitrary JSON schemas.
93
  The exact prompt and label mapping matter; the GGUF includes the decision template.
94
 
 
 
 
 
 
 
 
95
  ## Training data
96
 
97
  The following sources provide the decision questions and targets used for fine-tuning.
 
138
  The 512-question test set was scored after checkpoint selection on a separate 1,024-question validation set.
139
 
140
  Base Dory is the original NVIDIA BF16 model quantized with the same NVFP4 recipe used for this fine-tune.
141
+ Both models use the same questions, typed-decision prompt, answer labels, two loops, and inference settings.
142
  This comparison measures the effect of fine-tuning within this decision interface, rather than Dory’s performance with other prompting methods.
143
  [Comparison results and hashes](evaluation/base-comparison.json) record the matched setup.
144
 
 
152
  ### llama.cpp — Q8_0
153
 
154
  The native `/v1/systemone` endpoint scored both models with Q8_0 weights.
155
+ All 512 questions use identical prompt tokens and answer labels across both runtimes.
156
  This measures fine-tuning under llama.cpp; differences from the NVFP4 table can reflect both quantization and runtime arithmetic.
157
 
158
  | Test task | Questions | Base Dory accuracy | Typed Decisions accuracy | Base Brier ↓ | Typed Decisions Brier ↓ |