tnh0527's picture
Publish gliclass-std-base-v3-daecore-5facet-qint8-v2 (qualified ONNX export and complete attribution)
4289dff verified
|
Raw History Blame Contribute Delete
1.77 kB
# Modifications from the upstream model
`gliclass-std-base-v3-daecore-5facet-qint8-v2` is not an unmodified copy of
`knowledgator/gliclass-base-v3.0`. It is not endorsed by Knowledgator or by
Microsoft, whose `deberta-v3-base` backbone the upstream model builds on.
What changed:
- **Fine-tune.** The upstream GLiClass single-pass classifier was trained
further on 59,886 labeled passages for five fixed facets (`trap`,
`decision`, `constraint`, `mechanism`, `procedure`) with the five label
prompts recorded in `classifier-metadata.json`. Labels were frontier-model
judgments under a frozen protocol, not human annotations.
- **Export.** The fine-tuned weights were exported to ONNX (opset 17) as a
single graph taking `input_ids` and `attention_mask` and emitting five
logits.
- **Quantization.** Only the token-embedding `Gather` tables were quantized
to signed INT8 (per-channel off, reduce-range off); every matrix product
stays FP32. Twenty-four constant identity nodes were folded. The compression
was qualified as equivalent to the FP32 export on a 5,298-row panel.
- **Calibration.** Per-facet temperature scaling and two frozen threshold
tables (`recall_leaning`, `contract`) travel in `classifier-metadata.json`
and are part of the artifact's identity.
- **Vulkan graph preparation.** Bounded integer/boolean mask calculations
use exact FP32 equivalents before their original output types are restored.
Learned parameters, tokenizers, label prompts, calibration and thresholds
are unchanged. `vulkan-derivation.json` binds the source and derived graph;
`classifier-metadata.json` records the new graph's byte identity.
Unchanged: the tokenizer vocabulary and the `<<LABEL>>` / `<<SEP>>` prompt
convention of the upstream model.