foxmind-small / README.md
pooria's picture
Name the model foxmind; keep the GLiNER2 base model credit
bcd5cdc verified
|
Raw History Blame Contribute Delete
1.38 kB
metadata
license: apache-2.0
base_model: fastino/gliner2.5-small-v1
library_name: transformers.js
tags:
  - gliner2
  - foxpilot
  - onnx

foxmind-small

foxmind-small is the small on-device model for the foxpilot apps (PII Guard, Consent Shield and others). It is an ONNX export of GLiNER2.5 small.

Base model: fastino/gliner2.5-small-v1 (Apache-2.0, 74M parameters, English). It runs on-device in Firefox with ONNX Runtime Web.

The export keeps foxpilot's four inputs (input_ids, attention_mask, word_positions, schema_positions). It returns cls_logits [1, L] for classification and span_probs [1, L, C] with span_bounds [1, C, 2] for span extraction over the boundary candidate pool. reference.json holds the library's own results on 14 calls.

File Size Check against the library (14 calls)
onnx/model.onnx (fp32) 290 MB 14/14 decisions, worst probability gap 0.0000
onnx/model_fp16.onnx 147 MB 14/14, worst gap 0.0005
onnx/model_quantized.onnx (q8) 86 MB 13/14, worst gap 0.1515

Firefox 157, wasm q8, one thread: 32 ms at 10 tokens, 120 ms at 64 tokens, 230 ms at 128 tokens.

Export script: export/export_gliner25.py in pooriaarab/foxpilot (MIT). Base model by Fastino, Apache-2.0.