Zero Proof AI commited on
Commit
b34c5c3
·
verified ·
1 Parent(s): 72425a5

Developed by Zero Proof Labs; brand spacing; remove payments tag

Browse files
Files changed (1) hide show
  1. README.md +4 -5
README.md CHANGED
@@ -7,7 +7,6 @@ library_name: peft
7
  pipeline_tag: text-classification
8
  tags:
9
  - intent-classification
10
- - payments
11
  - ecommerce
12
  - lora
13
  - qlora
@@ -28,7 +27,7 @@ On a hard, held-out benchmark it reaches **75.3% macro-averaged intent-type accu
28
 
29
  ### Model Description
30
 
31
- - **Developed by:** ZeroProof
32
  - **Model type:** E-commerce payment-intent classifier; structured JSON output over seven intent types
33
  - **Language:** English
34
  - **License:** Gemma (inherited from the base model)
@@ -86,7 +85,7 @@ The model returns one JSON object per message:
86
 
87
  ### Training Data
88
 
89
- The differentiator is the data. ZeroProof builds e-commerce intent training data as **randomized conversational simulations**: role-played customers with independently sampled personas, tones, financial situations, life stages, devices, and behaviors, including adversarial actors, simulated turn by turn between two independently drawn models. Generation is label-blind (the generating models never see the intent schema), labels are assigned in a separate pass, and every candidate passes a structural data gate: deduplicated by message signature, with zero train/eval leakage.
90
 
91
  This release was fine-tuned on **17,144 conversations**. The held-out evaluation set contains **1,977 conversations** and has no conversation or identifier overlap with the training split.
92
 
@@ -108,7 +107,7 @@ Held-out eval of 1,977 conversations, zero train/eval leakage, macro-averaged (e
108
 
109
  ### Results
110
 
111
- ![ZeroProof e-commerce intent evaluation: accuracy, per-action accuracy, and cost to serve](1b-v1.png)
112
 
113
  - Fine-tuning takes intent-type accuracy from **14.4% to 75.3%** on the public six-action rubric, macro-averaged across the 1,977-row held-out evaluation.
114
  - Intent detection reaches **80.7%**, and structured order-detail extraction reaches **66.3%**, both macro-averaged on the same public rubric.
@@ -127,4 +126,4 @@ Served as an OpenAI-compatible endpoint (base + adapter) under vLLM. Measured on
127
 
128
  ## Model Card Contact
129
 
130
- ZeroProof, https://huggingface.co/zero-proof-ai
 
7
  pipeline_tag: text-classification
8
  tags:
9
  - intent-classification
 
10
  - ecommerce
11
  - lora
12
  - qlora
 
27
 
28
  ### Model Description
29
 
30
+ - **Developed by:** Zero Proof Labs
31
  - **Model type:** E-commerce payment-intent classifier; structured JSON output over seven intent types
32
  - **Language:** English
33
  - **License:** Gemma (inherited from the base model)
 
85
 
86
  ### Training Data
87
 
88
+ The differentiator is the data. Zero Proof Labs builds e-commerce intent training data as **randomized conversational simulations**: role-played customers with independently sampled personas, tones, financial situations, life stages, devices, and behaviors, including adversarial actors, simulated turn by turn between two independently drawn models. Generation is label-blind (the generating models never see the intent schema), labels are assigned in a separate pass, and every candidate passes a structural data gate: deduplicated by message signature, with zero train/eval leakage.
89
 
90
  This release was fine-tuned on **17,144 conversations**. The held-out evaluation set contains **1,977 conversations** and has no conversation or identifier overlap with the training split.
91
 
 
107
 
108
  ### Results
109
 
110
+ ![Zero Proof e-commerce intent evaluation: accuracy, per-action accuracy, and cost to serve](1b-v1.png)
111
 
112
  - Fine-tuning takes intent-type accuracy from **14.4% to 75.3%** on the public six-action rubric, macro-averaged across the 1,977-row held-out evaluation.
113
  - Intent detection reaches **80.7%**, and structured order-detail extraction reaches **66.3%**, both macro-averaged on the same public rubric.
 
126
 
127
  ## Model Card Contact
128
 
129
+ Zero Proof Labs, https://huggingface.co/zero-proof-ai