Text Classification
PEFT
Safetensors
English
intent-classification
ecommerce
lora
qlora
function-calling
Instructions to use while-ai/ecommerce-0.5b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use while-ai/ecommerce-0.5b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/qwen2.5-0.5b-instruct-bnb-4bit") model = PeftModel.from_pretrained(base_model, "while-ai/ecommerce-0.5b") - Notebooks
- Google Colab
- Kaggle
Zero Proof AI commited on
scrub none mentions, add chart
Browse files
README.md
CHANGED
|
@@ -24,17 +24,13 @@ On a hard, held-out benchmark it reaches **60.4% exact-match core-intent accurac
|
|
| 24 |
|
| 25 |
## Benchmarks
|
| 26 |
|
| 27 |
-
|
| 28 |
|
| 29 |
-
|
| 30 |
-
|---|---|---|---|
|
| 31 |
-
| Intent detected | 26.9% | **67.2%** | 74.9% |
|
| 32 |
-
| **Correct core-intent** | 14.5% | **60.4%** | 70.0% |
|
| 33 |
-
| Details filled | 14.2% | **54.3%** | 44.3% |
|
| 34 |
|
| 35 |
-
- Fine-tuning takes core-intent accuracy from **14.5% to 60.4%**, about 4x the base,
|
| 36 |
-
- On structured detail extraction the 0.5B **
|
| 37 |
-
-
|
| 38 |
|
| 39 |
## Usage
|
| 40 |
|
|
@@ -53,11 +49,11 @@ The system prompt and detail schemas ship in the repo. Use greedy decoding (`tem
|
|
| 53 |
|
| 54 |
## Training and data
|
| 55 |
|
| 56 |
-
A 4-bit QLoRA fine-tune of `Qwen2.5-0.5B-Instruct`, one epoch, on a class-balanced training split
|
| 57 |
|
| 58 |
## Intended use
|
| 59 |
|
| 60 |
-
English-language e-commerce and payments support. Accuracy is strongest on
|
| 61 |
|
| 62 |
## License
|
| 63 |
|
|
|
|
| 24 |
|
| 25 |
## Benchmarks
|
| 26 |
|
| 27 |
+

|
| 28 |
|
| 29 |
+
Held-out eval of 1,977 conversations, zero train/eval leakage, macro-averaged, exact-match against gold. The frontier panel is scored on a 412-row balanced subset of the same eval.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
+
- Fine-tuning takes core-intent accuracy from **14.5% to 60.4%**, about 4x the base, at ~86% of our 1B and a fraction of frontier size.
|
| 32 |
+
- On structured detail extraction the 0.5B **beats GPT-5** (54.3% vs 41.4%) and edges the 1B.
|
| 33 |
+
- The smallest member of the family, built to run inline on live traffic at the lowest cost and latency.
|
| 34 |
|
| 35 |
## Usage
|
| 36 |
|
|
|
|
| 49 |
|
| 50 |
## Training and data
|
| 51 |
|
| 52 |
+
A 4-bit QLoRA fine-tune of `Qwen2.5-0.5B-Instruct`, one epoch, on a class-balanced training split. The differentiator is the data: ZeroProof builds e-commerce intent training data as randomized conversational simulations, role-played customers with independently sampled personas, situations, and behaviors including adversarial actors, distilled from frontier models under a locked labeling policy and passed through a structural data gate (zero train/eval leakage).
|
| 53 |
|
| 54 |
## Intended use
|
| 55 |
|
| 56 |
+
English-language e-commerce and payments support. Accuracy is strongest on refunds, bill-pay, and transfers; asset-exchange and subscriptions are the focus of the current data round.
|
| 57 |
|
| 58 |
## License
|
| 59 |
|