Text Classification
PEFT
Safetensors
English
intent-classification
ecommerce
lora
qlora
function-calling
Instructions to use while-ai/ecommerce-0.5b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use while-ai/ecommerce-0.5b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/qwen2.5-0.5b-instruct-bnb-4bit") model = PeftModel.from_pretrained(base_model, "while-ai/ecommerce-0.5b") - Notebooks
- Google Colab
- Kaggle
Rebrand to While AI
Browse files
README.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
base_model: Qwen/Qwen2.5-0.5B-Instruct
|
| 4 |
datasets:
|
| 5 |
-
-
|
| 6 |
library_name: peft
|
| 7 |
pipeline_tag: text-classification
|
| 8 |
tags:
|
|
@@ -15,9 +15,9 @@ language:
|
|
| 15 |
- en
|
| 16 |
---
|
| 17 |
|
| 18 |
-
# Model Card for
|
| 19 |
|
| 20 |
-
**E-commerce intent detection in a 0.5B model, the smallest member of the
|
| 21 |
|
| 22 |
On a hard, held-out benchmark it reaches **70.3 macro-averaged intent-type accuracy, roughly 91% of our 1B**, from a base model that scores 10.7.
|
| 23 |
|
|
@@ -25,7 +25,7 @@ On a hard, held-out benchmark it reaches **70.3 macro-averaged intent-type accur
|
|
| 25 |
|
| 26 |
### Model Description
|
| 27 |
|
| 28 |
-
- **Developed by:**
|
| 29 |
- **Model type:** E-commerce payment-intent classifier; structured JSON output over seven intent types
|
| 30 |
- **Language:** English
|
| 31 |
- **License:** Apache-2.0 (inherited from the base model)
|
|
@@ -33,8 +33,8 @@ On a hard, held-out benchmark it reaches **70.3 macro-averaged intent-type accur
|
|
| 33 |
|
| 34 |
### Model Sources
|
| 35 |
|
| 36 |
-
- **Repository:** https://huggingface.co/
|
| 37 |
-
- **Training data:** https://huggingface.co/datasets/
|
| 38 |
|
| 39 |
## Uses
|
| 40 |
|
|
@@ -60,8 +60,8 @@ Pair the model with a verification layer before any payment executes, and re-ben
|
|
| 60 |
from peft import AutoPeftModelForCausalLM
|
| 61 |
from transformers import AutoTokenizer
|
| 62 |
|
| 63 |
-
model = AutoPeftModelForCausalLM.from_pretrained("
|
| 64 |
-
tok = AutoTokenizer.from_pretrained("
|
| 65 |
```
|
| 66 |
|
| 67 |
Use greedy decoding (`temperature=0`). The system prompt and per-intent detail schemas ship in the repo.
|
|
@@ -70,7 +70,7 @@ Use greedy decoding (`temperature=0`). The system prompt and per-intent detail s
|
|
| 70 |
|
| 71 |
### Training Data
|
| 72 |
|
| 73 |
-
The differentiator is the data.
|
| 74 |
|
| 75 |
### Training Procedure
|
| 76 |
|
|
@@ -88,7 +88,7 @@ Held-out eval of 1,977 conversations, zero train/eval leakage, macro-averaged, s
|
|
| 88 |
|
| 89 |
### Results
|
| 90 |
|
| 91 |
-

|
| 92 |
|
| 93 |
- Fine-tuning takes intent-type accuracy from **10.7 to 70.3** (macro), more than 6x the base, at ~91% of our 1B and a fraction of frontier size.
|
| 94 |
- On structured detail extraction the 0.5B **beats every frontier panel member**: 58.5 against Sonnet 5's 55.7, Opus 4.8's 53.2, and GPT-5's 41.4. The 1B leads the family at 64.0.
|
|
|
|
| 102 |
|
| 103 |
## Model Card Contact
|
| 104 |
|
| 105 |
+
While AI, https://huggingface.co/while-ai
|