getprasannav commited on
Commit
89fb84d
·
verified ·
1 Parent(s): 5740b52

Correct API costs to current list prices (Sonnet 5.5 $2/$10, Haiku 5.5 $0.10/$0.50)

Browse files
Files changed (1) hide show
  1. README.md +10 -8
README.md CHANGED
@@ -53,7 +53,7 @@ Product accuracy sits near 82-85% for every model we tried, including much large
53
  own choice and some products overlap (credit reporting vs debt collection). The 82-class issue label is where
54
  training on the data pays off: +11 points over Claude Sonnet, +17 over Claude Haiku and +22 over a 501B model,
55
  all prompted without examples. Sonnet given the five most similar training complaints as examples is 1.6 points ahead
56
- on issue, at roughly 900 times the cost per complaint (below). On the first 200 test complaints only, Claude Opus 5.5
57
  prompted without examples reached 61.5% issue accuracy (this adapter: 51.5% on the same 200); not run on the full set.
58
 
59
  ## Cost per 1,000 complaints (USD)
@@ -61,17 +61,19 @@ prompted without examples reached 61.5% issue accuracy (this adapter: 51.5% on t
61
  | Model | Real-time | Batch |
62
  |---|---:|---:|
63
  | **This adapter, self-hosted on one NVIDIA A30** | **~$0.012** | **~$0.014** (10,000 per batch) to **~$0.034** (1,000 per batch) |
64
- | Claude Haiku 5.5, prompt only | ~$2.6 | ~$0.7 |
65
- | Claude Sonnet 5.5, prompt only | ~$5.6 | ~$0.9 |
66
- | Claude Sonnet 5.5, 5 examples | ~$10.5 | ~$3.4 |
67
 
68
  Estimates, not invoices. Self-hosted: one NVIDIA A30 in India at about $0.41/hour (list price ₹38.88, converted at
69
  USD 1 = ₹95), about 10 complaints/s, billed per minute;
70
  real-time assumes the GPU is busy (at low volume a dedicated GPU costs about $9.80/day whatever the traffic, so run in
71
- batches or share it across tasks); batch includes about 160 s of GPU start-up. API: list prices ($1/$5 and $3/$15 per
72
- million input/output tokens) on our measured tokens per complaint; batch applies the 50% batch discount and caches the
73
- shared instructions (the retrieved examples differ per complaint and are not cached). At bank volumes both are small in absolute terms; the adapter's case is fine-grained accuracy,
74
- data residency and control as much as cost.
 
 
75
 
76
  ## Use
77
 
 
53
  own choice and some products overlap (credit reporting vs debt collection). The 82-class issue label is where
54
  training on the data pays off: +11 points over Claude Sonnet, +17 over Claude Haiku and +22 over a 501B model,
55
  all prompted without examples. Sonnet given the five most similar training complaints as examples is 1.6 points ahead
56
+ on issue, at roughly 600 times the cost per complaint in real time (below). On the first 200 test complaints only, Claude Opus 5.5
57
  prompted without examples reached 61.5% issue accuracy (this adapter: 51.5% on the same 200); not run on the full set.
58
 
59
  ## Cost per 1,000 complaints (USD)
 
61
  | Model | Real-time | Batch |
62
  |---|---:|---:|
63
  | **This adapter, self-hosted on one NVIDIA A30** | **~$0.012** | **~$0.014** (10,000 per batch) to **~$0.034** (1,000 per batch) |
64
+ | Claude Haiku 5.5, prompt only | ~$0.26 | ~$0.07 |
65
+ | Claude Sonnet 5.5, prompt only | ~$3.75 | ~$0.73 |
66
+ | Claude Sonnet 5.5, 5 examples | ~$7.0 | ~$2.4 |
67
 
68
  Estimates, not invoices. Self-hosted: one NVIDIA A30 in India at about $0.41/hour (list price ₹38.88, converted at
69
  USD 1 = ₹95), about 10 complaints/s, billed per minute;
70
  real-time assumes the GPU is busy (at low volume a dedicated GPU costs about $9.80/day whatever the traffic, so run in
71
+ batches or share it across tasks); batch includes about 160 s of GPU start-up. API: list prices (Haiku 5.5 $0.10/$0.50,
72
+ Sonnet 5.5 $2/$10 per million input/output tokens, cached reads $0.20 for Sonnet) on our measured tokens per
73
+ complaint; real-time without caching; batch applies the 50% batch discount and caches the shared instructions (the
74
+ retrieved examples differ per complaint and are not cached). Corrected 22 Oct 2026: earlier figures used older models'
75
+ prices. At bank volumes all are small in absolute terms; a small API model such as Haiku is close on cost, so the
76
+ adapter's case is fine-grained accuracy, data residency and control as much as cost.
77
 
78
  ## Use
79