DavidSeyserHF commited on
Commit
8b403cf
·
verified ·
1 Parent(s): 97f08cb

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +16 -11
README.md CHANGED
@@ -6,9 +6,9 @@ tags: [vision, ripeness, tomato, jepa, preview]
6
  # plantjepa-preview
7
 
8
  Tomato ripeness from a single fruit crop. Give it a photo plus a bounding box,
9
- get back the ripeness stage with a calibrated confidence. Small JEPA encoder
10
- plus linear head — roughly 10x smaller than SigLIP2 at nearly the same
11
- class-averaged quality.
12
 
13
  ## Use in 30 seconds
14
 
@@ -63,18 +63,23 @@ review and spot-check the rest.
63
 
64
  ## How good is it?
65
 
66
- Held-out tomato rows 5 and 6 (5,556 crops):
67
 
68
- | Model | Accuracy | Macro-F1 |
69
  |---|---|---|
70
- | JEPA adapted (this release) | 88.01% | 79.46% |
71
- | SigLIP2 frozen reference (~10x larger) | 91.45% | 79.92% |
 
72
 
73
- Calibration cut expected calibration error from 4.04% to 1.86% on the same rows.
 
74
 
75
  ## Limitations
76
 
77
- - Only 2 independent greenhouse test rows: point estimates, no reliable 95%
78
- CI, no equivalence claim vs SigLIP2.
79
- - Trained on pseudo-labels; evaluated on hand-corrected labels.
 
 
 
80
  - Calibration fixes average confidence, not worst-case confident mistakes.
 
6
  # plantjepa-preview
7
 
8
  Tomato ripeness from a single fruit crop. Give it a photo plus a bounding box,
9
+ get back the ripeness stage with a confidence. Small JEPA encoder plus linear
10
+ head trained on pooled multi-farm boxes (BUTom-ST21, strawberry, Laboro-train)
11
+ — roughly 10x smaller than SigLIP2 with far better cross-farm generality.
12
 
13
  ## Use in 30 seconds
14
 
 
63
 
64
  ## How good is it?
65
 
66
+ Home rows 5–6 (5,556 crops) vs Laboro test, foreign farm (1,996 boxes):
67
 
68
+ | Model | Home acc / F1 | Away acc / F1 |
69
  |---|---|---|
70
+ | JEPA multi-source (this release) | 86.84% / 77.81% | 66.1% / 0.414 |
71
+ | JEPA single-farm previous | 88.01% / 79.46% | 48.9% / 0.351 |
72
+ | SigLIP2 frozen reference (~10x larger) | 91.45% / 79.92% | — |
73
 
74
+ Selective prediction travels even where absolute confidence does not: on
75
+ Laboro, accuracy rises 0.66 → 0.89 from full coverage to the 0.95 threshold.
76
 
77
  ## Limitations
78
 
79
+ - Home evidence is 2 independent greenhouse rows: point estimates, no
80
+ reliable 95% CI, no equivalence claim vs SigLIP2.
81
+ - BUTom train labels are pseudo-labels; all evaluations are hand-corrected.
82
+ - The temperature in `calibration.json` was fit at home and is valid there
83
+ only; abroad it hurts (away ECE 8.4 → 13.0). Re-fit thresholds — and
84
+ ideally the temperature — per deployment instead of trusting these values.
85
  - Calibration fixes average confidence, not worst-case confident mistakes.