Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -6,9 +6,9 @@ tags: [vision, ripeness, tomato, jepa, preview]
|
|
| 6 |
# plantjepa-preview
|
| 7 |
|
| 8 |
Tomato ripeness from a single fruit crop. Give it a photo plus a bounding box,
|
| 9 |
-
get back the ripeness stage with a
|
| 10 |
-
|
| 11 |
-
|
| 12 |
|
| 13 |
## Use in 30 seconds
|
| 14 |
|
|
@@ -63,18 +63,23 @@ review and spot-check the rest.
|
|
| 63 |
|
| 64 |
## How good is it?
|
| 65 |
|
| 66 |
-
|
| 67 |
|
| 68 |
-
| Model |
|
| 69 |
|---|---|---|
|
| 70 |
-
| JEPA
|
| 71 |
-
|
|
|
|
|
| 72 |
|
| 73 |
-
|
|
|
|
| 74 |
|
| 75 |
## Limitations
|
| 76 |
|
| 77 |
-
-
|
| 78 |
-
CI, no equivalence claim vs SigLIP2.
|
| 79 |
-
-
|
|
|
|
|
|
|
|
|
|
| 80 |
- Calibration fixes average confidence, not worst-case confident mistakes.
|
|
|
|
| 6 |
# plantjepa-preview
|
| 7 |
|
| 8 |
Tomato ripeness from a single fruit crop. Give it a photo plus a bounding box,
|
| 9 |
+
get back the ripeness stage with a confidence. Small JEPA encoder plus linear
|
| 10 |
+
head trained on pooled multi-farm boxes (BUTom-ST21, strawberry, Laboro-train)
|
| 11 |
+
— roughly 10x smaller than SigLIP2 with far better cross-farm generality.
|
| 12 |
|
| 13 |
## Use in 30 seconds
|
| 14 |
|
|
|
|
| 63 |
|
| 64 |
## How good is it?
|
| 65 |
|
| 66 |
+
Home rows 5–6 (5,556 crops) vs Laboro test, foreign farm (1,996 boxes):
|
| 67 |
|
| 68 |
+
| Model | Home acc / F1 | Away acc / F1 |
|
| 69 |
|---|---|---|
|
| 70 |
+
| JEPA multi-source (this release) | 86.84% / 77.81% | 66.1% / 0.414 |
|
| 71 |
+
| JEPA single-farm previous | 88.01% / 79.46% | 48.9% / 0.351 |
|
| 72 |
+
| SigLIP2 frozen reference (~10x larger) | 91.45% / 79.92% | — |
|
| 73 |
|
| 74 |
+
Selective prediction travels even where absolute confidence does not: on
|
| 75 |
+
Laboro, accuracy rises 0.66 → 0.89 from full coverage to the 0.95 threshold.
|
| 76 |
|
| 77 |
## Limitations
|
| 78 |
|
| 79 |
+
- Home evidence is 2 independent greenhouse rows: point estimates, no
|
| 80 |
+
reliable 95% CI, no equivalence claim vs SigLIP2.
|
| 81 |
+
- BUTom train labels are pseudo-labels; all evaluations are hand-corrected.
|
| 82 |
+
- The temperature in `calibration.json` was fit at home and is valid there
|
| 83 |
+
only; abroad it hurts (away ECE 8.4 → 13.0). Re-fit thresholds — and
|
| 84 |
+
ideally the temperature — per deployment instead of trusting these values.
|
| 85 |
- Calibration fixes average confidence, not worst-case confident mistakes.
|