diff --git "a/validation_report.html" "b/validation_report.html" --- "a/validation_report.html" +++ "b/validation_report.html" @@ -37,23 +37,23 @@

Model Export Validation Report

-

Generated: 2026-04-09 11:20:33 | Test images: 814 | 8 classes | Formats: Keras, TFLite, TFLite-fp16

+

Generated: 2026-04-10 15:58:06 | Test images: 964 | 9 classes | Formats: Keras, TFLite, TFLite-fp16

1. Overall Comparison

-
Accuracy
+
Accuracy

2. Per-class F1 Comparison

-
F1
+
F1

3. Prediction Agreement

-
Agreement
-
Speed
+
Agreement
+
Speed
@@ -63,17 +63,17 @@

Keras

- File: exports/BestModelEfficientNetLite.keras | Size: 16.4 MB | - Accuracy: 0.8931 | - F1(W): 0.8931 | - Speed: 19.8s (41.0 img/s) + File: BestModelEfficientNetLite.keras | Size: 5.3 MB | + Accuracy: 0.8558 | + F1(W): 0.8564 | + Speed: 5.4s (179.7 img/s)
-
CM
+
CM
- +
ClassPrecisionRecallF1Support
Baked Potato0.88170.82000.8497100
Burger0.89320.86790.8804106
Crispy Chicken0.83620.92380.8778105
Donut0.98590.88610.9333158
Fries0.88180.93270.9065104
Hot Dog0.87040.94000.9038100
Pizza0.88510.93900.911282
Sandwich0.87270.81360.842159
Baked Potato0.84950.79000.8187100
Burger0.89770.74530.8144106
Crispy Chicken0.79170.90480.8444105
Donut0.82680.93670.8783158
Fries0.92940.75960.8360104
Hot Dog0.93180.82000.8723100
Other0.94810.97330.9605150
Pizza0.89040.79270.838782
Sandwich0.61900.88140.727359
@@ -81,17 +81,17 @@

TFLite

- File: exports/tflite/model.tflite | Size: 4.4 MB | - Accuracy: 0.8784 | - F1(W): 0.8786 | - Speed: 33.4s (24.4 img/s) + File: exports/tflite/model.tflite | Size: 0.5 MB | + Accuracy: 0.8475 | + F1(W): 0.8477 | + Speed: 3.7s (257.1 img/s)
-
CM
+
CM
- +
ClassPrecisionRecallF1Support
Baked Potato0.82000.82000.8200100
Burger0.89320.86790.8804106
Crispy Chicken0.84550.88570.8651105
Donut0.98560.86710.9226158
Fries0.84350.93270.8858104
Hot Dog0.85050.91000.8792100
Pizza0.88510.93900.911282
Sandwich0.86790.77970.821459
Baked Potato0.89410.76000.8216100
Burger0.89660.73580.8083106
Crispy Chicken0.74220.90480.8155105
Donut0.80540.94300.8688158
Fries0.91860.75960.8316104
Hot Dog0.92940.79000.8541100
Other0.94740.96000.9536150
Pizza0.83130.84150.836482
Sandwich0.65750.81360.727359
@@ -99,17 +99,17 @@

TFLite-fp16

- File: exports/tflite/model_float16.tflite | Size: 7.8 MB | - Accuracy: 0.8919 | - F1(W): 0.8919 | - Speed: 57.8s (14.1 img/s) + File: exports/tflite/model_float16.tflite | Size: 0.8 MB | + Accuracy: 0.8537 | + F1(W): 0.8543 | + Speed: 2.7s (355.9 img/s)
-
CM
+
CM
- +
ClassPrecisionRecallF1Support
Baked Potato0.88170.82000.8497100
Burger0.89320.86790.8804106
Crispy Chicken0.83480.91430.8727105
Donut0.98590.88610.9333158
Fries0.87390.93270.9023104
Hot Dog0.87040.94000.9038100
Pizza0.88510.93900.911282
Sandwich0.87270.81360.842159
Baked Potato0.84780.78000.8125100
Burger0.89770.74530.8144106
Crispy Chicken0.78510.90480.8407105
Donut0.83050.93040.8776158
Fries0.92940.75960.8360104
Hot Dog0.93180.82000.8723100
Other0.93590.97330.9542150
Pizza0.89040.79270.838782
Sandwich0.61900.88140.727359
@@ -125,43 +125,43 @@ Keras - 16.4 MB - 0.8931 - 0.8959 - 0.8931 - 0.8931 - 0.8881 - 19.8s - 41.0 + 5.3 MB + 0.8558 + 0.8667 + 0.8558 + 0.8564 + 0.8434 + 5.4s + 179.7 TFLite - 4.4 MB - 0.8784 - 0.8817 - 0.8784 - 0.8786 - 0.8732 - 33.4s - 24.4 + 0.5 MB + 0.8475 + 0.8581 + 0.8475 + 0.8477 + 0.8352 + 3.7s + 257.1 TFLite-fp16 - 7.8 MB - 0.8919 - 0.8947 - 0.8919 - 0.8919 - 0.8870 - 57.8s - 14.1 + 0.8 MB + 0.8537 + 0.8645 + 0.8537 + 0.8543 + 0.8415 + 2.7s + 355.9
-

6. Disagreement Examples (Keras vs TFLite)

Image #True LabelKeras PredTFLite Pred
191BurgerCrispy ChickenBurger
196BurgerCrispy ChickenBaked Potato
205BurgerBurgerHot Dog
234Crispy ChickenSandwichBaked Potato
286Crispy ChickenCrispy ChickenFries
302Crispy ChickenCrispy ChickenBaked Potato
303Crispy ChickenCrispy ChickenPizza
304Crispy ChickenCrispy ChickenBaked Potato
320DonutDonutCrispy Chicken
357DonutPizzaFries
410DonutHot DogDonut
416DonutDonutFries
423DonutDonutBaked Potato
437DonutDonutHot Dog
537FriesCrispy ChickenFries
548FriesFriesCrispy Chicken
599Hot DogHot DogBaked Potato
619Hot DogHot DogSandwich
654Hot DogHot DogFries
706PizzaCrispy ChickenFries
286Crispy ChickenCrispy ChickenFries
+

6. Disagreement Examples (Keras vs TFLite)

Image #True LabelKeras PredTFLite Pred
25Baked PotatoBaked PotatoPizza
27Baked PotatoBaked PotatoPizza
40Baked PotatoBaked PotatoCrispy Chicken
47Baked PotatoSandwichBaked Potato
53Baked PotatoSandwichDonut
74Baked PotatoPizzaCrispy Chicken
82Baked PotatoSandwichCrispy Chicken
97Baked PotatoBaked PotatoDonut
161BurgerSandwichBurger
163BurgerBurgerSandwich
172BurgerBurgerDonut
178BurgerBaked PotatoDonut
185BurgerSandwichHot Dog
194BurgerBaked PotatoCrispy Chicken
196BurgerBaked PotatoDonut
305Crispy ChickenSandwichBaked Potato
399DonutBaked PotatoDonut
579Hot DogSandwichBaked Potato
601Hot DogHot DogCrispy Chicken
602Hot DogHot DogDonut
40Baked PotatoBaked PotatoCrispy Chicken
438DonutDonutOther
500FriesDonutOther
Whispr Moderation Service — Model Export Validation
- All formats tested on the same 814 test images + All formats tested on the same 964 test images