ZoneTwelve commited on
Commit
c92bcbb
·
verified ·
1 Parent(s): 589117a

Sync updated model card and all charts

Browse files
Files changed (4) hide show
  1. README.md +21 -11
  2. accuracy_chart.svg +10 -10
  3. network_size_chart.svg +65 -53
  4. training_loss_curves.svg +24 -15
README.md CHANGED
@@ -11,9 +11,9 @@ This repository contains checkpoints from the MPS-trained CIFAR-10 model
11
  comparison suite. Each `.pt` file preserves model weights, optimizer state,
12
  epoch history, architecture metadata, and validation-selection metadata.
13
 
14
- > **Fairness note:** DenseCNN was trained for 200 epochs; the other headline
15
- > models were trained for 30 epochs. DenseCNN's 92.53% is not a matched-budget
16
- > comparison. The best completed 30-epoch result is CNN-C + BN at 84.27%.
17
 
18
  ![CIFAR-10 test accuracy](accuracy_chart.svg)
19
 
@@ -42,13 +42,22 @@ inputs, batch size 128, 10 warmup iterations, and 50 measured iterations.
42
  | Model | Run epochs | Selected epoch | Best validation | Test accuracy |
43
  |---|---:|---:|---:|---:|
44
  | DenseCNN | 200* | **192** | 93.30% | **92.53%** |
45
- | CNN-C + BN | 30 | **27** | 86.24% | 84.27% |
46
- | CNN-C + LN | 30 | **30** | 84.00% | 82.74% |
 
 
 
 
 
 
47
  | R-CNN-B + BN | 30 | **29** | 82.40% | 81.22% |
48
- | MobileNet-A + BN | 30 | **29** | 62.24% | 62.68% |
49
- | MobileNet-A | 30 | **27** | 53.74% | 53.35% |
50
- | CNN-B + BN | 30 | **29** | 83.02% | 81.55% |
51
- | ViT | 30 | **28** | 70.66% | 69.08% |
 
 
 
52
 
53
  The full per-variant report is available in `reports/` in the source repository.
54
 
@@ -56,13 +65,14 @@ The full per-variant report is available in `reports/` in the source repository.
56
  checkpoint state is used for the reported test accuracy. **Run epochs** is the
57
  total training budget.
58
 
59
- `*` DenseCNN used a longer training budget; rerun all models for 200 epochs for
60
- a fair comparison.
61
 
62
  | Checkpoint family | Notes |
63
  |---|---|
64
  | `cnn_A/B/C_{def,bn,ln}.pt` | CNN capacity and normalization variants |
65
  | `rcnn_B_bn.pt` | recurrent convolutional classifier |
 
66
  | `vit.pt` | Vision Transformer |
67
  | `densecnn.pt` | DenseNet-inspired CNN; 92.53% test accuracy |
68
  | `dynamic_cnn.pt` | Dynamic capacity CNN |
 
11
  comparison suite. Each `.pt` file preserves model weights, optimizer state,
12
  epoch history, architecture metadata, and validation-selection metadata.
13
 
14
+ > **Fairness note:** DenseCNN, CNN A/B/C, ViT, and MobileNet-A now have
15
+ > 200-epoch results. R-CNN-B and MobileNet-B remain 30-epoch runs. Equal epoch
16
+ > count does not imply identical optimization recipes or compute.
17
 
18
  ![CIFAR-10 test accuracy](accuracy_chart.svg)
19
 
 
42
  | Model | Run epochs | Selected epoch | Best validation | Test accuracy |
43
  |---|---:|---:|---:|---:|
44
  | DenseCNN | 200* | **192** | 93.30% | **92.53%** |
45
+ | CNN-C + BN | 200 | **176** | 89.70% | 88.48% |
46
+ | CNN-C + LN | 200 | **123** | 88.90% | 87.73% |
47
+ | CNN-C | 200 | **123** | 88.02% | 86.37% |
48
+ | CNN-B + BN | 200 | **199** | 87.48% | 86.10% |
49
+ | CNN-B + LN | 200 | **140** | 87.10% | 85.32% |
50
+ | CNN-B | 200 | **148** | 86.36% | 84.43% |
51
+ | CNN-A + LN | 200 | **185** | 82.04% | 81.51% |
52
+ | CNN-A + BN | 200 | **179** | 82.18% | 81.23% |
53
  | R-CNN-B + BN | 30 | **29** | 82.40% | 81.22% |
54
+ | CNN-A | 200 | **167** | 81.80% | 80.33% |
55
+ | ViT | 200 | **182** | 80.02% | 79.31% |
56
+ | MobileNet-A + BN | 200 | **198** | 70.20% | 68.78% |
57
+ | MobileNet-B + BN | 30 | **29** | 66.22% | 66.28% |
58
+ | MobileNet-A | 200 | **199** | 66.76% | 65.64% |
59
+ | MobileNet-A + LN | 200 | **196** | 63.86% | 63.99% |
60
+ | MobileNet-B | 30 | **30** | 56.92% | 57.02% |
61
 
62
  The full per-variant report is available in `reports/` in the source repository.
63
 
 
65
  checkpoint state is used for the reported test accuracy. **Run epochs** is the
66
  total training budget.
67
 
68
+ `*` DenseCNN uses a different optimization recipe from the baseline models;
69
+ matched epoch count is not identical compute.
70
 
71
  | Checkpoint family | Notes |
72
  |---|---|
73
  | `cnn_A/B/C_{def,bn,ln}.pt` | CNN capacity and normalization variants |
74
  | `rcnn_B_bn.pt` | recurrent convolutional classifier |
75
+ | `mobilenet_A/B_{def,bn,ln}.pt` | depthwise-separable MobileNet variants |
76
  | `vit.pt` | Vision Transformer |
77
  | `densecnn.pt` | DenseNet-inspired CNN; 92.53% test accuracy |
78
  | `dynamic_cnn.pt` | Dynamic capacity CNN |
accuracy_chart.svg CHANGED
network_size_chart.svg CHANGED
training_loss_curves.svg CHANGED