File size: 5,935 Bytes
61b5997
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
---
language:
- en
library_name: pytorch
tags:
- parkinsons
- proteomics
- tabular-regression
- ridge-regression
- autoencoder
- pca
- pls
- cross-validation
---
# CS4486 AMP-PD checkpoint collection

Existing fitted models from the CS4486 Parkinson's disease progression project.

- **Code:** https://github.com/feng-ruiyang/cs_ai_project
- **Checkpoints:** https://huggingface.co/fryabcfry/cs4486-amp-pd-checkpoints
- **Task:** predict UPDRS-1/2/3/4 at horizons 0/6/12/24 months.
- **Main inference inputs:** current visit month and current protein measurements. Visit IDs route requests; they are not predictive features.

## Results

SMAPE+1 is lower-is-better. The main comparisons use 248 patients, 1,068 clinical origins with proteins, and 12,578 observed labels.

| Model | Original split | Mean ± sample SD over split seeds 42/142/242 |
|---|---:|---:|
| Direct MLP baseline | 70.611 | Not run |
| Shared distribution MLP reference | 64.026 | 64.120 ± 0.166 |
| Selected AE + Ridge residual | 63.685 | 63.845 ± 0.181 |
| PCA + Ridge residual | 63.537 | 63.813 ± 0.517 |
| PLS + Ridge residual | 63.379 | 63.900 ± 0.496 |

PCA has the lowest three-split mean. Selected AE improves its same-split reference in all three splits and has the smallest variation among the protein methods. These are local CV results, not hidden Kaggle leaderboard scores.

## Contents

`checkpoints/` preserves the local experiment hierarchy:

| Directory | Contents |
|---|---|
| `retained/baseline_mlp/` | Five original CV folds and an all-patient model; preprocessing + direct regression MLP |
| `retained/pls/` | Five original CV folds; shared reference ensemble + PLS/Ridge parameters |
| `retained/selected_ae/` | Five original CV folds and an all-patient model; AE + reference ensemble + selected residual heads |
| `improvement_ablation_2026-11-16_v2/` | Rebuilt PCA and fixed-parameter ablation heads; loads neural dependencies from `retained/` |
| `three_split_seeds_2026-11-17/` | Five refitted model bundles for each of the three split seeds |
| `original_configs_2026-11-10/` | Earlier regression/distribution MLP checkpoints and preprocessing |
| `top_methods_2026-11-10/` | History-enabled adaptations of leading solution ideas |
| `isolated_inference_2026-11-10/` | Earlier frozen and retrained inference-boundary models |
| `top_nohistory_2026-11-10/` | Current-visit adapters with frozen and retrained models |
| `leakage_2026-11-10/` | Saved preprocessing from early controls; Ridge coefficients were not exported in that run |

History-enabled and `INVALID_*` diagnostic artifacts retain their original names. They are supplementary records, not main zero-history results. Old weights previously deleted locally are not recreated in this release.

`checkpoint_manifest.json` and `.csv` list every published parameter file, source-relative path, SHA-256 and any packaging transformation. Preprocessing arrays retain fitted statistics but omit dataset row-index arrays. Evaluation-probability dumps, raw clinical/protein/peptide data, participant-level OOF files and split membership tables are not included.

`code/ampd/` contains the inference source snapshot needed to load the current packages, including modules that may not yet be present in the linked GitHub revision. `load_models.py` provides portable convenience loaders. Ablation references are relative to the downloaded checkpoint root. Legacy pickle preprocessors require the matching Python package environment; current main model loaders use numeric arrays and PyTorch state dictionaries.

## Load a current model

Install `requirements.txt` and `huggingface_hub` in a separate environment, then:

```python
import sys
from huggingface_hub import snapshot_download

snapshot = snapshot_download('fryabcfry/cs4486-amp-pd-checkpoints')
sys.path.insert(0, snapshot)
from load_models import load_model

model = load_model('pls', fold=0, root=snapshot)
# Replace protein_vector with current measurements in model.spec['proteins'] order.
events = [{'visit_id': 'current_sample', 'visit_month': 12,
           'proteins': protein_vector}]
prediction = model.predict(events)['pls']   # N x 16
```

Outputs are ordered by UPDRS component, with horizons 0, 6, 12, 24 inside each component. Missing protein values can be `None` or `NaN`.

| Loader name | Output key | Final all-patient model |
|---|---|---|
| `baseline_mlp` | `month_protein` | `fold='final'` |
| `selected_ae` | `selected_latent_r` | `fold='final'` |
| `pls` | `pls` | CV folds only |
| `pca` | `pca_full` | CV folds only |
| `ablations` | `ae_full`, `pca_full`, `pls_full`, and ablation names | CV folds only |

For repeated-split models:

```python
model = load_model('selected_ae', split_seed=142, fold=0, root=snapshot)
outputs = model.predict(events)
# outputs: reference, selected_ae, pca, pls
```

The split-seed loader returns all three residual predictions around the same reference. Full-data models have no separate test score; the reported metrics come from held-out CV folds. The original data must be obtained from the [Kaggle competition](https://www.kaggle.com/competitions/amp-parkinsons-disease-progression-prediction) to retrain the models.

## Related work

The report cites **SubspaceAD: Training-Free Few-Shot Anomaly Detection via Subspace Modeling** (Lendering, Akdag and Bondarev, CVPR 2026, pp. 28557–28566) as a related frozen-feature/subspace design. SubspaceAD uses a frozen DINOv2 image encoder, PCA and reconstruction residuals. Our selected AE is trained on training-patient proteins, frozen for latent screening, and followed by supervised Ridge prediction of UPDRS residuals. This collection does not contain DINOv2 or SubspaceAD pretrained weights.

Paper/project: https://clendering.github.io/SubspaceAD/

## Scope

This is a course research artifact for comparing input availability and protein representations. It is not a clinically validated prediction system.