Model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,40 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc-by-4.0
|
| 3 |
+
tags:
|
| 4 |
+
- electron-microscopy
|
| 5 |
+
- stem
|
| 6 |
+
- denoising
|
| 7 |
+
- flow-matching
|
| 8 |
+
library_name: pytorch
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# cimp-denoise weights
|
| 12 |
+
|
| 13 |
+
Weights for the `denoise` command from the `cimp-denoise` package (code: CIMP-flow). It denoises STEM images by
|
| 14 |
+
rendering a frame as it would look after a longer exposure. The model is a conditional flow-matching U-Net (x2x),
|
| 15 |
+
steered by CMMP, a frozen encoder that describes an acquisition from its metadata or from the image itself.
|
| 16 |
+
|
| 17 |
+
| file | what it is | trained from |
|
| 18 |
+
|---|---|---|
|
| 19 |
+
| `cmmp.pt` | frozen CMMP encoder pair (image + 7-number acquisition metadata) | CMMP |
|
| 20 |
+
| `x2x.pt` | flow denoiser, metadata mode | `x2x_v2_local` ep500 |
|
| 21 |
+
| `x2x_cmmp.pt` | flow denoiser, CMMP mode (also trained with CMMP image embeddings as sources) | `x2x_v3_imgsrc` ep100 |
|
| 22 |
+
| `supervised.pt` | supervised denoiser; supplies the "clean look" target in CMMP mode | `sup_v1` ep100 |
|
| 23 |
+
|
| 24 |
+
## Use
|
| 25 |
+
|
| 26 |
+
```
|
| 27 |
+
pip install cimp-denoise # or: pip install -e <CIMP-flow checkout>
|
| 28 |
+
denoise frame.emd # downloads these files to ~/.cache/cimp-denoise on first use
|
| 29 |
+
```
|
| 30 |
+
|
| 31 |
+
While this repository is private, set `HF_TOKEN` to a token with read access before the first run.
|
| 32 |
+
|
| 33 |
+
Defaults: 8 draws × 4 sampler steps, about 5 s per 512 × 512 px and 90 s per 2048 × 2048 px on a desktop GPU.
|
| 34 |
+
Metadata mode (Velox .emd) is told min(recorded dwell, 1 µs) → 16× that. CMMP mode needs only the image.
|
| 35 |
+
|
| 36 |
+
## Limitations
|
| 37 |
+
|
| 38 |
+
- Trained on HAADF data from one microscope. BF and DF channels are processed, but the models were not trained on them.
|
| 39 |
+
- Very faint lattice fringes near the noise level can be smoothed away.
|
| 40 |
+
- Images must be at least 128 px per side.
|