benke97 commited on
Commit
cfdbf45
·
verified ·
1 Parent(s): 5c5fd10

Model card

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ tags:
4
+ - electron-microscopy
5
+ - stem
6
+ - denoising
7
+ - flow-matching
8
+ library_name: pytorch
9
+ ---
10
+
11
+ # cimp-denoise weights
12
+
13
+ Weights for the `denoise` command from the `cimp-denoise` package (code: CIMP-flow). It denoises STEM images by
14
+ rendering a frame as it would look after a longer exposure. The model is a conditional flow-matching U-Net (x2x),
15
+ steered by CMMP, a frozen encoder that describes an acquisition from its metadata or from the image itself.
16
+
17
+ | file | what it is | trained from |
18
+ |---|---|---|
19
+ | `cmmp.pt` | frozen CMMP encoder pair (image + 7-number acquisition metadata) | CMMP |
20
+ | `x2x.pt` | flow denoiser, metadata mode | `x2x_v2_local` ep500 |
21
+ | `x2x_cmmp.pt` | flow denoiser, CMMP mode (also trained with CMMP image embeddings as sources) | `x2x_v3_imgsrc` ep100 |
22
+ | `supervised.pt` | supervised denoiser; supplies the "clean look" target in CMMP mode | `sup_v1` ep100 |
23
+
24
+ ## Use
25
+
26
+ ```
27
+ pip install cimp-denoise # or: pip install -e <CIMP-flow checkout>
28
+ denoise frame.emd # downloads these files to ~/.cache/cimp-denoise on first use
29
+ ```
30
+
31
+ While this repository is private, set `HF_TOKEN` to a token with read access before the first run.
32
+
33
+ Defaults: 8 draws × 4 sampler steps, about 5 s per 512 × 512 px and 90 s per 2048 × 2048 px on a desktop GPU.
34
+ Metadata mode (Velox .emd) is told min(recorded dwell, 1 µs) → 16× that. CMMP mode needs only the image.
35
+
36
+ ## Limitations
37
+
38
+ - Trained on HAADF data from one microscope. BF and DF channels are processed, but the models were not trained on them.
39
+ - Very faint lattice fringes near the noise level can be smoothed away.
40
+ - Images must be at least 128 px per side.