File size: 4,326 Bytes
93d9980 8ea8172 93d9980 8ea8172 93d9980 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 | ---
tags:
- seismic
- multiples
- denoising
- unet
- resunet
- dncnn
- attention-unet
- pytorch
library_name: pytorch
---
# Marine Multiples Attenuation Benchmark
Deep-learning-based free-surface multiple attenuation on marine pre-stack seismic shot gathers.
## Task
Given a shot gather containing primaries and free-surface multiples, the model predicts the additive multiple component. The attenuated primary estimate is obtained by:
```
denoised = noisy_input - predicted_noise
```
This is a **paired regression** task trained with a noise-label objective. The supervision target is the multiple wavefield stored in the paired noise-label volume.
## Dataset
- **Input volume**: `/data/shared/benchmark/multiples/noisy/total_nodw.sgy`
- **Multiple-label volume**: `/data/shared/benchmark/multiples/noise/multiples.sgy`
- **Geometry**: regular shot gathers with 638 traces per shot
- **Split**: shot-level sequential split from the training configs, typically 510 train shots, 64 validation shots, and 64 held-out test shots
The uploaded checkpoints are trained on the fixed paired marine multiples benchmark used by `scripts/multiples_attenuation`.
Metrics are computed on the held-out test shots in the normalized domain. If a batch-evaluation workbook is supplied, its values are embedded below.
## Model Architectures
- **DNNDAT** (`dnndat`) — DNNDAT-style convolutional encoder-decoder for marine multiple suppression (Wang et al., 2022). U-Net-like encoder-decoder with 28 convolutional layers and dropout.
- **SAGAN** (`sagan`) — Self-attention GAN generator for seismic surface-related multiple suppression (Tao et al., 2022). U-Net generator with a bottleneck self-attention block.
## Uploaded Checkpoints
- DNNDAT: 4 checkpoints
- SAGAN: 3 checkpoints
### Preprocessing
- **Normalization**: `max_abs`, global scope — the entire dataset scaled to [-1, 1]
- **Patching**: overlapping 2D patches, usually 256 traces × 512 time samples with 50% overlap
- **Tensor format**: PyTorch NCHW patches `(batch, 1, trace, time)`
## Repository Structure
```
models/
├── unet/
│ ├── seed42/
│ │ ├── best.pt # Best checkpoint (minimum validation loss)
│ │ └── config.yaml # Full training configuration
│ ├── seed43/
│ ├── seed44/
│ └── ...
└── res_unet/
└── ...
```
Each subdirectory corresponds to one experiment: a model architecture trained with a specific random seed.
## Training Details
| Hyperparameter | Value |
|----------------|-------|
| Loss | MSE on the predicted multiple/noise component |
| Optimizer | Adam / AdamW / SGD, depending on model config |
| Scheduler | Cosine annealing (min_lr=1e-6) |
| Epochs | 100-200, depending on model config |
| Gradient clipping | 1.0 (max norm) |
| Seeds | 42, 43, 44 per experiment |
## Usage
```python
import torch
from huggingface_hub import hf_hub_download
# Download a checkpoint
repo = "GeoBrain/multiples-attenuation"
model_key = "res_unet"
seed = "42"
ckpt_path = hf_hub_download(
repo_id=repo,
filename=f"models/{model_key}/seed{seed}/best.pt",
)
# Load state dict
state_dict = torch.load(ckpt_path, map_location="cpu", weights_only=True)
# For full model loading, instantiate the corresponding architecture
# and load the state dict (see config.yaml for exact architecture params).
```
See the companion benchmark documentation for detailed experimental setup and full evaluation results.
## Results
*Results pending — run batch_evaluate.py to populate.*
## References
- Ronneberger et al., U-Net: Convolutional Networks for Biomedical Image Segmentation, MICCAI 2015
- He et al., Deep Residual Learning for Image Recognition, CVPR 2016
- Zhang et al., Image Denoising via Deep CNN (DnCNN), IEEE TIP 2017
- Oktay et al., Attention U-Net: Learning Where to Look for the Pancreas, MIDL 2018
- Kiraz et al., Attenuating free-surface multiples and ghost reflection from seismic data using a trace-by-trace convolutional neural network approach, Geophysical Prospecting 2024
- Tao et al., Seismic Surface-Related Multiples Suppression Based on SAGAN, IEEE Geoscience and Remote Sensing Letters 2022
- Wang et al., Seismic multiple suppression based on a deep neural network method for marine data, Geophysics 2022
|