File size: 1,732 Bytes
ebd3d23
b42f86c
 
 
 
ebd3d23
 
 
 
b42f86c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
---
title: SDRBench
emoji: 📦
colorFrom: blue
colorTo: indigo
sdk: static
pinned: false
---

# SDRBench — Scientific Data Reduction Benchmark

[SDRBench](https://sdrbench.github.io/) provides reference scientific datasets for benchmarking
lossy and lossless data reduction (compression) techniques: climate, weather, cosmology,
molecular dynamics, quantum chemistry, turbulence, combustion, X-ray imaging and fusion
simulations from DOE laboratories and their partners.

This organization hosts an **unmodified mirror** of the SDRBench datasets, which are
originally distributed by Argonne National Laboratory through Globus. Every file is
byte-for-byte identical to the one in the original SDRBench archive (sha256 verified), and
the mirror is kept in sync automatically.

```bash
pip install sdrbench
```

```python
import sdrbench
sdrbench.list()                      # available datasets
nyx = sdrbench.dataset("nyx")
nyx.fields                           # field names
x = nyx["temperature"]               # numpy array, C order
```

- Website and documentation: https://sdrbench.github.io/
- Python package and sync pipeline: https://github.com/szcompressor/sdrbench
- Maintained by the SDRBench team (Argonne National Laboratory and collaborators)

**Citation.** Please cite SDRBench and the data provider named on each dataset card:

```bibtex
@inproceedings{zhao2020sdrbench,
  title     = {{SDRBench}: Scientific Data Reduction Benchmark for Lossy Compressors},
  author    = {Zhao, Kai and Di, Sheng and Liang, Xin and Li, Sihuan and Tao, Dingwen and Chen, Zizhong and Cappello, Franck},
  booktitle = {2020 IEEE International Conference on Big Data (Big Data)},
  pages     = {2716--2724},
  year      = {2020}
}
```