OxHyperRealCH4 dataset

Author: Vít Růžička

One of the OxHyper datasets, for more details please check my main web at: https://previtus.github.io/

Fast data preview in: https://huggingface.co/datasets/previtus/OxHyperRealCH4/blob/main/dataset_exploration.ipynb

The "OxHyperRealCH4" dataset is a new mono-temporal hyperspectral dataset of real methane leak events. In total we have 279 large tiles in the training dataset, 91 in the validation dataset and 98 in the test dataset. These have reliable ground truth labels, which we calculated from the original labels provided on the EMIT data portal. We note that this dataset is smaller than the other ones and training a machine learning model from scratch could lead to overfitting and poor generalisation, however it can also be used for model fine-tuning and to test generalisation ability of models trained on other datasets. The total size of this data is 47 GB. It contains 86 spectral bands made of the RGB bands and ranges between 1573-1699nm and 2004-2478nm.

More info will be added upon publication, for now please refer to https://previtus.github.io/

More information about the NASA's sensor EMIT: https://earth.jpl.nasa.gov/emit/

File structure

Each folder represent a large tile (of 512x512px), in this case, every folder also contains a real methane leak event captured by the EMIT sensor. Rows in the attached csv's split these into train/val/test subsets.

Each folder contains these files:

• B - all 86 bands in a georeferenced file (note: you'll also need the B.hdr file to load it, can be also inspected for example in QGIS)
• B_EMIT_641nm.tif, B_EMIT_551nm.tif, B_EMIT_462nm.tif - The RGB bands, these were extracted from the larger file
• label_v3_binary.tif - binary label (pixel values 0 or 1 for "no plume" or "plume" class)
• B_magic30_tile.tif - computed matched filter product (using the iterative variant called mag1c)
• info.json - saved information about the used source data (for example the link to the used EMIT_L2B_CH4PLM sample)
• Note: for each georeferenced tif we also provide the .hdr file which is needed for loading and has details about the bands

Citation

Will be added.