Skip to content

This is the github repository for the article: Convolutional Neural Network Modelling for MODIS Land Surface Temperature Super-Resolution

Notifications You must be signed in to change notification settings

IMT-Project-LTS-SR/MRUNet-for-MODIS-super-resolution

Repository files navigation

Convolutional Neural Network Modelling for MODIS Land Surface Temperature Super-Resolution

This repository includes code implementation for our article:

Binh Minh Nguyen, Ganglin Tian, Minh-Triet Vo, Aurélie Michel, Thomas Corpetti, et al.. Convolutional Neural Network Modelling for MODIS Land Surface Temperature Super-Resolution. 2022.

The brief description for each file is shown in the table below:

File description File description
File name Description
modis_downloader.py download MODIS LST image from NASA webpage (more information below)
modis_data_preprocessing.py preprocess the downloaded MODIS images, including cropping, cloud/sea elimination, etc.
utils.py contain all helper functions
tiff_process.py preprocess the tif files and transform them into npy arrays
File name Description
model.py definition for Multi-residual U-Net model
dataset.py create Pytorch dataset object
run_inference.py run the trained network
train.py train the network

0. Requirements

pip install -r requirements.txt

1. Data downloading and database preparation

User should firstly register on NASA's website[https://urs.earthdata.nasa.gov/users/new]. User could use the following command to download automatically MODIS dataset with the user name and corresponding password, the downloaded data will be placed folder "MODIS" in current directory.

python modis_downloader.py --username <username> --password <password> 

By assigning values to '--year_begin' and '--year_end', user can select the time range for downloading data, from year_begin to year_end. Default 'year_begin' is 2020, 'year_end' is 2021.

python modis_downloader.py --year_begin <year_begin> --year_end <year_end> --username <username> --password <password> 

After downloading the raw data for the desired years, data need to be pre-processed, which involves cropping, cloud and sea pixels elimination and downsampling:

python modis_data_preprocessing.py --year_begin <year_begin> --year_end <year_end>

2. Train and test Multi-residual U-Net

Our principle contribution in this project is to design and implement a new deep learning model based on U-net architecture called Multi-residual U-Net. The architecture of this model is shown as below:

MRUnet

Train

To train the network with your tif data, please make sure to put all of the data into a folder and run the following command:

python train.py --datapath <path/to/training/tifs/directory> --model_name <name of the model> --lr <learning rate> --epochs <number of epochs> --batch_size <size of batch> --continue_train <True/False>

P/s: The checkpoint of training process lies in the same directory as the train.py.

Test

To run the inference of the pretrained network on your tif data, please make sure to put all of the data into a folder and run the following command:

python run_inference.py --datapath <path/to/testing/tifs/directory> --pretrained <path/to/pretrained/model.pth> --savepath <path/to/save/directory> --max_val <normalization factor>

P/s:

  1. The max_val is the maximum pixel value of the data used for training the pretrained model.
  2. A pretrained Multi-residual U-Net can be found in Visualization benchmark.

3. Result

To quantify the results, we employed some famous metrics in image super resolution: PSNR and SSIM. We also mentioned RMSE because it is meaningful in remote sensing.

Qualitative results:

Results

Quantitative results:

Method PSNR SSIM RMSE
Bicubic 23.91 0.61 0.69
ATPRK 21.59 0.61 0.90
VDSR 25.42 0.72 0.58
DCMN 25.05 0.71 0.61
Multi-residual U-Net 28.40 0.85 0.39

4. Result visualization

You can find the notebook as well as the instruction for the benchmarking visualization in the folder Visualization benchmark. The notebook provides functions to plot and benchmark several techniques mentioned in the paper.

About

This is the github repository for the article: Convolutional Neural Network Modelling for MODIS Land Surface Temperature Super-Resolution

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published