This repository shows how I extract daily weather data from NOAA using R and Python. Automation codes are mainly written in R, and the Jupyter notebook is more of a tutorial. Will also include Python codes for data downloading and cleaning automation in the future.
Data is extracted from ftp://ftp.ncdc.noaa.gov/pub/data/gsod/. Copy this link to your file explorer to access station data from 1950 to present.
Station numbers can be found here:
ftp://ftp.ncdc.noaa.gov/pub/data/noaa/isd-history.csv
For example, Legazpi weather station's USAF ID is 984440
Custom functions:
download_NOAA.R: used to download files to a local folder. Only to be run once, except if data needs to be updated.read_NOAA.R: used to read and store data to R. This will create a data frame with complete dates, even those that are not in the dataset, as long as within the range of the pre-determined start and end years.
Sample outputs are also featured here.
Data for LARS-WG.R shows how I use the custom fuctions and other data cleaning process of weather data for Philippine Weather stations.
Output files are as *.dat file format which can be used as input data for statistical downscaling using LARS-WG.