Worked Examples

Getting Started: Generators and Scheduled Loads

A great place to start exploring the AEMO data sets is the list of Generators and Scheduled Loads, this data is from AEMO's list of registrations. Access it through nem-data by following the steps below.

• Follow this link and download the latest release of the graphical user interface as an executable file.
• Download the session file for this example here
• Open the nem-data.exe file, windows will not recognise this file so you need to inform it is safe to run, click through any warnings
• Click the load session button and then select the example_zero.pkl file you just downloaded
• You will also need to create two new folders on you computer, one for the raw data cache and one to save the results in. Then provide the paths to these folder to nem-data in the text entry boxes provided.
• Now you should be ready to run the query, click the 'Run queries' button. Any time you run a query that requires new data to be downloaded it may take some time while nem-data creates and formats the local data cache.

Now the data should be ready for you to view. Explore the generator set and try using generators DUIDs to filter other queries like those outlined below.

Filtered Query of Dispatch Targets

This example out lines how to construct a query for dispatch targets of a single dispatch unit (Capital Wind Farm).

• The query is given a name, this will be used when nem-data saves the results as a csv
• A start and end time are given
• The DISPATCH_LOAD table is selected as this contains the dispatch targets data
• The columns 'SETTLEMENTDATE', 'DUID' and 'INTERVENTION' are automatically selected by nem-data as they from the primary key for this table.
• Additionally we select the column 'TOTALCLEARED' to get the dispatch targets for each interval
• The filter for Capital Wind Farm is created by entering its DUID in to the filter entry box, pressing enter and then selecting it from the list below.
• The filter for the intervention flag is automatically opened by nem-data, but will be ignore unless values are added and selected.

The query can be run using the 'Run queries' button. It can also be saved and loaded using the buttons at the top of the window. The file to load this session can be found here.

SCADA Data for Solar Generators

This example outlines how to query for scada data and generator fuel types, additionally it demonstrates how to merge data sets.

• In the AEMO database generator information and unit scada data are stored separately, therefore in order create a data set of scada data for just solar generators we need to query two data sets.
• First all the scada data is pulled unfiltered, then all the fuel type data is pulled from the Master Registration List but is filtered to just return 'Solar' generators.
• When an inner join is used to merge the data sets on the 'DUID' column all non solar generators are excluded from the result as they are not in the right hand table
• In this example query names not only provide file names for saving data, but are also referenced when merging data.
• Start and end times are not given for the Master Registration List as this is a static tables and its contents does not change with respect to time

The query can be run using the 'Run queries' button. It can also be saved and loaded using the buttons at the top of the window. The file to load this session can be found here.