NREL ATB axtraction

[cmgosnell]

Overview

Closes #3468.

What did you change?

• added nrel doi into datastore
• added nrel atb settings
• added a parquet extractor
• added a nrel atb extractor
• mapped columns from multiple years
• added dagsets assets using raw_df_factory
• import those assets in the dagset setup

Remaining Questions?

• Is it okay that the ParquetExtractor assumes that the archive is one non-zipped file per partition?
• Is there a safer/better way to open these parquet files?
• Context: I noticed that only the excel extractor was actual renaming columns based on the column_maps by default. This felt wrong so I moved it. Q: This required a little bit of a hack in the unit tests... is that okay? Is there a cleaner way to do this? It relates to the use of any_year in the column maps. I like that convention overall. If we made it a little more general like any or any_part i could imagine adding this default behavior into the generic extractor. I didn't do that only bc it felt oos here.

Testing

How did you make sure this worked? How can a reviewer verify this?

To-do list

Beta Give feedback

1. If updating analyses or data processing functions: make sure to update or write data validation tests (e.g., test_minmax_rows())
2. Update the release notes: reference the PR and related issues.
3. Ensure docs build, unit & integration tests, and test coverage pass locally with make pytest-coverage (otherwise the merge queue may reject your PR)
4. Review the PR yourself and call out any questions or issues you have
5. For minor ETL changes or data additions, once make pytest-coverage passes, make sure you have a fresh full PUDL DB downloaded locally, materialize new/changed assets and all their downstream assets and run relevant data validation tests using pytest and --live-dbs.
6. Run the full ETL locally to make sure any of the extractor migrations didn't junk anything up

[cmgosnell]

hm i accidentally made this branch off of my unfinished eia extraction branch... i think it's okay now but i probably should have done something besides merge in main...

[e-belfer]

Two smallish blocking changes:

1. Please add any ATB docs that you're referencing into our data_sources folder.
2. Suggested changes to the extraction test to actually test the rename, rather than skipping it.

Otherwise extraction works great and as expected.

[e-belfer]

Looks good to go!