Skip to content

new files for ipl3 #73

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Nov 16, 2023
Merged

new files for ipl3 #73

merged 1 commit into from
Nov 16, 2023

Conversation

ajwheeler
Copy link
Contributor

No description provided.

Copy link
Contributor

@joelbrownstein joelbrownstein left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding ipl3 astra species

@joelbrownstein joelbrownstein merged commit 54e7094 into main Nov 16, 2023
Copy link
Collaborator

@havok2063 havok2063 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding a comment here on suggested changes to simplify the astra path templates.

Comment on lines +200 to +203
astraAllStarApogeeNetv2 = $MWM_ASTRA/{v_astra}/summary/astraAllStarApogeeNetv2-{v_astra}.fits
astraAllVisitApogeeNetv2 = $MWM_ASTRA/{v_astra}/summary/astraAllVisitApogeeNetv2-{v_astra}.fits
astraAllStarBossNet = $MWM_ASTRA/{v_astra}/summary/astraAllStarBossNet-{v_astra}.fits
astraAllVisitBossNet = $MWM_ASTRA/{v_astra}/summary/astraAllVisitBossNet-{v_astra}.fits
Copy link
Collaborator

@havok2063 havok2063 Nov 16, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Given that you have a lot of related file species that only vary by a name, I would suggest we consolidate all these paths down by adding more template keywords. Something like

astraAllStar = $MWM_ASTRA/{v_astra}/summary/astraAllStar{pipeline}-{v_astra}.fits
astraAllVisit = $MWM_ASTRA/{v_astra}/summary/astraAllVisit{pipeline}-{v_astra}.fits

to replace all the separate allStar and allVisit files. These are really all one type of data product anyway. I think this can also be done with the astra pipeline output paths, e.g.

astraStar = $MWM_ASTRA/{v_astra}/results/star/@sdss_id_groups|/astraStar{pipeline}-{v_astra}-{sdss_id}@component_default|.fits
astraVisit = $MWM_ASTRA/{v_astra}/results/visit/@sdss_id_groups|/astraVisit{pipeline}-{v_astra}-{sdss_id}@component_default|.fits

This means you can also flexibly add pipelines or change pipeline names and we don't need to always update the tree.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No Brian, these are only superficially the "same" species but each has a different data model! They are different species with different datamodels, so collectivizing their paths would not be helpful for the data products database.

@havok2063
Copy link
Collaborator

@ajwheeler pinging you manually since this was already merged, and I'd like discuss my comment.

@havok2063 havok2063 deleted the ipl3-species branch November 21, 2023 17:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants