Updated round 18 projections to include age groups

[mooresea]

Description

Added required age group projections. Increased number of trajectories per scenario from 100 to 200.

Checklist

• Specify a proper PR title with your team name.
• All validation checks ran successfully on your branch. Instructions to run the tests locally is present here.

[github-actions]

Run validation on files: 2024-04-28/cum death/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/cum hosp/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/inc death/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/inc hosp/2024-04-28-NotreDame-FRED0.gz.parquet

Columns:

No errors or warnings found on the column names and numbers

Scenarios:

No errors or warnings found on scenario name and scenario id columns

Origin Date Column:

No errors or warnings found on the column 'origin_date'

Value and Type Columns:

❌ Error 510: Each group combination should have one unique value. 6364800 unique groups have been identified with this issue. For example:
group: 2024-04-28, A-2024-03-01, 02, inc death, 1, NA, sample, 1;
group: 2024-04-28, A-2024-03-01, 02, inc death, 2, NA, sample, 1;
group: 2024-04-28, A-2024-03-01, 02, inc death, 3, NA, sample, 1;
etc.

Target Columns:

No errors or warnings found in target and associated columns

Locations:

No errors or warnings found on Location

Sample:

❌ Error 904: Samples are expected in the submission for the target(s): inc death, inc hosp. please verify.

Quantiles:

No errors or warnings found on quantiles values and format

Age Group:

❌ Error 801: The age_group column should contain value written: 'AGEMIN-AGEMAX', one or more 'age_group' value(s) is not corresponding in the submission file, please verify: 'NA'.
❌ Error 802: The age_group column contains unexpected value: 'NA'. 'age_group' can only be: 0-130, 65-130, 0-64, for the target: inc death, inc hosp.
❌ Error 802: The age_group column is missing at least 1 required value: '0-130', '65-130', '0-64'. 'age_group' should contain: 0-130, 65-130, 0-64, for the target: inc death, inc hosp.

[github-actions]

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission might be available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

[LucieContamin]

Good afternoon @mooresea ,

If I can provide more information on the error messages: it seems that the main issue is the NA in the age_group column for the sample output type. It creates multiple errors that might be confusing in the validation report. Also as I reminder, it is important to have the same number of samples for every group.

Please let me know if any issue or questions,
Best,
Lucie

[mooresea]

Lucie, Thank you, I think I have fixed the issue with NAs in the age_group column. Unfortunately, I am in Nairobi this week and my internet connection may not be strong enough to download my projections to my laptop for processing and then upload them to github until next week. Sean

…

On Mon, Jun 3, 2024 at 10:05 PM Lucie Contamin ***@***.***> wrote: Good afternoon @mooresea <https://github.com/mooresea> , If I can provide more information on the error messages: it seems that the main issue is the NA in the age_group column for the sample output type. It creates multiple errors that might be confusing in the validation report. Also as I reminder, it is important to have the same number of samples for every group. Please let me know if any issue or questions, Best, Lucie — Reply to this email directly, view it on GitHub <#287 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABKYJVMHF23W62HNWHESL7LZFS5AVAVCNFSM6AAAAABITQGXJCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBVHEZDENBZGQ> . You are receiving this because you were mentioned.Message ID: ***@***.*** com>

[github-actions]

Run validation on files: 2024-04-28/cum death/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/cum hosp/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/inc death/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/inc hosp/2024-04-28-NotreDame-FRED0.gz.parquet
End of validation check: all the validation checks were successful

[github-actions]

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission might be available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

[LucieContamin]

Hi @mooresea ,

Thank you for the update, I have a question about your submission, it seems that the file contains "sample" and "quantile" output type for all targets: cumulative and incident hospitalization and death. However, I noticed that your files do not contain cumulative hospitalization and death samples for the age group "0-130" but it's available for other age group. As the targets are optional, the validation did not send a message, but would it be possible to look into it, please?
I am happy to wait next week for next update if it's easier.

Please let me know if any issue or questions,
Best,
Lucie

[LucieContamin]

Hi again!

Sorry for the double message, but will it also be possible to remove your previous submission files to avoid issues.
Please let me know if any issue or questions,
Best,
Lucie

[github-actions]

Run validation on files: 2024-04-28/cum death/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/cum hosp/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/inc death/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/inc hosp/2024-04-28-NotreDame-FRED0.gz.parquet
End of validation check: all the validation checks were successful

[github-actions]

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission might be available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

[github-actions]

Run validation on files: 2024-04-28/cum death/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/cum hosp/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/inc death/2024-04-28-NotreDame-FRED0.gz.parquet, 2024-04-28/inc hosp/2024-04-28-NotreDame-FRED0.gz.parquet
End of validation check: all the validation checks were successful

[github-actions]

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission might be available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

[LucieContamin]

Hi @mooresea,
Thank you for the update, it looks all good now.
Best, Lucie