Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add generate-SQC-BAM #174

Merged
merged 22 commits into from
Mar 18, 2024
Merged

Add generate-SQC-BAM #174

merged 22 commits into from
Mar 18, 2024

Conversation

yashpatel6
Copy link
Collaborator

  • I have read the code review guidelines and the code review best practice on GitHub check-list.

  • The name of the branch is meaningful and well formatted following the standards, using [AD_username (or 5 letters of AD if AD is too long)-[brief_description_of_branch].

  • I have set up or verified the branch protection rule following the github standards before opening this pull request.

  • I have added my name to the contributors listings in the
    metadata.yaml and the manifest block in the nextflow.config as part of this pull request, am listed
    already, or do not wish to be listed. (This acknowledgement is optional.)

  • I have added the changes included in this pull request to the CHANGELOG.md under the next release version or unreleased, and updated the date.

  • I have updated the version number in the metadata.yaml and manifest block of the nextflow.config file following semver, or the version number has already been updated. (Leave it unchecked if you are unsure about new version number and discuss it with the infrastructure team in this PR.)

  • I have tested the pipeline on at least one A-mini sample.

Adding generate-SQC-BAM pipeline, with SAMtools stats and Picard CollectWgsMetrics enabled by default.

Testing Results

Tested with NFTest: test-generate-SQC-BAM, test-metapipeline-DNA-batch, test-metapipeline-DNA-fastq-input - logs and output: /hot/software/pipeline/metapipeline-DNA/Nextflow/development/unreleased/yashpatel-add-sqc-bam

Copy link
Member

@nwiltsie nwiltsie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like there's some problem with the outputs in test-metapipeline-DNA-fastq-input.log:

2024-03-16 03:49:21,820 - NFTest - INFO - WARN: Access to undefined parameter `input_csv` -- Initialise it to a default value eg. `params.input_csv = some_value`
2024-03-16 05:46:02,793 - NFTest - INFO - WARN: Failed to publish file: /scratch/107838/49/5d54845765959a8a2149b022e031da/generate-SQC-BAM-1.0.0/IlluminaPatient1; to: /hot/software/pipeline/metapipeline-DNA/Nextflow/development/unreleased/yashpatel-add-sqc-bam/test-metapipeline-DNA-fastq-input/metapipeline-DNA-6.0.0-rc.1/IlluminaTest/main_workflow/output/generate-SQC-BAM-1.0.0/IlluminaPatient1 [copy] -- See log file for details
2024-03-16 05:46:03,022 - NFTest - INFO - WARN: Failed to publish file: /scratch/107838/49/5d54845765959a8a2149b022e031da/generate-SQC-BAM-1.0.0/IlluminaPatient1; to: /hot/software/pipeline/metapipeline-DNA/Nextflow/development/unreleased/yashpatel-add-sqc-bam/test-metapipeline-DNA-fastq-input/metapipeline-DNA-6.0.0-rc.1/IlluminaTest/main_workflow/output/generate-SQC-BAM-1.0.0/IlluminaPatient1 [copy] -- See log file for details

I don't see those lines in test-metapipeline-DNA-batch.log. Is the same directory getting copied three times and failing the last two, or are multiple samples getting aliased to the same place?

@yashpatel6 yashpatel6 changed the title Yashpatel add sqc bam Add generate-SQC-BAM Mar 18, 2024
@yashpatel6
Copy link
Collaborator Author

It was an issue with over-writing since the patient ID was being used as the identifier in single-sample mode; updated now to assign the ID based on run mode

Copy link
Member

@nwiltsie nwiltsie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

Copy link
Contributor

@sorelfitzgibbon sorelfitzgibbon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! A couple of minor comments.

config/schema.yaml Outdated Show resolved Hide resolved
test/test-generate-SQC-BAM/assert_metrics.sh Outdated Show resolved Hide resolved
Copy link
Contributor

@Faizal-Eeman Faizal-Eeman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Two comments.

main.nf Outdated Show resolved Hide resolved
yashpatel6 and others added 3 commits March 18, 2024 16:27
Co-authored-by: Sorel Fitz-Gibbon <3223552+sorelfitzgibbon@users.noreply.github.com>
Co-authored-by: Sorel Fitz-Gibbon <3223552+sorelfitzgibbon@users.noreply.github.com>
@yashpatel6 yashpatel6 merged commit 6ca42f6 into main Mar 18, 2024
1 check passed
@yashpatel6 yashpatel6 deleted the yashpatel-add-sqc-bam branch March 18, 2024 23:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants