Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Making memory an optional parameter for ValidateVcf task #1144

Merged
merged 7 commits into from
Dec 13, 2023

Conversation

meganshand
Copy link
Contributor

When running the ReblockGvcfs pipeline without a calling_interval_list, the validation occurs over the intervals from the input (unreblocked) GVCF. In this case ValidateVariants requires much more memory. This argument will allow users to be able to adjust the memory to that task as needed if they don't provide the optional calling_interval_list. See also this GATK issue: broadinstitute/gatk#8608

For typical WGS GVCFs (around 4Gb inputs) using 32 Gb of memory allowed the task to pass (setting machine_mem_mb=32000).

Copy link

github-actions bot commented Dec 8, 2023

Remember to squash merge!

Copy link

github-actions bot commented Dec 8, 2023

Remember to squash merge!

@kayleemathews
Copy link
Contributor

@meganshand we'll need to bump the pipeline version numbers in the documentation but I can take care of that

@meganshand
Copy link
Contributor Author

@kayleemathews Thanks, I didn't realize I needed to change the versions elsewhere. I'll try to follow how you fix it to update those next time.

@kayleemathews
Copy link
Contributor

@meganshand No worries! I'm often the one who goes in to update the versions listed in the docs. Sometimes the changes being made require bigger changes to the documentation, but these ones should be pretty simple :)

Copy link

github-actions bot commented Dec 8, 2023

Remember to squash merge!

Copy link

Remember to squash merge!

Copy link

Remember to squash merge!

@nikellepetrillo
Copy link
Contributor

nikellepetrillo commented Dec 12, 2023

Copy link
Contributor

@aawdeh aawdeh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Copy link

Remember to squash merge!

@nikellepetrillo nikellepetrillo merged commit 514bb03 into develop Dec 13, 2023
3 checks passed
@meganshand meganshand deleted the ms_reblock_mem branch March 26, 2024 12:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants