Adjust the ntask parameter in the Runmodel module to set the number of parallel tasks. #241
Unanswered
TaeWoong-Jeong
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, I use the RunModel module to execute third-party software using GNU parallel.
I am exploring how to adjust ntask to calculate the desired number of samples in parallel.
For example, if there are 100 samples and ntask=5 is set, I expect to distribute 20 samples to each of the 5 cores and run them in parallel. This should result in 5 output folders named Model_Runs_~, each containing 20 run_{index} folders.
I tested it, and it seems that whether I set ntask to 5 or any number, all samples are calculated in parallel at once.
Currently, my node has 48 cores, and it seems that as long as ntask is 2 or more, all samples are automatically and evenly distributed across the 48 cores for parallel computation. If I want to use only 10 cores, for example, is there a way to control this?
Thank you.
Beta Was this translation helpful? Give feedback.
All reactions