Entering edit mode
Hello,
Is it a good practice to use MulticoreParam on each of the cores/cpus requested by BatchtoolsParam?
Regards
Hello,
Is it a good practice to use MulticoreParam on each of the cores/cpus requested by BatchtoolsParam?
Regards
Generally it is not a good idea to have nested parallel calls, because it is too easy to over-subscribe the compute nodes (e.g., on a six-core machine running six jobs, each job starts six more parallel jobs, so there are 36 jobs contending for only 6 cores). In batchtools it would be better to use slurm or other facilities for distributing appropriate numbers of tasks to each compute node.
Use of this site constitutes acceptance of our User Agreement and Privacy Policy.