Commit f4c37ea5 authored by Martina Locatelli's avatar Martina Locatelli 🍁
Browse files

Adding task concurrency parameter to job script

parent a293b9d2
Pipeline #2627 passed with stages
in 16 minutes and 59 seconds
......@@ -43,6 +43,7 @@ then
source $HOME/.bashrc
fi
%(command)s
"""
......@@ -131,6 +132,7 @@ fi
memory = kwargs.get("memory", membycore*cpu*0.8)
# when the job exceeds membycore*cpu il get killed, to start it
# we ask to have a node with at least 80% of the maximum we can reach
max_jobs = kwargs.get("max_jobs", None)
submit_string = 'qsub -terse '
......@@ -173,7 +175,10 @@ fi
if maxtime is not None:
jobParams.append(
"#$ -l h_rt=" + str(datetime.timedelta(minutes=maxtime)))
if max_jobs is not None:
jobParams.append("#$ -tc " + str(max_jobs))
# NS, where elements turns into <FILE>
if len(elements) > 0:
self.__log.debug("Num elements submitted " + str(len(elements)))
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment