Last modified: 2014-08-27 19:33:43 UTC
So tasks running on SGE can submit (sub-)tasks themselves, to avoid using direct subprocesses.
Can we have progress on that? Subprocess works poorly for multiple cpu bound sub-task.
Despite some hesitation about possible runaway jobs, this has been done. Note that the jsub/jstart tools are not available on the exec nodes by design; submitting jobs recursively should be considered an advanced operation and careful consideration of parameters to qsub should be a requirement.