Last modified: 2014-08-27 19:33:43 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T56786, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 54786 - Make exec hosts as submit hosts too
Make exec hosts as submit hosts too
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
tools (Other open bugs)
unspecified
All All
: High normal
: ---
Assigned To: Marc A. Pelletier
:
Depends on:
Blocks:
  Show dependency tree / graph
 
Reported: 2013-09-30 13:15 UTC by Liangent
Modified: 2014-08-27 19:33 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description Liangent 2013-09-30 13:15:13 UTC 
So tasks running on SGE can submit (sub-)tasks themselves, to avoid using direct subprocesses.
Comment 1 Philippe Elie 2014-06-23 15:15:29 UTC 
Can we have progress on that? Subprocess works poorly for multiple cpu bound sub-task.
Comment 2 Marc A. Pelletier 2014-08-27 19:33:43 UTC 
Despite some hesitation about possible runaway jobs, this has been done.

Note that the jsub/jstart tools are not available on the exec nodes by design; submitting jobs recursively should be considered an advanced operation and careful consideration of parameters to qsub should be a requirement.
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links