Last modified: 2014-02-03 03:00:45 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T57908, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 55908 - mysqldump on SGE exec host tools-exec-01 is very slow
mysqldump on SGE exec host tools-exec-01 is very slow
Status: RESOLVED WORKSFORME
Product: Wikimedia Labs
Classification: Unclassified
tools (Other open bugs)
unspecified
All All
: Unprioritized normal
: ---
Assigned To: Marc A. Pelletier
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-10-19 08:59 UTC by Liangent
Modified: 2014-02-03 03:00 UTC (History)
2 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Liangent 2013-10-19 08:59:48 UTC
My script: http://pastebin.com/zGDtjC64

Based on output and file existence, it seems every failed mysqldump call (due to missing database) takes one minute to end, while it's less than one second on tools-dev.
Comment 1 Liangent 2013-10-19 09:38:44 UTC
I removed my previous job and started a new one, and tools-exec-02 is allocated. Now the script runs smoothly. The previous host was tools-exec-01.

btw In meantime, I changed the script a bit, removing " 2> /dev/null" in order to observe whether it's some abnormal error. Hope that it doesn't matter much.
Comment 2 Marc A. Pelletier 2013-10-29 13:53:13 UTC
Is this still an issue?
Comment 3 Liangent 2013-10-29 14:15:48 UTC
(In reply to comment #2)
> Is this still an issue?

I haven't observed such events recently, based on file timestamps, but I can't know whether tools-exec-01 has been allocated for them.
Comment 4 Tim Landscheidt 2013-10-29 16:17:28 UTC
(In reply to comment #3)
> [...]
> I haven't observed such events recently, based on file timestamps, but I
> can't
> know whether tools-exec-01 has been allocated for them.

You can force executing a job on a specific host by requesting the "hostname" resource, i. e. "jsub -l hostname=tools-exec-03 true" will run "true" on tools-exec-03.
Comment 5 Liangent 2013-11-02 09:19:14 UTC
(In reply to comment #2)
> Is this still an issue?

ok it seems better now.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links