Last modified: 2014-08-25 17:11:11 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T71828, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 69828 - tools-db is down; need to flush hosts
tools-db is down; need to flush hosts
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
tools (Other open bugs)
unspecified
All All
: Unprioritized critical
: ---
Assigned To: Marc A. Pelletier
:
Depends on:
Blocks:
  Show dependency tree / graph
 
Reported: 2014-08-21 05:07 UTC by bgwhite
Modified: 2014-08-25 17:11 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description bgwhite 2014-08-21 05:07:31 UTC 
I'm getting this error for the past ~30 minutes:

Could not connect to database: Host '10.68.17.174' is blocked because of many connection errors; unblock with 'mysqladmin flush-hosts'
Comment 1 metatron 2014-08-21 12:55:20 UTC 
It is node: tools-webgrid-04  which is currently blocked by tools-db. All other nodes seem to be ok atm. A db-admin has to issue the FLUSH HOSTS command:

But prior to that, maybe assess the culprit-app.
As an /emergency/ workaround, you could repeatedly restart your webservice until it's no longer on tools-webgrid-04. 

https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Overview#Sun_Grid_Engine_.28SGE.29
Comment 2 bgwhite 2014-08-23 06:56:44 UTC 
For the past few weeks, web services have continually died.  Big Brother does restart it.  However, on which webgrid node things restart on can be random.  Long story short, a good part of the day I'm on tools-webgrid-04, thus dead in the water.
Comment 3 Marc A. Pelletier 2014-08-25 17:11:11 UTC 
flush hosts done.
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links