Last modified: 2013-12-10 14:31:06 UTC
local-earwigbot@tools-login:~$ python >>> import oursql >>> oursql.connect(host="enwiki.labsdb", db="enwiki_p", read_default_file="/data/project/earwigbot/replica.my.cnf") <oursql.Connection object at 0x7f95d98792f0> >>> local-earwigbot@tools-login:~$ ssh tools-exec-09 local-earwigbot@tools-exec-09:~$ python >>> import oursql >>> oursql.connect(host="enwiki.labsdb", db="enwiki_p", read_default_file="/data/project/earwigbot/replica.my.cnf") Traceback (most recent call last): File "<stdin>", line 1, in <module> File "connection.pyx", line 150, in oursql.Connection.__cinit__ (oursqlx/oursql.c:5482) File "connection.pyx", line 183, in oursql.Connection._raise_error (oursqlx/oursql.c:5885) oursql.InterfaceError: (2005, "Unknown MySQL server host 'enwiki.labsdb' (0)", None) >>> This happens on 09 and 01 for all databases, whereas 02-08 have no issues. 09 seems to get the error immediately while 01 takes about a minute to fail.
There is currently a known issue with DNS inside labs that is at the top of my priority list and is the cause of this.
There was a workaround put in place that should prevent this from happening no matter what happens to DNS.