Last modified: 2013-08-30 11:13:02 UTC
Internet Explorer (6-9) tests fail randomly. Investigate the failures and make the tests more robust.
Here's one run that seems bogus: https://wmf.ci.cloudbees.com/job/browsertests-windows-internet_explorer_9/267/testReport/(root)/Math/Display_simple_math/ Sauce job: https://saucelabs.com/jobs/302b2cf196374819b39470b2b3e55918# Raw selenium log: https://saucelabs.com/jobs/302b2cf196374819b39470b2b3e55918/selenium-server.log The failure is: org.openqa.selenium.NoSuchElementException: Unable to find element with id == wpTextbox1 (WARNING: The server did not provide any stacktrace information) ..but if you look at the video, #wpTextbox is clearly there. Interestingly, the first NoSuchElementException failure is thrown *before* another warning, "Invalid length: Content-Length=22200 written=8192". Although this warning is emitted for load.php (i.e., for one of the ResourceLoader requests and and not for the main request), it makes me suspect that Selenium is not waiting for DOMContentLoaded, and that there is consequently a race condition that causes the selector to fire some milliseconds before the element is present. If this is indeed the problem, it should be fixable by setting a wait timeout. See http://www.deanhume.com/Home/BlogPost/selenium-webdriver---wait-for-an-element-to-load/64 & http://docs.seleniumhq.org/docs/04_webdriver_advanced.jsp.
..also, it might be a good idea to disable wmf-selenium-bot until this bug is fixed, since the bogus failures are not winning it any friends.
Since just 1-2 tests are failing on Internet Explorer, disable them until they are fixed. Failing tests now just create noise, and the vast majority of the tests are passing.
Oli, I have spend a few hours trying to fix failing IE tests, but I had no luck so far. I will disable failing tests for now (for IE only), until I get some time to make them more robust.
"Oli" should be "Ori", of course. :)
Failing tests disabled in https://gerrit.wikimedia.org/r/#/c/58099/
Wontfix-ing, this is not a useful bug, it is too general. I will create more targeted bugs as needed.
