Last modified: 2013-06-20 17:49:28 UTC
A few things stopped working as of June 17: With Visual Editor enabled in preferences, edit any page. Tabs for "Edit" and "Edit source" should exist but only "Edit" exists. Click "Edit" and what appears has no edit tools at all. http://en.wikipedia.beta.wmflabs.org/wiki/Aftpage should have AFT input at the bottom but does not. Cog icon at http://en.wikipedia.beta.wmflabs.org/wiki/Special:ArticleFeedbackv5/Aftpage should be active but is not.
*Seems* to be caused by trying to load the 'schema.Echo,EchoInteraction,EchoMail,EchoPrefUpdate,GettingStartedNavbar' module... Specifically schema.GettingStartedNavbar
In debug mode, the first 500 I get is http://en.wikipedia.beta.wmflabs.org/w/load.php?debug=true&lang=en&modules=startup&only=scripts&skin=vector&* (which indicates a failure very early in the loading process). In prod mode, the first 500 is http://en.wikipedia.beta.wmflabs.org/w/load.php?debug=false&lang=en&modules=ext.articleFeedbackv5.startup%7Cext.eventLogging%2CmarkAsHelpful%7Cext.gadget.PagesForDeletion%2CwmfFR2011Style%7Cext.gettingstarted.logging%2CopenTask%7Cjquery.articleFeedbackv5.utils%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CdelayedBind%2Chidpi%2ChighlightText%2CmakeCollapsible%2Cmw-jump%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.Title%2Chidpi%2CsearchSuggest%7Cmediawiki.action.view.postEdit%7Cmediawiki.page.ready%7Cmobile.desktop%7Cmw.MwEmbedSupport.style%7Cmw.PopUpMediaTransform%7Cschema.GettingStartedNavbar%7Cskins.vector.js&skin=vector&version=20130617T175109Z&* . hashar said fatals (which this apparently is) are currently sent to the prod machine. But they don't/shouldn't make it there, since the Labs network is meant to be isolated.
This was caused by https://gerrit.wikimedia.org/r/#/c/69130/ .
My apologies for causing this bug - EventLogging/NavigationTiming were causing problems for the mobile site immediately prior to testing and acceptance review meeting and the usual folks I would ask about this kinda stuff were unavailable, so I just disabled the extensions. Bad form, particularly with no follow up. So, my bad and I'll be sure to be more on it next time :)
Arthur, thanks for the note -- I appreciate it!
> hashar said fatals (which this apparently is) are currently sent to the prod > machine. But they don't/shouldn't make it there, since the Labs network is > meant to be isolated. Indeed. The destination is hardcoded in puppet. I have submitted a bunch of patches in operations/puppet and need to have them reviewed by ops. for reference: https://gerrit.wikimedia.org/r/68830 (make it possible to change the destination) https://gerrit.wikimedia.org/r/68831 (set the destination for labs) Kudos on fixing up beta :-)
Fixed by re-enabling EventLogging (Gerrit change Ibeb07a4b9).
Note that fatal errors are now enabled on beta (the changes I have referenced in comment #6 got merged a few hours ago). They can be found in /data/projects/logs/fatal.log
