Last modified: 2014-01-13 22:44:26 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T51906, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 49906 - monitor mediawiki extensions superproject misconfiguration
monitor mediawiki extensions superproject misconfiguration
Status: RESOLVED WONTFIX
Product: Wikimedia
Classification: Unclassified
Git/Gerrit (Other open bugs)
wmf-deployment
All All
: Normal enhancement (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks: 49846 49911 50261
  Show dependency treegraph
 
Reported: 2013-06-20 20:20 UTC by Antoine "hashar" Musso (WMF)
Modified: 2014-01-13 22:44 UTC (History)
7 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Antoine "hashar" Musso (WMF) 2013-06-20 20:20:23 UTC
The beta cluster rely on the super project mediawiki/extensions.git to deploy extensions automatically.  Sometime an extension would be misconfigured, a recent example is VisualEditor which got stuck for a few weeks to an old version (bug 49846).

It would be nice to run a SQL query daily that would mail gerritadmin about any misconfiguration.
Comment 1 Antoine "hashar" Musso (WMF) 2013-06-24 16:08:41 UTC
Vector was not updated either, might have caused bug 49911
Comment 2 Antoine "hashar" Musso (WMF) 2013-06-27 15:51:39 UTC
Campaigns not updating, bug 50261
Comment 3 Antoine "hashar" Musso (WMF) 2013-06-27 16:07:06 UTC
So to find out what is not up to date:

Fetch the extensions:

 git clone https://gerrit.wikimedia.org/r/p/mediawiki/extensions.git 
 cd extensions
 git submodule update --init

Then for each submodules look at the number of commits between HEAD (the currently checked out version locally) and origin/master (the version in gerrit):

 git submodule foreach 'test "$(git rev-list HEAD..origin/master --count)" = "0"  && echo "Up to date." || echo "ERROR!"'

Gives out something like:

 ...
 Entering 'AuthorProtect'
 Up to date.
 Entering 'AutoCreateCategoryPages'
 ERROR!

That extension is indeed lagging:

hashar:~/extensions/AutoCreateCategoryPages$ git log --oneline --decorate  --all -n4
14a097d (origin/master, origin/HEAD, master) Localisation updates from http://translatewiki.net.
981a381 (HEAD) Localisation updates from http://translatewiki.net.
e01f64e Add .gitreview and .gitignore
7ae6dd3 (origin/REL1_21) Localisation updates from http://translatewiki.net.
Comment 4 Antoine "hashar" Musso (WMF) 2013-06-27 16:13:40 UTC
A slightly better version being run on mediawiki/extensions.git at d0680b9


$ git submodule --quiet foreach 'test "$(git rev-list HEAD..origin/master --count)" = "0" || echo "ERROR! $path is lagging behind."'ERROR! AutoCreateCategoryPages is lagging behind.
ERROR! Bootstrap is lagging behind.
ERROR! Campaigns is lagging behind.
ERROR! CirrusSearch is lagging behind.
ERROR! CommunityTwitter is lagging behind.
ERROR! CoreEvents is lagging behind.
ERROR! EImage is lagging behind.
ERROR! JsonData is lagging behind.
ERROR! Less is lagging behind.
ERROR! OpenStreetMapSlippyMap is lagging behind.
ERROR! PerPageLicense is lagging behind.
ERROR! QuickResponse is lagging behind.
ERROR! TimelineTable is lagging behind.
ERROR! VisualEditor is lagging behind.
ERROR! WikibaseDataModel is lagging behind.
ERROR! WikibaseQueryEngine is lagging behind.
$
Comment 5 Antoine "hashar" Musso (WMF) 2013-06-27 16:23:57 UTC
https://gerrit.wikimedia.org/r/#/c/70836/ adds a script to verify the extensions syncronization.
Comment 6 Greg Grossmeier 2013-11-06 18:17:20 UTC
So now "all" that is needed is to have this in a cronjob that mails the output to...?
Comment 7 Andre Klapper 2013-11-22 15:30:27 UTC
Greg: Was that a question to hashar?
Comment 8 Greg Grossmeier 2013-11-22 16:22:37 UTC
(In reply to comment #7)
> Greg: Was that a question to hashar?

Yeah, rhetorical mostly, but he's the one that can answer it ;)
Comment 9 Antoine "hashar" Musso (WMF) 2013-11-22 22:05:48 UTC
(In reply to comment #6)
> So now "all" that is needed is to have this in a cronjob that mails the
> output to...?

I have no clue where it could be send. Nor do I have any idea where such a script should be run.

Possibly, we could run it once a few times per day as a Jenkins job and make that job alert back on IRC and/or to the Gerrit admin mail alias.
Comment 10 Antoine "hashar" Musso (WMF) 2014-01-13 22:44:26 UTC
I have filled that bug to monitor mediawiki/extensions.git being badly configured (for bug 49846).  Instead of using Gerrit maintained mediawiki/extensions.git, I will write a script that list all extensions, register them on beta and then do the submodule update.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links