Last modified: 2012-11-20 07:54:08 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T41742, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 39742 - Create a static copy of a clean MediaWiki clone instead git-cloning locally
Create a static copy of a clean MediaWiki clone instead git-cloning locally
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Continuous integration (Other open bugs)
unspecified
All All
: Low enhancement (vote)
: ---
Assigned To: Antoine "hashar" Musso (WMF)
:
Depends on:
Blocks:
  Show dependency tree / graph
 
Reported: 2012-08-28 18:53 UTC by Antoine "hashar" Musso (WMF)
Modified: 2012-11-20 07:54 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description Antoine "hashar" Musso (WMF) 2012-08-28 18:53:02 UTC 
The ant script is using a local git clone which is really slow when using mediawiki/core.  Since we dont really care about the whole history, we could just update the shared repository and take a snapshot of whatever revision we want then use that in the builddir.

Something like, from git-archive man page:

git archive --remote=/var/lib/jenkins/git/mediawiki/core master | (cd /dest/path && tar xf - )

That would make the whole cloning really faster.
Comment 1 Antoine "hashar" Musso (WMF) 2012-08-28 19:51:27 UTC 
I have implemented that idea with the new macro <git-snapshot /> https://gerrit.wikimedia.org/r/#/c/21821/
Comment 2 Antoine "hashar" Musso (WMF) 2012-08-31 16:43:30 UTC 
Used that for the Ext-TitleBlacklist job. Still need to convert the Wikidata job.
Comment 3 Antoine "hashar" Musso (WMF) 2012-09-24 20:22:33 UTC 
Not a high priority. Most jobs are already using git archive.  It is more about migrating the Mediawiki-GIT-Fetching job.
Comment 4 Antoine "hashar" Musso (WMF) 2012-10-29 08:25:16 UTC 
Will magically fix itself when we switch to Zuul.
Comment 5 Antoine "hashar" Musso (WMF) 2012-10-29 21:59:02 UTC 
To elaborate, Zuul create a new reference made of master + the change(s) and make that available to Jenkins.  Jenkins simply fetch that reference in its workspace.
Comment 6 Antoine "hashar" Musso (WMF) 2012-11-20 07:54:08 UTC 
Fixed with Zuul
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links