Last modified: 2013-11-18 23:53:49 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T58717, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 56717 - limit jenkins user git setting pack.windowMemory to 2GB
limit jenkins user git setting pack.windowMemory to 2GB
Status: NEW
Product: Wikimedia
Classification: Unclassified
Continuous integration (Other open bugs)
wmf-deployment
All All
: Low minor (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency tree / graph
 
Reported: 2013-11-07 11:30 UTC by Antoine "hashar" Musso (WMF)
Modified: 2013-11-18 23:53 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description Antoine "hashar" Musso (WMF) 2013-11-07 11:30:18 UTC 
By default git comes with 8GB to map pack files in memory (core.packedGitLimit). Whenever we run `git gc --aggressive` the machine is sent to swap when processing certain repositories (i.e.  mediawiki/core).

We could use the puppet class git::userconfig to set the parameter for the jenkins user.
Comment 1 Gerrit Notification Bot 2013-11-13 09:18:19 UTC 
Change 95123 had a related patch set uploaded by Hashar:
contint: jenkins git config core.packedGitLimit=2G

https://gerrit.wikimedia.org/r/95123
Comment 2 Gerrit Notification Bot 2013-11-18 02:36:21 UTC 
Change 95123 merged by Faidon Liambotis:
contint: jenkins git config core.packedGitLimit=2G

https://gerrit.wikimedia.org/r/95123
Comment 3 Antoine "hashar" Musso (WMF) 2013-11-18 09:12:07 UTC 
Turns out the real memory hog is git repack-objects, its window memory limit can be set in recent git versions with pack.windowMemory=2GB or git repack --window-memory.

That is not available in git version 1.7.9.5 which we are using :/

Keeping bug open with low priority until we update git.
Comment 4 Antoine "hashar" Musso (WMF) 2013-11-18 23:53:49 UTC 
Pending git upgrade. Unassigning self. :(
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links