Last modified: 2014-10-21 21:17:52 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T73341, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 71341 - /tmp/mw-ocg-latexer* directories left on Jenkins workers
/tmp/mw-ocg-latexer* directories left on Jenkins workers
Status: RESOLVED FIXED
Product: OCG
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
All All
: High critical
: ---
Assigned To: C. Scott Ananian
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-09-26 04:04 UTC by Bryan Davis
Modified: 2014-10-21 21:17 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Bryan Davis 2014-09-26 04:04:50 UTC
I was looking at disk utilization on integration-slave1006 today and noticed that there were a lot of /tmp/mw-ocg-latexer* directories. When I removed them just under 1G of disk space was freed.

These looked like they may be temporary files for tests that are leaked under some test failure scenario.
Comment 1 Gerrit Notification Bot 2014-09-26 16:24:47 UTC
Change 163186 had a related patch set uploaded by Cscott:
Increase OCG warning/critical space thresholds.

https://gerrit.wikimedia.org/r/163186
Comment 2 Gerrit Notification Bot 2014-09-26 18:50:56 UTC
Change 163186 merged by BBlack:
Increase OCG warning/critical space thresholds.

https://gerrit.wikimedia.org/r/163186
Comment 3 Krinkle 2014-10-14 06:12:30 UTC
That does not help Jenkins slaves. The /tmp on Jenkins slaves is filling up with 100s of abandoned mw-ocg-latexer**** directories like:

Oct  1 15:38 mw-ocg-latexer9950bagslz4/
Oct  1 15:38 mw-ocg-latexer9950bu0mq4g/

l mw-ocg-latexer87372ckx34w/
total 72K
drwx------   4 jenkins-deploy wikidev 4.0K Oct  7 22:10 ./
drwxrwxrwt 319 root           root     48K Oct 14 06:07 ../
drwxr-xr-x   3 jenkins-deploy wikidev 4.0K Oct  7 22:10 bundle/
-rw-r--r--   1 jenkins-deploy wikidev 1.9K Oct  7 22:10 languages.tex
drwxr-xr-x   2 jenkins-deploy wikidev 4.0K Oct  7 22:10 latex/
-rw-r--r--   1 jenkins-deploy wikidev 1.4K Oct  7 22:10 output.tex

This is one of three different software packages (the other being hhvm's perf-**.map and MW_PHPUnit_TextPassDumperTest files) that is filling up /tmp on Jenkins slaves and not being cleaned up.

Fix this soon (make it configurable, clean it up, disable it, whatever, if this needs modification to the Jenkins job, let me or Antoine know). If this is not addressed soon, we may have to undeploy tests for this project until it's sorted out.
Comment 4 Gerrit Notification Bot 2014-10-14 21:53:03 UTC
Change 166677 had a related patch set uploaded by Arlolra:
Fix cleaning up while running the tests

https://gerrit.wikimedia.org/r/166677
Comment 5 Gerrit Notification Bot 2014-10-21 16:27:07 UTC
Change 166677 merged by jenkins-bot:
Fix cleaning up while running the tests

https://gerrit.wikimedia.org/r/166677
Comment 6 C. Scott Ananian 2014-10-21 21:17:52 UTC
Should be fixed now.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links