Last modified: 2014-06-24 19:56:17 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T68864, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 66864 - tools-webgrid-01 / full
tools-webgrid-01 / full
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
tools (Other open bugs)
unspecified
All All
: Unprioritized critical
: ---
Assigned To: Tim Landscheidt
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-06-20 00:00 UTC by metatron
Modified: 2014-06-24 19:56 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description metatron 2014-06-20 00:00:23 UTC
And unfortunately, the grid directs all web(re)starts in the lighty-queue to this host.

tools-webgrid-01:~$ df -h
Filesystem                                       Size  Used Avail Use% Mounted on
/dev/vda1                                        7.6G  7.2G     0 100% /
udev                                             7.9G   12K  7.9G   1% /dev
tmpfs                                            3.2G  8.7M  3.2G   1% /run
none                                             5.0M     0  5.0M   0% /run/lock
none                                             7.9G     0  7.9G   0% /run/shm
/dev/vda2                                        1.9G  1.2G  677M  63% /var
Comment 1 Tim Landscheidt 2014-06-20 00:40:17 UTC
There were 3,7 GByte of VIPS temporary files in /tmp:

| scfc@tools-webgrid-01:~$ ll -rt /tmp/vips-*
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:25 /tmp/vips-8-XE11HX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:25 /tmp/vips-7-5K11HX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:25 /tmp/vips-6-B901HX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:25 /tmp/vips-5-7701HX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:25 /tmp/vips-4-WA11HX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:25 /tmp/vips-3-DV11HX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:25 /tmp/vips-2-4X11HX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:25 /tmp/vips-1-7941HX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:27 /tmp/vips-1-MUMZHX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:27 /tmp/vips-6-3RXNHX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:27 /tmp/vips-5-T2XNHX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:27 /tmp/vips-4-5YXNHX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:27 /tmp/vips-3-28XNHX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:27 /tmp/vips-2-FVVNHX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:27 /tmp/vips-7-SJXNHX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer 2635313152 Jun 19 12:27 /tmp/vips-9-I840HX.v
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer          8 Jun 19 12:27 /tmp/vips-8-44YOHX.tif
| -rw-r--r-- 1 tools.zoomviewer tools.zoomviewer 1250889728 Jun 19 12:29 /tmp/vips-11-6GJRHX.v
| scfc@tools-webgrid-01:~$

I deleted those and killed the im_vips2tiff processes that were holding them open.

Recently, in coordination with Daniel I set TMPDIR to a directory underneath the tool's home directory for the FastCGI process (iipsrv.fcgi) in ~/.lighttpd.conf.  In this case, the VIPS processes were spawned from PHP instead which didn't get an explicit TMPDIR and thus used /tmp by default.  Daniel, could you set TMPDIR in the PHP scripts as well, please?
Comment 2 Giftpflanze 2014-06-24 02:38:11 UTC
/ is full again, scenario as above.
Comment 3 Tim Landscheidt 2014-06-24 05:32:06 UTC
And deleted /tmp/*vips* again.  I'll leave this bug open until I've fixed the cause.
Comment 4 Tim Landscheidt 2014-06-24 19:56:17 UTC
Okay, I added:

| tools.zoomviewer@tools-webgrid-01:~$ diff -u public_html/index.php{~,}
| --- public_html/index.php~      2014-05-14 22:08:11.702308448 +0000
| +++ public_html/index.php       2014-06-24 19:52:40.030824639 +0000
| @@ -92,6 +92,7 @@
 
|      //$cmd = '/home/dschwen/install/bin/vips im_vips2tiff '.$c.' '.$t.':jpeg:75,tile:256x256,pyramid';
|      $cmd = '/usr/bin/vips im_vips2tiff '.$c.' '.$t.':jpeg:75,tile:256x256,pyramid';
| +    putenv ('TMPDIR=/data/project/zoomviewer/var/tmp');
|      $output = shell_exec( $cmd.'  2>&1');
|      rename( $t, $p );
|    }
| tools.zoomviewer@tools-webgrid-01:~$

to public_html/index.php (and I think that should fix it).

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links