Last modified: 2013-07-02 13:41:11 UTC
Error retrieving thumbnail from scaling server: couldn't connect to host for this file and others (on en.beta) http://upload.beta.wmflabs.org/wikipedia/de/thumb/1/1e/Example_azy.png/100px-Example_azy.png http://de.wikipedia.beta.wmflabs.org/wiki/Datei:Example_azy.png svg seems to work (as only format): http://upload.beta.wmflabs.org/wikipedia/de/thumb/0/06/Icon-gears2.svg/20px-Icon-gears2.svg.png
(In reply to comment #0) > svg seems to work (as only format): strike that out. That is most likely a cached version. Just tested with a new uploaded svg file: http://de.wikipedia.beta.wmflabs.org/wiki/Datei:VLine.svg
http://upload.beta.wmflabs.org/wikipedia/de/thumb/6/6a/VLine.svg/500px-VLine.svg.png Yield: Error retrieving thumbnail from scaling server: couldn't connect to host
The deployment-upload internal cache was pointing to the old squid text cache. Ariel had the hint: ariel@deployment-upload:/data/project/upload7/scripts$ grep squid * thumb-handler.php:$reqURL = "http://deployment-squid/w/thumb.php?"; Made that to point to the deployment-cache-text1 instance via its internal IP. Now http://upload.beta.wmflabs.org/wikipedia/en/thumb/a/ab/Polar_bear.jpeg/50px-Polar_bear.jpeg gives me: -------------- Error generating thumbnail Error creating thumbnail: -------------- Looking at /data/project/logs/thumbnails.log : 2013-07-02 13:13:39 deployment-apache33 enwiki: thumbnail failed on deployment-apache33: error 1 "" from "'/usr/bin/convert' -quality 80 -background white '/mnt/upload7/wikipedia/en/a/ab/Polar_bear.jpeg' -thumbnail '50x38!' -set comment 'File source: http://en.wikipedia.beta.wmflabs.org/wiki/File:Polar_bear.jpeg' -depth 8 -sharpen '0x0.8' -rotate -0 '/tmp/transform_db78c40d6353-1.jpeg' 2>&1" 2013-07-02 13:13:39 deployment-apache33 enwiki: Removing bad 0-byte thumbnail "/tmp/transform_db78c40d6353-1.jpeg". unlink() succeeded running that command on deployment-apache33 gives me a thumbnail though.
Looking at the wfExec calls in /data/project/logs/web.log (grep wfExec), the exact command is: /bin/bash '/usr/local/apache/common-local/php-master/includes/limit.sh' 'OMP_NUM_THREADS='\''1'\'' MAGICK_TMPDIR='\''/tmp/a/magick-tmp'\'' '\''/usr/bin/convert'\'' -quality 80 -background white '\''/mnt/upload7/wikipedia/en/a/ab/Polar_bear.jpeg'\'' -thumbnail '\''50x38!'\'' -set comment '\''File source: http://en.wikipedia.beta.wmflabs.org/wiki/File:Polar_bear.jpeg'\'' -depth 8 -sharpen '\''0x0.8'\'' -rotate -0 '\''/tmp/transform_b092ee9c368d-1.jpeg'\'' 2>&1' 'MW_CPU_LIMIT=50; MW_CGROUP='\''/sys/fs/cgroup/memory/mediawiki/job'\''; MW_MEM_LIMIT=409600; MW_FILE_SIZE_LIMIT=409600; MW_WALL_CLOCK_LIMIT=180' That makes uses of cgroup that raised some alarms in the log files. Trying to run that command as user apache on deployment-apache32 yields: limit.sh: failed to create the cgroup.
mkdir: cannot create directory `/sys/fs/cgroup/memory/mediawiki/job/23391': No such file or directory
First occurrence according to the error apache logs is on [Mon Jul 01 19:18:58 2013]
The cgroups got recreated by restarting the mw-cgroups service on both apaches. That fixed the issue.
