Last modified: 2013-04-22 16:15:28 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T46044, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 44044 - Thumbnails fail: "timeout" not installed, required in ulimit5.sh
Thumbnails fail: "timeout" not installed, required in ulimit5.sh
Status: RESOLVED FIXED
Product: MediaWiki
Classification: Unclassified
File management (Other open bugs)
1.21.x
All All
: High critical (vote)
: 1.21.0 release
Assigned To: Aaron Schulz
http://www.wecowi.de/images/thumb/6/6...
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-01-16 19:22 UTC by DaSch
Modified: 2013-04-22 16:15 UTC (History)
7 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description DaSch 2013-01-16 19:22:26 UTC
I have a somehow strange error. I updated mediawiki to the latest git version.
Now when uploading a new image creating thumbnails fails.
But for old images creating thumbnails with sizes that are not in thumbnails folder works.
I already checked the folder permissions and set them to 777.

It seams to me that creating the folders fails and then the images cannot be added. Where there any changes there?
Comment 1 DaSch 2013-01-16 20:15:20 UTC
I made some test and it's a problem with ImageMagick because setting
$wgUseImageMagick = false;
makes it work again.
Comment 2 Bawolff (Brian Wolff) 2013-01-16 20:49:02 UTC
Do you get error messages when trying to create a thumbnail? (With php warnings enabled).

There were a bunch of changes with how files were handled, but I think that was in 1.19. Off the top of my head im not sure if there have been recent changes
Comment 3 DaSch 2013-01-16 21:08:04 UTC
I had PHP Warning enabled and there were not errors displayed. The only error was that instead of the thumbnail there is the text that creating thumbnails failed.
Comment 4 Andre Klapper 2013-01-17 10:33:42 UTC
Bug 42730 and bug 32387 came to my mind, but they both have error messages.
Comment 5 Bawolff (Brian Wolff) 2013-01-17 12:49:24 UTC
(In reply to comment #4)
> Bug 42730 and bug 32387 came to my mind, but they both have error messages.

Neither seems likely. The first would apply to all images not just new images (I think). The second only applies to exvessively large images.
Comment 6 Bawolff (Brian Wolff) 2013-01-17 13:28:41 UTC
(In reply to comment #5)
> (In reply to comment #4)
> > Bug 42730 and bug 32387 came to my mind, but they both have error messages.
> 
> Neither seems likely. The first would apply to all images not just new images
> (I think)
By which i mean i think that bug would apply to old images where there is no cached thumbnail
Comment 7 DaSch 2013-01-18 13:36:04 UTC
Until now I just look on the File Page, there only the error that thumbnail creation failed was shown. In gallery view I saw, that there is another message saying invalid thumbnail paramter.

So it could be a similar problem like Bug 42730?

The solution should be to set $wgTmpDirectory?
Comment 8 DaSch 2013-01-18 13:48:53 UTC
With imagemagick it even does not work with old images and there is no error message.
Without imagemagick it works for some images and fails for other with the message invalid parameters.
For this image it fails with and without imagemagick
http://www.wecowi.de/wiki/Datei:Yosemite_Half_Dome.jpg
Comment 9 DaSch 2013-01-23 21:35:05 UTC
Well, somehow even for some old images (and PDFs – I have with PDFHandler installed) the creation of thumbnails fails. But the strange thing is, that the small version work but the normal size thumbnails do not work. Here an example
http://www.wecowi.de/index.php?title=Datei:Hausarbeit-DaSch-2009.pdf
Comment 10 DaSch 2013-01-23 22:21:41 UTC
After taking a look into the temp directory I saw, that the images are named like this now
20130116203806!php6yqftK.jpg

Older images have a number and the Name of the picture and not such a cryptic name.
Comment 11 DaSch 2013-01-23 22:43:31 UTC
Something with images works totally wrong, I tried to omit the error by setting $wgUseImageResize = false; but this doesn't have any effect! Somebody broke the image handling completely!
Comment 12 DaSch 2013-01-23 23:22:12 UTC
Installing new version of ImageMagick also didn't help.

I changed $wgTmpDirectory to a directory that is accessible and nothing happens. It seams to me, that creating new hashed subfolders does not work.
Comment 13 Nemo 2013-01-24 11:01:48 UTC
-tracking bug: https://commons.wikimedia.org/wiki/Special:NewFiles has no problems.
Comment 14 Nemo 2013-01-24 11:19:33 UTC
https://translatewiki.net/wiki/File:Bug44044.JPG works too, you can find the config at https://gerrit.wikimedia.org/r/gitweb?p=translatewiki.git;a=tree
That PDF definitely has some other problem, MediaWiki is not finding its resolution info?
Comment 15 Bawolff (Brian Wolff) 2013-01-24 13:40:38 UTC
I don't think this should be high critical unless its affecting several wikis
Comment 16 DaSch 2013-01-24 19:22:14 UTC
Is this maybe a Problem with PHP? I use 5.3.2 the latest supported Version. Commons and translatewiki use 5.3.10

The point is that I didn't change anything with the configuration and with folder permissions just updated mediawiki through git
Comment 17 Nemo 2013-01-24 19:49:24 UTC
Can you confirm that all files show this error?

http://www.wecowi.de/images/thumb/6/66/Yosemite_Half_Dome.jpg/120px-Yosemite_Half_Dome.jpg
Not Found
The requested document was not found on this server.

We have something similar going on at WMF for some images (not new uploads, just recent uploads in pseudo-random timespans):
https://upload.wikimedia.org/wikipedia/commons/thumb/e/eb/John_Angelos.JPG/160px-John_Angelos.JPG
Error generating thumbnail
The source file 'John_Angelos.JPG' does not exist. 

I don't know if it's the same issue, ah Aaron just said "probably not".
Comment 18 DaSch 2013-01-24 19:53:46 UTC
At the moment all files show errors and do not work. Maybe this Debug Output can help?


MimeMagic::__construct: loading mime types from /var/www/vhosts/wecowi.de/httpdocs/includes/mime.types
MimeMagic::__construct: loading mime info from /var/www/vhosts/wecowi.de/httpdocs/includes/mime.info
File::transform: Doing stat for mwstore://local-backend/local-thumb/6/66/Yosemite_Half_Dome.jpg/555px-Yosemite_Half_Dome.jpg
FileBackendStore::getFileStat: File mwstore://local-backend/local-thumb/6/66/Yosemite_Half_Dome.jpg/555px-Yosemite_Half_Dome.jpg does not exist.
BitmapHandler::doTransform: creating 555x414 thumbnail at /var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_78b27c601de6-1.jpg using scaler im
BitmapHandler::doTransform: called wfMkdirParents(/var/www/vhosts/wecowi.de/httpdocs/images/tmp)
BitmapHandler::getMagickVersion: Running convert -version
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 ''\''/usr/local/bin/convert'\'' -version'
BitmapHandler::getMagickVersion: ImageMagick version check failed
BitmapHandler::transformImageMagick: running ImageMagick: '/usr/local/bin/convert' -quality 80 -background white  '/var/www/vhosts/wecowi.de/httpdocs/images/6/66/Yosemite_Half_Dome.jpg'  -thumbnail '555x414!' -set comment 'File source: http://www.wecowi.de/wiki/Datei:Yosemite_Half_Dome.jpg' -depth 8 -sharpen '0x0.4'  -rotate -0   '/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_78b27c601de6-1.jpg' 2>&1
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 'OMP_NUM_THREADS='\''1'\'' MAGICK_TMPDIR='\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp'\'' '\''/usr/local/bin/convert'\'' -quality 80 -background white  '\''/var/www/vhosts/wecowi.de/httpdocs/images/6/66/Yosemite_Half_Dome.jpg'\''  -thumbnail '\''555x414!'\'' -set comment '\''File source: http://www.wecowi.de/wiki/Datei:Yosemite_Half_Dome.jpg'\'' -depth 8 -sharpen '\''0x0.4'\''  -rotate -0   '\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_78b27c601de6-1.jpg'\'' 2>&1'
File::transform: Doing stat for mwstore://local-backend/local-thumb/6/66/Yosemite_Half_Dome.jpg/833px-Yosemite_Half_Dome.jpg
FileBackendStore::getFileStat: File mwstore://local-backend/local-thumb/6/66/Yosemite_Half_Dome.jpg/833px-Yosemite_Half_Dome.jpg does not exist.
BitmapHandler::doTransform: creating 833x622 thumbnail at /var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_714af6f12892-1.jpg using scaler im
BitmapHandler::doTransform: called wfMkdirParents(/var/www/vhosts/wecowi.de/httpdocs/images/tmp)
BitmapHandler::getMagickVersion: Running convert -version
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 ''\''/usr/local/bin/convert'\'' -version'
BitmapHandler::getMagickVersion: ImageMagick version check failed
BitmapHandler::transformImageMagick: running ImageMagick: '/usr/local/bin/convert' -quality 80 -background white  '/var/www/vhosts/wecowi.de/httpdocs/images/6/66/Yosemite_Half_Dome.jpg'  -thumbnail '833x622!' -set comment 'File source: http://www.wecowi.de/wiki/Datei:Yosemite_Half_Dome.jpg' -depth 8 -sharpen '0x0.4'  -rotate -0   '/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_714af6f12892-1.jpg' 2>&1
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 'OMP_NUM_THREADS='\''1'\'' MAGICK_TMPDIR='\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp'\'' '\''/usr/local/bin/convert'\'' -quality 80 -background white  '\''/var/www/vhosts/wecowi.de/httpdocs/images/6/66/Yosemite_Half_Dome.jpg'\''  -thumbnail '\''833x622!'\'' -set comment '\''File source: http://www.wecowi.de/wiki/Datei:Yosemite_Half_Dome.jpg'\'' -depth 8 -sharpen '\''0x0.4'\''  -rotate -0   '\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_714af6f12892-1.jpg'\'' 2>&1'
File::transform: Doing stat for mwstore://local-backend/local-thumb/6/66/Yosemite_Half_Dome.jpg/1110px-Yosemite_Half_Dome.jpg
FileBackendStore::getFileStat: File mwstore://local-backend/local-thumb/6/66/Yosemite_Half_Dome.jpg/1110px-Yosemite_Half_Dome.jpg does not exist.
BitmapHandler::doTransform: creating 1110x829 thumbnail at /var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_3dbdf6ca567e-1.jpg using scaler im
BitmapHandler::doTransform: called wfMkdirParents(/var/www/vhosts/wecowi.de/httpdocs/images/tmp)
BitmapHandler::getMagickVersion: Running convert -version
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 ''\''/usr/local/bin/convert'\'' -version'
BitmapHandler::getMagickVersion: ImageMagick version check failed
BitmapHandler::transformImageMagick: running ImageMagick: '/usr/local/bin/convert' -quality 80 -background white  '/var/www/vhosts/wecowi.de/httpdocs/images/6/66/Yosemite_Half_Dome.jpg'  -thumbnail '1110x829!' -set comment 'File source: http://www.wecowi.de/wiki/Datei:Yosemite_Half_Dome.jpg' -depth 8 -sharpen '0x0.4'  -rotate -0   '/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_3dbdf6ca567e-1.jpg' 2>&1
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 'OMP_NUM_THREADS='\''1'\'' MAGICK_TMPDIR='\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp'\'' '\''/usr/local/bin/convert'\'' -quality 80 -background white  '\''/var/www/vhosts/wecowi.de/httpdocs/images/6/66/Yosemite_Half_Dome.jpg'\''  -thumbnail '\''1110x829!'\'' -set comment '\''File source: http://www.wecowi.de/wiki/Datei:Yosemite_Half_Dome.jpg'\'' -depth 8 -sharpen '\''0x0.4'\''  -rotate -0   '\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_3dbdf6ca567e-1.jpg'\'' 2>&1'
Pulling file metadata from cache key admin_wecowi:file:1adb9a6555187fbaf74974bea3de3183
File::transform: Doing stat for mwstore://local-backend/local-thumb/1/1a/Mono_Lake_Türmchen.jpg/555px-Mono_Lake_Türmchen.jpg
FileBackendStore::getFileStat: File mwstore://local-backend/local-thumb/1/1a/Mono_Lake_Türmchen.jpg/555px-Mono_Lake_Türmchen.jpg does not exist.
BitmapHandler::doTransform: creating 555x370 thumbnail at /var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_11159b9141a4-1.jpg using scaler im
BitmapHandler::doTransform: called wfMkdirParents(/var/www/vhosts/wecowi.de/httpdocs/images/tmp)
BitmapHandler::getMagickVersion: Running convert -version
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 ''\''/usr/local/bin/convert'\'' -version'
BitmapHandler::getMagickVersion: ImageMagick version check failed
BitmapHandler::transformImageMagick: running ImageMagick: '/usr/local/bin/convert' -quality 80 -background white  '/var/www/vhosts/wecowi.de/httpdocs/images/1/1a/Mono_Lake_Türmchen.jpg'  -thumbnail '555x370!' -set comment 'File source: http://www.wecowi.de/wiki/Datei:Mono_Lake_T%%C3%%BCrmchen.jpg' -depth 8 -sharpen '0x0.4'  -rotate -0   '/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_11159b9141a4-1.jpg' 2>&1
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 'OMP_NUM_THREADS='\''1'\'' MAGICK_TMPDIR='\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp'\'' '\''/usr/local/bin/convert'\'' -quality 80 -background white  '\''/var/www/vhosts/wecowi.de/httpdocs/images/1/1a/Mono_Lake_Türmchen.jpg'\''  -thumbnail '\''555x370!'\'' -set comment '\''File source: http://www.wecowi.de/wiki/Datei:Mono_Lake_T%%C3%%BCrmchen.jpg'\'' -depth 8 -sharpen '\''0x0.4'\''  -rotate -0   '\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_11159b9141a4-1.jpg'\'' 2>&1'
File::transform: Doing stat for mwstore://local-backend/local-thumb/1/1a/Mono_Lake_Türmchen.jpg/833px-Mono_Lake_Türmchen.jpg
FileBackendStore::getFileStat: File mwstore://local-backend/local-thumb/1/1a/Mono_Lake_Türmchen.jpg/833px-Mono_Lake_Türmchen.jpg does not exist.
BitmapHandler::doTransform: creating 833x555 thumbnail at /var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_6279c17a26df-1.jpg using scaler im
BitmapHandler::doTransform: called wfMkdirParents(/var/www/vhosts/wecowi.de/httpdocs/images/tmp)
BitmapHandler::getMagickVersion: Running convert -version
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 ''\''/usr/local/bin/convert'\'' -version'
BitmapHandler::getMagickVersion: ImageMagick version check failed
BitmapHandler::transformImageMagick: running ImageMagick: '/usr/local/bin/convert' -quality 80 -background white  '/var/www/vhosts/wecowi.de/httpdocs/images/1/1a/Mono_Lake_Türmchen.jpg'  -thumbnail '833x555!' -set comment 'File source: http://www.wecowi.de/wiki/Datei:Mono_Lake_T%%C3%%BCrmchen.jpg' -depth 8 -sharpen '0x0.4'  -rotate -0   '/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_6279c17a26df-1.jpg' 2>&1
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 'OMP_NUM_THREADS='\''1'\'' MAGICK_TMPDIR='\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp'\'' '\''/usr/local/bin/convert'\'' -quality 80 -background white  '\''/var/www/vhosts/wecowi.de/httpdocs/images/1/1a/Mono_Lake_Türmchen.jpg'\''  -thumbnail '\''833x555!'\'' -set comment '\''File source: http://www.wecowi.de/wiki/Datei:Mono_Lake_T%%C3%%BCrmchen.jpg'\'' -depth 8 -sharpen '\''0x0.4'\''  -rotate -0   '\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_6279c17a26df-1.jpg'\'' 2>&1'
File::transform: Doing stat for mwstore://local-backend/local-thumb/1/1a/Mono_Lake_Türmchen.jpg/1110px-Mono_Lake_Türmchen.jpg
FileBackendStore::getFileStat: File mwstore://local-backend/local-thumb/1/1a/Mono_Lake_Türmchen.jpg/1110px-Mono_Lake_Türmchen.jpg does not exist.
BitmapHandler::doTransform: creating 1110x740 thumbnail at /var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_655411fe238c-1.jpg using scaler im
BitmapHandler::doTransform: called wfMkdirParents(/var/www/vhosts/wecowi.de/httpdocs/images/tmp)
BitmapHandler::getMagickVersion: Running convert -version
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 ''\''/usr/local/bin/convert'\'' -version'
BitmapHandler::getMagickVersion: ImageMagick version check failed
BitmapHandler::transformImageMagick: running ImageMagick: '/usr/local/bin/convert' -quality 80 -background white  '/var/www/vhosts/wecowi.de/httpdocs/images/1/1a/Mono_Lake_Türmchen.jpg'  -thumbnail '1110x740!' -set comment 'File source: http://www.wecowi.de/wiki/Datei:Mono_Lake_T%%C3%%BCrmchen.jpg' -depth 8 -sharpen '0x0.4'  -rotate -0   '/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_655411fe238c-1.jpg' 2>&1
wfShellExec: /bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 'OMP_NUM_THREADS='\''1'\'' MAGICK_TMPDIR='\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp'\'' '\''/usr/local/bin/convert'\'' -quality 80 -background white  '\''/var/www/vhosts/wecowi.de/httpdocs/images/1/1a/Mono_Lake_Türmchen.jpg'\''  -thumbnail '\''1110x740!'\'' -set comment '\''File source: http://www.wecowi.de/wiki/Datei:Mono_Lake_T%%C3%%BCrmchen.jpg'\'' -depth 8 -sharpen '\''0x0.4'\''  -rotate -0   '\''/var/www/vhosts/wecowi.de/httpdocs/images/tmp/transform_655411fe238c-1.jpg'\'' 2>&1'
Comment 19 DaSch 2013-01-24 19:55:59 UTC
The only point about this that I do not understand is where
"mwstore://local-backend/local-thumb/…" points cause this is the only point where an error is shown
Comment 20 Bawolff (Brian Wolff) 2013-01-24 19:58:21 UTC
The interesting line there imho is the convert version check failed. There were recent changes to the ulimit script if I recall. I wonder if that's related
Comment 21 Bawolff (Brian Wolff) 2013-01-24 20:05:10 UTC
(In reply to comment #17)
> Can you confirm that all files show this error?
> 
> http://www.wecowi.de/images/thumb/6/66/Yosemite_Half_Dome.jpg/120px-
> Yosemite_Half_Dome.jpg
> Not Found
> The requested document was not found on this server.
> 

Note that is an apache error not a mw error. Like most non wmf setups he's not using 404 thumb generation so that error message is just a standard thumb doesnt currently exist and wouldn't have much to do with the cause (unlike the thumb errors on wmf)
Comment 22 DaSch 2013-01-24 20:14:43 UTC
(In reply to comment #20)
> The interesting line there imho is the convert version check failed. There
> were
> recent changes to the ulimit script if I recall. I wonder if that's related

so it might be, that convert is executed in a wrong way because the version is not check correctly?
Maybe then the problem with PdfHandler is also caused by this.
Comment 23 Nemo 2013-01-24 20:16:02 UTC
(In reply to comment #21)
> Note that is an apache error not a mw error. Like most non wmf setups he's
> not
> using 404 thumb generation so that error message is just a standard thumb
> doesnt currently exist and wouldn't have much to do with the cause (unlike
> the
> thumb errors on wmf)

Ok, sorry.

(In reply to comment #20)
> The interesting line there imho is the convert version check failed. There
> were
> recent changes to the ulimit script if I recall. I wonder if that's related

Indeed https://gerrit.wikimedia.org/r/#/c/43405/ broke other things (see last comment, no bug filed as far as I know).
Maybe you have to raise $wgMaxShellWallClockTime ?
Comment 24 DaSch 2013-01-24 20:21:32 UTC
This could explain this

/bin/bash '/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh' 350 302400 302400 180 ''\''/usr/bin/convert'\'' -version'
/var/www/vhosts/wecowi.de/httpdocs/bin/ulimit5.sh: line 13: timeout: command not found
Comment 25 DaSch 2013-01-24 20:25:55 UTC
Okay I got it
The problem is, that the function timeout is not always installed
I don't know how it worked until now, but after installing timeout on my server it works now!
Comment 26 Bawolff (Brian Wolff) 2013-01-24 20:38:47 UTC
Hmm it appears (from what ive googled) timeout is a gnu specific program. (Not part of posix or whatever) we should check for its exisistence before using it for compatability with non-gnu unixes.
Comment 27 DaSch 2013-01-25 14:50:55 UTC
I have ubuntu installed on a vserver. The installations there are often very minimalistic and this could mean, that even when this is installed by ubuntu by default it must not be installed on a vserver with ubuntu. A warning / error message with instruction how to solve the problem should be added.
Comment 28 Aaron Schulz 2013-01-25 21:25:06 UTC
See https://gerrit.wikimedia.org/r/#/c/45898/

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links