Last modified: 2014-10-27 11:36:48 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T73604, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 71604 - Map Warper - No space left on device
Map Warper - No space left on device
Status: NEW
Product: Tool Labs tools
Classification: Unclassified
Other (Other open bugs)
unspecified
All All
: Unprioritized normal
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-10-03 10:09 UTC by jeblad
Modified: 2014-10-27 11:36 UTC (History)
1 user (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments
Screendump of the error (59.14 KB, image/png)
2014-10-03 10:09 UTC, jeblad
Details

Description jeblad 2014-10-03 10:09:15 UTC
Created attachment 16658 [details]
Screendump of the error

Tried to warp
https://commons.wikimedia.org/wiki/File:Patroclus_Hirsch,_Christiania_By_og_dens_Marker,_1794_og_1795,_reproduksjon.tif#.7B.7Bint:filedesc.7D.7D

And got an "Out of space".

This file is ~200MB
Comment 1 Tim Waters 2014-10-03 11:07:18 UTC
Thanks - there was over 200mb left on the / partition however, it probably needed space in /tmp as well.

Will free up some space and move thumbnails (only using 100mb so far) over to shared project directory.
Comment 2 Andre Klapper 2014-10-03 11:31:16 UTC
What are steps to reproduce to "warp"? I'm not even sure which server this is about and how to be able to see the same outcome / steps to reproduce.
Comment 3 Tim Waters 2014-10-03 11:37:34 UTC
Okay I have moved the warper uploads, to shared project space, which left around 400mb in the /dev/vda1  partition. 

When the map is added it goes into /tmp first and I believe that this is being filled up causing the error

Smaller sized images won't cause the error, but larger ones will.

I think it's possible to change the tmp directory in the warper code. Will investigate. 



---


Andre - this is on warper.wmflabs.org part of the WikiMaps Commons Project. 

To reproduce one would need to click a link from the Commons template which had the map template included i.e. https://commons.wikimedia.org/wiki/File:Oslo_byarkiv,_Grosch_1830-%C3%A5rene,_001_001.tif

which goes to here: https://warper.wmflabs.org/wikimaps/new?pageid=35599439

which if the map is not in the warper, it would prompt the user to load it in, and it is at this stage that the error is seen.

Also the image itself would need to be large i.e. over 200mb  which is a small amount of the Commons maps - most are smaller and would work without error

Cheers,

Tim
Comment 5 Andre Klapper 2014-10-19 17:41:23 UTC
So is this something to fix in the warper project itself?
Or is this something to fix in the general Labs infrastructure for tools?
Comment 6 jeblad 2014-10-27 01:45:08 UTC
Still fails.

I think the map warper instance need more disk space.
Comment 7 Tim Waters 2014-10-27 11:36:48 UTC
it's due to the size of the /tmp partition, not the whole instance.

The whole instance has enough disk space, it's where /tmp resides which is filling up, but _temporarily_

_temporarily_ /tmp fills up when 1) the system requests a large file from commons and 2) the system converts it into a tif

/tmp then will clear out these temporary files, freeing up the space on that partition which is why smaller files run okay.


The fix would be to:

1) increase the size of the /tmp partition

2) change the application to use another partition for temporary files.

I believe #2 would be possible, but need to investigate properly.

Leave the issue open and as new until that has occurred.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links