Last modified: 2014-10-16 15:08:12 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T68362, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 66362 - Wikidata dump not available - out of space for dump
Wikidata dump not available - out of space for dump
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
Infrastructure (Other open bugs)
unspecified
All All
: Unprioritized normal
: ---
Assigned To: Nobody - You can work on this!
:
: 67922 (view as bug list)
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-06-09 07:05 UTC by Gerard Meijssen
Modified: 2014-10-16 15:08 UTC (History)
11 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Gerard Meijssen 2014-06-09 07:05:44 UTC
The latest Wikidata dump was ready on May 28, the dump should become available soon after this. It does not and consequently the statistics are already dated when they become available. 

Given that the numbers are followed to steer activity towards quality it would be really beneficial when the dumps become automatically available and it would be even better when a message / mail / tweet can be produced for those interested.
Thanks,
    GerardM 

http://dumps.wikimedia.org/wikidatawiki/
Comment 1 Lydia Pintscher 2014-06-22 09:49:32 UTC
There is a newer dump now on the link you provided. Is the issue that they are not available on tool labs?
Comment 2 Gerard Meijssen 2014-06-22 11:01:55 UTC
When the dumps become available on labs, the statistics are automagically created. 
Thanks,
    GerardM
Comment 3 Tim Landscheidt 2014-06-22 11:20:40 UTC
What did you except to happen?  What happened instead?
Comment 4 Gerard Meijssen 2014-06-22 11:35:44 UTC
Check out https://tools.wmflabs.org/wikidata-todo/stats.php it parses each dump when it becomes available. The data for two dumps is missing in the statistics and consequently the data cannot be analysed. We did use the data to determine our actions.
Thanks,
     GerardM
Comment 5 Tim Landscheidt 2014-06-22 12:05:18 UTC
You filed a bug against the Wikimedia Labs Infrastructure.  What did you except to happen there?  What happened instead?
Comment 6 Gerard Meijssen 2014-06-22 16:39:45 UTC
I expect that it gets proper attention. For me the processes of getting external data in their Labs place is part of the infrastructure.
Thanks,
    GerardM
Comment 7 Tim Landscheidt 2014-06-22 16:57:05 UTC
Okay, closing then as I can't understand what's wrong.  Please see http://www.chiark.greenend.org.uk/~sgtatham/bugs.html for how to report bugs effectively.
Comment 8 Gerard Meijssen 2014-06-22 17:16:48 UTC
Dumps are created outside of labs. They are moved by Labs staff to Labs. This is all I know and it has been done automagically until the move to the new datacentre. After that things were no longer done automagically.

What do you not understand?
Thanks,
    GerardM
Comment 9 Gerard Meijssen 2014-06-22 18:04:33 UTC
Learned from Tim that the files are automagically moved to /public/datasets/public/wikidatawiki

The question now is why does the script by Magnus not pick it up.
Thanks,
    GerardM
Comment 10 Andre Klapper 2014-07-12 14:55:13 UTC
*** Bug 67922 has been marked as a duplicate of this bug. ***
Comment 11 bgwhite 2014-08-04 20:56:54 UTC
Sorry, I don't know how to do all the fancy bugzilla text stuff.

I too reported the problem and was told my bug was a duplicate of #48894

Dumps have been dead for six weeks now, frustration is building with all the user complaints.
Comment 12 Andre Klapper 2014-10-16 12:57:41 UTC
Nowadays dumps exist and are created more than once per month:
  http://dumps.wikimedia.org/wikidatawiki/
Closing as WORKSFORME.
Comment 13 Tim Landscheidt 2014-10-16 15:08:12 UTC
There was new disk space (and a new server IIRC?) added, so it was FIXED (assuming this bug's topic essentially was an issue with /public/datasets/public).

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links