Last modified: 2014-11-07 23:04:00 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T68663, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 66663 - mwxml2sql fails for `mediawiki' versions above 1.21; patch posted for review
mwxml2sql fails for `mediawiki' versions above 1.21; patch posted for review
Status: PATCH_TO_REVIEW
Product: Datasets
Classification: Unclassified
General/Unknown (Other open bugs)
unspecified
PC Linux
: Normal blocker (vote)
: ---
Assigned To: Ariel T. Glenn
:
: 72886 (view as bug list)
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-06-16 13:27 UTC by wp mirror
Modified: 2014-11-07 23:04 UTC (History)
2 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description wp mirror 2014-06-16 13:27:04 UTC
0) Summary

`mwxml2sql' checks the `mediawiki' version, and aborts if out of the range 1.5 through 1.21. This is a show-stopper.

I posted a patch for your review. I should extend the upper bound to version 1.24.

1) Version

(shell)$ mwxml2sql --version
mwxml2sql 0.0.2
Supported input schema versions: 0.4 through 0.8.
Supported output MediaWiki versions: 1.5 through 1.21.

2) Patch

<https://gerrit.wikimedia.org/r/#/c/139413/>

Sincerely Yours,
Kent
Comment 1 Andre Klapper 2014-07-06 22:10:13 UTC
wp mirror: Thanks for the patch. If you fix the commit message in Gerrit (see http://www.mediawiki.org/wiki/Gerrit/Commit_message_guidelines ) to mention "Bug: 66663" there will be automatic notifications on this bug report.
Comment 2 Gerrit Notification Bot 2014-07-07 00:33:53 UTC
Change 139413 had a related patch set uploaded by Wpmirrordev:
Extend maximum allowed mediawiki version to 1.24 (Bug: 66663)

https://gerrit.wikimedia.org/r/139413
Comment 3 Gerrit Notification Bot 2014-07-30 13:38:51 UTC
Change 139413 had a related patch set uploaded by Qgil:
Extend maximum allowed mediawiki version to 1.24

https://gerrit.wikimedia.org/r/139413
Comment 4 Quim Gil 2014-07-30 13:40:26 UTC
(In reply to Andre Klapper from comment #1)
> wp mirror: Thanks for the patch. If you fix the commit message in Gerrit
> (see http://www.mediawiki.org/wiki/Gerrit/Commit_message_guidelines ) to
> mention "Bug: 66663" there will be automatic notifications on this bug
> report.

Ah, I just came to say this.  :)
Comment 5 Andre Klapper 2014-08-04 14:41:02 UTC
Ariel: Any chance to review the 20 lines patch in Gerrit?
Comment 6 Andre Klapper 2014-10-28 15:59:37 UTC
Ariel: Any chance to review the 20 lines patch in Gerrit?
Comment 7 wp mirror 2014-10-29 17:49:16 UTC
Dear Sirs,

1) Database Schema

Currently, MW 1.25 is being deployed. Can someone tell me if the database schema for MW 1.26+ is known at this time? If so, where is the information posted?

If possible, I would like to get ahead of the curve. Otherwise, we file bug reports every six months.

2) XML Dump format

I understand that the XML dump format will soon be updated to version 0.10. See
<https://bugzilla.wikimedia.org/show_bug.cgi?id=72417> and
<https://gerrit.wikimedia.org/r/#/c/168583/>.

This will also impact `mwxml2sql' which currently supports versions 0.4 through 0.8.

Sincerely Yours,
Kent
Comment 8 Andre Klapper 2014-10-29 18:06:21 UTC
That sounds like questions for https://lists.wikimedia.org/mailman/listinfo/wikitech-l instead of this bug report.
Comment 9 Sam Reed (reedy) 2014-10-29 18:10:02 UTC
(In reply to wp mirror from comment #7)
> Dear Sirs,
> 
> 1) Database Schema
> 
> Currently, MW 1.25 is being deployed. Can someone tell me if the database
> schema for MW 1.26+ is known at this time? If so, where is the information
> posted?
> 
> If possible, I would like to get ahead of the curve. Otherwise, we file bug
> reports every six months.

https://github.com/wikimedia/mediawiki/blob/master/maintenance/tables.sql

It won't be final until it's branched...
Comment 10 Sam Reed (reedy) 2014-11-02 18:08:54 UTC
*** Bug 72886 has been marked as a duplicate of this bug. ***
Comment 11 Sam Reed (reedy) 2014-11-02 18:10:51 UTC
0.10 is merged now, and will be going live on Wikimedia sites as of Wednesday
Comment 12 wp mirror 2014-11-07 02:42:25 UTC
Dear Sam,

XML dump files are still being generated using schema 0.9.

1) Need XML dump using schema 0.10

Do you know when (or where) I can have an XML dump file using schema 0.10? I would like to patch `mwxml2sql' right away; but I need an XML data dump file using schema 0.10 in order to test the patch before posting it to gerrit for review.

2) Patch ready for schema 0.9

I have ready a patch that brings `mwxml2sql' up to schema 0.9. I am using for production in-house. Should I post it now, or should I wait until I can bring it up to schema 0.10?

3) Usage of `mwxml2sql'

The previous question is motivated by a growing apprehension that I may be the only person using `mwxml2sql'. Is there any way (e.g. analytics) to determine the usage of `mwxml2sql'? Would you know if anyone is in a position to say which dump import utilities are best supported and most widely used?

Sincerely Yours,
Kent
Comment 13 Sam Reed (reedy) 2014-11-07 02:45:59 UTC
https://www.mediawiki.org/wiki/Special:Export/Main_page will give you something in the 0.10 format

That is the point of the XSD files - So you know what format it will be :)
Comment 14 Gerrit Notification Bot 2014-11-07 22:58:05 UTC
Change 171976 had a related patch set uploaded by Wpmirrordev:
Extend maximum allowed mediawiki version to 1.24

https://gerrit.wikimedia.org/r/171976
Comment 15 wp mirror 2014-11-07 23:04:00 UTC
Dear Sam,

1) Patch for schema 0.10

I just submitted <https://gerrit.wikimedia.org/r/171976>. It actually squashes two patches together (one old, one new). `mwxml2sql' can now handle mediawiki version up to 1.24 (old patch), and XML data dump schemas up to 0.10 (new patch).

2) Usage of `mwxml2sql'

I still would like to know if anyone else is using `mwxml2sql'. Is there any way to determine this?

Sincerely Yours,
Kent

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links