Last modified: 2014-09-06 01:54:39 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T61718, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 59718 - Import 2013 wikiteam list of independent mediawikis
Import 2013 wikiteam list of independent mediawikis
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
wikistats (Other open bugs)
unspecified
All All
: Unprioritized enhancement
: ---
Assigned To: Daniel Zahn
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-01-06 13:59 UTC by Nemo
Modified: 2014-09-06 01:54 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Nemo 2014-01-06 13:59:34 UTC
Please import the missing wikis from this list: https://wikiteam.googlecode.com/svn/trunk/listsofwikis/mediawikis_2013_checked.txt note that it has some overlap with Pavlo's list in the same directory, which was already imported previously.
Comment 1 Daniel Zahn 2014-08-30 01:00:14 UTC
fwiw, arbitrary string "See the schedule at [[Wikimedia Foundation Annual Plan]]." in there

hmm.. some are ending in index.php, not api.php, i would like one type only, the api.php ones..
Comment 2 Daniel Zahn 2014-08-30 01:20:07 UTC
total number in list: 13220 

ending in api.php: 10268

reduced list to SQL: for wiki in $(cat mediawikis_2013_checked_api.txt); do echo "INSERT IGNORE INTO mediawikis (statsurl,method) VALUES (\"$wiki\",\"8\");"; done > mediawikis_2013_checked_api.sql

mysql wikistats < mediawikis_2013_checked_api.sql

duplicates are skipped, results in new wikis without names in the table:

8997

importing new wikis, get names and stats from APIs:

sudo -u wikistatsuser /usr/bin/php /usr/lib/wikistats/update.php mw import

(which is a special import run that also sets the name)

minimal fix to the import itself: https://gerrit.wikimedia.org/r/#/c/157322/

now running ...

A(126/8992)
Comment 3 Nemo 2014-08-30 05:53:40 UTC
Wow! Great.
Comment 4 Daniel Zahn 2014-09-06 01:54:39 UTC
and after it was finished running it said:

6188 wikis succesfully imported.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links