Last modified: 2013-03-20 17:39:28 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T47234, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 45234 - Fix rebuildTermSearchKey script.
Fix rebuildTermSearchKey script.
Status: VERIFIED FIXED
Product: MediaWiki extensions
Classification: Unclassified
WikidataRepo (Other open bugs)
unspecified
All All
: High major (vote)
: ---
Assigned To: Wikidata bugs
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-02-21 15:54 UTC by Daniel Kinzler
Modified: 2013-03-20 17:39 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Daniel Kinzler 2013-02-21 15:54:23 UTC
The rebuildTermSearchKey script needs fixes for several issues. Not that the core of the functionality is implemented in TermSqlCache::rebuildSearchKey(). 

The most important issues are:

* The batch size is hardcoded to 10. It should be configurable (ideally, using a command line option, passed as a parameter to rebuildSearchKey). The default should be at least 100, maybe 1000 (ask Asher?).

* The continuation between batches is ambiguous. We have term_row_id now, use that instead of trying to sort and select by *all* fields.

* Use a logging callback to report progress (e.g. a dot per batch, or some such).

* To allow for nicer handling of options, logging, etc, rebuildSearchKey() could be factored out into a separate class, so these things could be injected via the constructor instead of being function arguments.

There also seems to be a fatal error related to the issue addressed in Idbf67b96, but I'm not sure how that is related.
Comment 1 Daniel Kinzler 2013-02-21 17:03:19 UTC
One more thing: the script needs to take a continuation ID from the command line, so it can be re-started in case it broke.
Comment 2 Anja Jentzsch 2013-03-20 14:40:06 UTC
Change I4d2b9fca: Rewrite of rebuildTermSearchKey

Change I9eb2735b: rebuildTermSearchKey should wait for slaves.

Both are merged and this fixes the rebuildTermSearchKey script.
Comment 3 abraham.taherivand 2013-03-20 17:39:28 UTC
Verified in Wikidata demo sprint 35-2

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links