Last modified: 2014-09-14 07:18:23 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T46145, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 44145 - [Errors 992] Failed data retrieval shouldn't update "Last update" column
[Errors 992] Failed data retrieval shouldn't update "Last update" column
Status: ASSIGNED
Product: Wikimedia Labs
Classification: Unclassified
wikistats (Other open bugs)
unspecified
All All
: Normal enhancement
: ---
Assigned To: Daniel Zahn
http://wikistats.wmflabs.org/display....
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-01-19 09:18 UTC by Nemo
Modified: 2014-09-14 07:18 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments
800 alive wikis currently erroring out on wikistats (30.81 KB, text/plain)
2014-09-14 07:18 UTC, Nemo
Details

Description Nemo 2013-01-19 09:18:24 UTC
For instance one of the first wikis in the URL, wikitau, is currently down and IA last crawled it in May: http://web.archive.org/web/20120422190918/http://www.wikitau.org/index.php5/Accueil
But wikistats says that the information was last updated 13h ago.
There's little use in knowing when it was last attempted to update the data; if the column actually contained the "last update" date, it would be useful. In the future, it might also help identifying dead wikis, wikis with permanent problems, wikis to attempt updates for less often, etc.
Comment 1 Nemo 2013-01-19 09:22:45 UTC
Same for errors 991 due to lag, for instance
http://wikicafe.metacafe.com/en/api.php?action=query&meta=siteinfo&maxlag=5
  <error code="maxlag" info="Waiting for a database server: 14 seconds lagged">
(wikicafe is probably never not lagged, so my random click was particularly unlucky).
Comment 2 Daniel Zahn 2014-09-13 01:17:47 UTC
you know, that actually happens on the database level. the column for timestamp uses 'on update CURRENT_TIMESTAMP', so every time something is being touched, it also updates the timestamp. and in cases where fetching fails, there is also something to update, the http return code, which then also triggers the ts.


| ts                       | timestamp    | NO   |     | 0000-00-00 00:00:00 | on update CURRENT_TIMESTAMP |
Comment 3 Nemo 2014-09-14 07:18:23 UTC
Created attachment 16464 [details]
800 alive wikis currently erroring out on wikistats

(In reply to Daniel Zahn from comment #2)
> you know, that actually happens on the database level.

I don't challenge the technical correctness, but the timestamp can get quite useless for presentation to the users. If that's fine enough, maybe the focus should be instead on reducing such errors.

I run checkalive.py and out of 3159 rows with error 991 or higher there are at least 800 which actually seem alive, whose URLs I attach.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links