Last modified: 2014-10-22 06:09:25 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T61742, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 59742 - Respect wikisite and EditThis throttling
Respect wikisite and EditThis throttling
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
wikistats (Other open bugs)
unspecified
All All
: Normal major
: ---
Assigned To: Daniel Zahn
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-01-06 23:28 UTC by Robert Hanke
Modified: 2014-10-22 06:09 UTC (History)
3 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Robert Hanke 2014-01-06 23:28:18 UTC
See http://wikistats.wmflabs.org/display.php?t=et&s=http_desc
The utmost of them work in the browser.
Comment 1 Nemo 2014-01-24 21:57:05 UTC
That's because they have a very aggressive throttling, like wiki-site.
Only 1 request every 60 seconds is allowed on EditThis, more or less. On wiki-site I usually make 1 every 240 s even.
It's easy to sleep more, but if the cronjobs are daily I'm not sure how long each of them can last. Probably we'd need to stop after a certain amount of hours, or something.
Comment 2 Daniel Zahn 2014-08-29 23:30:17 UTC
yep, there are currently no cron jobs for wikisite and editthis until this is resolved somehow
Comment 3 Daniel Zahn 2014-08-29 23:31:25 UTC
Robih, feel like calculating that? <current number of wikis> x <seconds we have to wait> .. is that under or over 24h?
Comment 4 Robert Hanke 2014-08-29 23:40:28 UTC
WikiSite needs to allow us an interval of 72 seconds to get around in 48 hours.
EditThis needs to allow us an interval of 257 seconds to get around in 96 hours.
Comment 5 Gerrit Notification Bot 2014-10-11 00:55:03 UTC
Change 166162 had a related patch set uploaded by Dzahn:
add a delay between updates for wikisite/editthis

https://gerrit.wikimedia.org/r/166162
Comment 6 Gerrit Notification Bot 2014-10-11 01:06:23 UTC
Change 166162 merged by Dzahn:
add a delay between updates for wikisite/editthis

https://gerrit.wikimedia.org/r/166162
Comment 7 Gerrit Notification Bot 2014-10-11 01:17:11 UTC
Change 166164 had a related patch set uploaded by Dzahn:
add update cronjobs for wikisite/editthis

https://gerrit.wikimedia.org/r/166164
Comment 8 Gerrit Notification Bot 2014-10-11 01:18:37 UTC
Change 166164 merged by Dzahn:
add update cronjobs for wikisite/editthis

https://gerrit.wikimedia.org/r/166164
Comment 9 Daniel Zahn 2014-10-11 01:20:09 UTC
thanks! .. so i:

added delay:

https://gerrit.wikimedia.org/r/#/c/166162/

added cron jobs:

https://gerrit.wikimedia.org/r/#/c/166164/

please keep an eye on them over the weekend. let's just see how far it gets
Comment 10 Nemo 2014-10-11 10:01:05 UTC
(In reply to Daniel Zahn from comment #9)
> please keep an eye on them over the weekend. let's just see how far it gets

Since this morning (9 UTC) it seems to be going well, Before that, only an endless spiral of 503 errors in quick succession, last ones being 2014-10-10 15:23:19 / 2014-10-10 15:23:20
Comment 11 Nemo 2014-10-22 06:09:25 UTC
Seems to have worked well! Only a few dozens wikis errored out now.
http://wikistats.wmflabs.org/display.php?t=et&s=http_desc
http://wikistats.wmflabs.org/display.php?t=si&s=http_desc
wiki-site shows some 1200 wikis with 302, seemingly some now-deleted wikis; separate issue.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links