Last modified: 2012-06-08 20:49:55 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T39089, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 37089 - My IP has been banned because I overused the API
My IP has been banned because I overused the API
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
Site requests (Other open bugs)
unspecified
All All
: Normal normal (vote)
: ---
Assigned To: Nobody - You can work on this!
: ops
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2012-05-24 15:20 UTC by Romain Guillebert
Modified: 2012-06-08 20:49 UTC (History)
9 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Romain Guillebert 2012-05-24 15:20:34 UTC
Hi

My IP (193.54.67.101) was banned because I overused the mediawiki API, I wrote my program using the scrapy library which runs up to 8 requests in parallel by default, I've changed that so it runs the requests linearly. I now use the maxlag parameter as well.

Would it be possible to have my IP unbanned ?

Thanks
Romain
Comment 1 Antoine "hashar" Musso (WMF) 2012-05-24 16:58:51 UTC
On which wiki were you banned?

fr.wikipedia.org does not show any block for that IP.
Comment 2 Romain Guillebert 2012-05-24 17:00:39 UTC
No I sent requests to the english one, however it seems that the IP is banned for the french one as well
Comment 3 Platonides 2012-05-24 17:06:34 UTC
If he's really banned for excesive API usage (he won't even view wikipedia pages), his ip will have been blocked at squid config.
Comment 4 Romain Guillebert 2012-05-24 17:14:05 UTC
Yes, I can't ping the servers either
Comment 5 Mark A. Hershberger 2012-05-24 18:15:29 UTC
(In reply to comment #4)
> Yes, I can't ping the servers either

ops issue?
Comment 6 Romain Guillebert 2012-05-24 18:27:12 UTC
I don't know if it can help but if I ping from another server in the same IP range, it works
Comment 7 Antoine "hashar" Musso (WMF) 2012-05-24 19:04:30 UTC
(In reply to comment #5)
> (In reply to comment #4)
> > Yes, I can't ping the servers either
> 
> ops issue?

Definitely an ops ban. Lets open a RT ticket since ops never looks at +ops tickets.
Comment 8 Antoine "hashar" Musso (WMF) 2012-05-24 19:09:16 UTC
RT : https://rt.wikimedia.org/Ticket/Display.html?id=3024

That is the private bug system for operations.
Comment 9 Romain Guillebert 2012-05-27 13:48:27 UTC
Hi

Do you have any update ?

Thanks
Comment 10 Romain Guillebert 2012-06-07 11:37:43 UTC
Hi

It seems that I can now reach the server (I can ping and do HTTP requests), however the server now sends an error 403 when I make requests.

Regards
Romain
Comment 11 Ariel T. Glenn 2012-06-08 07:03:52 UTC
I unbanned at the squid level, please check your access now.
Comment 12 Romain Guillebert 2012-06-08 08:30:47 UTC
It works :)

Thanks a lot
Romain
Comment 13 Antoine "hashar" Musso (WMF) 2012-06-08 18:48:33 UTC
Thanks Ariel :-]
Comment 14 Sumana Harihareswara 2012-06-08 18:50:38 UTC
For future reference :-)  https://www.mediawiki.org/wiki/API:Etiquette
Comment 15 Romain Guillebert 2012-06-08 19:48:01 UTC
I knew that, but I didn't know that my scrapping library was doing 8 requests in parallel by default :)
Comment 16 Platonides 2012-06-08 20:47:44 UTC
Which library was that? It doesn't seem like a good default.

See for instance how until a few years ago, the browsers were still using the hint of rfc2616, 8.1.4 of not keeping more than 2 connections open to a given server.
Comment 17 Romain Guillebert 2012-06-08 20:49:55 UTC
It's called scrapy, you can see the setting defined there http://doc.scrapy.org/en/0.14/topics/settings.html#concurrent-requests-per-domain

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links