Last modified: 2014-02-12 23:40:05 UTC
I was trying to download the latest MediaWiki installer from <http://dumps.wikimedia.org/mediawiki/1.20/mediawiki-1.20.2.tar.gz> and it was going super-slow (about 25 KB/sec). My connection seems to be fine. When I tried to debug the issue, at one point <http://dumps.wikimedia.org/mediawiki/1.20/mediawiki-1.20.2.tar.gz> threw a 403 Forbidden error. Something seems a bit off.
MZMcBride asked me to test it, so using wget my average speed was 47.3 KB/s and it took a total of 6m 18s.
<carl-m> I am getting really slow download speeds from dumps.wikimedia.org to the toolserver - slow like 68KB/sec . Is that expected?
Right now it's very fast, it saturates my home connection and is about 10 MiB/s on Toolserver: lowering priority. At the time this bug was filed, and for several days on, people from several different places had super-slow download as reported; Ariel didn't see any obvious network problem, and there were people happily downloading at 5 MiB/s. We also suspected the sitenotice on es.wiki in early January making people download Kiwix's ZIM files mirrored on dataset2, but the network graphs don't show any big peak (plus, Kelson comments that his personal server has about the same traffic, just for Kiwix): <http://ganglia.wikimedia.org/latest/?r=year&cs=&ce=&c=Miscellaneous+pmtpa&h=dataset2.wikimedia.org&tab=m&vn=&mc=2&z=medium&metric_group=ALLGROUPS> However, at the moment CPU nice is 6 times the yearly average (7,92 vs. 1,33) and CPU wio 3 (9,92 vs. 3,61).
Danny_B> dumps site is slow... downloading small rss file takes 10 secs... :-/ Network activity for dataset2 only 30 MB/s now vs. 50 average, download of a big files starts at some 10 KB/s speed for a while and eventually is something like 2-300 on Toolserver.
(In reply to comment #3) > However, at the moment CPU nice is 6 times the yearly average (7,92 vs. 1,33) > and CPU wio 3 (9,92 vs. 3,61). This seems to vary with little effect on download speed. The only other change I can see in ganglia is that, about the time this bug was filed, ~2 TB were freed on disk. <http://ganglia.wikimedia.org/latest/graph.php?c=Miscellaneous%20pmtpa&h=dataset2.wikimedia.org&v=7317.328&m=disk_free&r=year&z=default&jr=&js=&st=1361113707&vl=GB&ti=Disk%20Space%20Available> From the weekly graph it would seem that something managed to pull 60 MB/s about a week ago, which matches the observation that while download is very slow for most people there are still some who manage to download very very quickly.
