Last modified: 2014-10-24 14:52:12 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T63784, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 61784 - Detect image loading from production, pull those images into beta cluster
Detect image loading from production, pull those images into beta cluster
Status: RESOLVED WORKSFORME
Product: Wikimedia Labs
Classification: Unclassified
deployment-prep (beta) (Other open bugs)
unspecified
All All
: Low enhancement
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2014-02-21 22:59 UTC by Greg Grossmeier
Modified: 2014-10-24 14:52 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Greg Grossmeier 2014-02-21 22:59:07 UTC
Specifically because of this:
http://en.wikipedia.beta.wmflabs.org/wiki/Template:Wikipedia%27s_sister_projects

The icons come from upload.wikimedia.org

Same issue other places as well, eg:
http://en.wikipedia.beta.wmflabs.org/wiki/Hurricane_Celeste_%281972%29
which loads the acrobat.gif from upload.wikimedia.org
Comment 1 Greg Grossmeier 2014-03-20 17:22:17 UTC
See also bug 37245 (previous version of this bug)
Comment 2 Greg Grossmeier 2014-03-20 17:50:15 UTC
Oh, that's smarter than I thought...

So, if the file is available on upload.beta, the it's served from there. If it isn't, it fails over to upload.wikimedia? Not bad.

Renaming bug and resetting priority to clarify the new goal :)

The ideal (something like):
1. Define a set of pages that are high use in (auto/manual) testing
2. Detect (daily?) any image loads from those pages that are from production
3. Fetch them from production and put them into beta cluster
Comment 3 Antoine "hashar" Musso (WMF) 2014-10-24 14:52:12 UTC
We do have instant commons and the foreignApi backend file system of doom. So in theory all images are looked locally on beta cluster, then on beta commons and finally on the production commons.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links