Last modified: 2013-03-06 04:48:00 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T45343, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 43343 - Move transcoded videos out of thumbs containers
Move transcoded videos out of thumbs containers
Status: RESOLVED FIXED
Product: MediaWiki extensions
Classification: Unclassified
TimedMediaHandler (Other open bugs)
unspecified
All All
: Normal normal (vote)
: ---
Assigned To: Jan Gerber
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2012-12-22 14:44 UTC by Faidon Liambotis
Modified: 2013-03-06 04:48 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Faidon Liambotis 2012-12-22 14:44:32 UTC
We currently have two main types of containers, "originals" and "thumbs". My understanding is that uploaded videos got into "originals" and transcoded variants of those into "thumbs".

Transcoded videos are obviously not original content, however their characteristics are very different from those of thumbnails: they're on the opposite end of the file size spectrum and it's not that easy/cheap to just regenerate them.

This affects various choices that we make and will make on the infrastructure in the future: whether we should store thumbs in file storage or just cache them, how many replicas of thumbs we should keep, if we should have a separate caching layer for videos etc.

My idea was on having a third container type for "videos", for both original and transcoded content. I suppose could also have two, one for original videos and one for transcoded videos.

But I don't have a strong opinion on how it should be done. What do people think?
Comment 1 Jan Gerber 2012-12-28 16:36:41 UTC
this would require changes to core, File right now does not allow setting any other location. for transcodes TMH uses getThumbPath this could be changed to point to another zone, not sure if this will cause issues in other places right now.
Comment 2 Jan Gerber 2013-01-22 10:25:01 UTC
https://gerrit.wikimedia.org/r/#/c/45102/
adds a "media" container to core that can be used for audio/video derivatives

https://gerrit.wikimedia.org/r/#/c/45101/
makes TMH use the media container if available to store derivatives,
it also comes with a maintenance script to move all derivatives to the media container for migration.

storing originals in another container is not possible since this would depend on the media handler and the current upload logic does not know about that.
Comment 3 Alex Monk 2013-02-08 16:35:03 UTC
Both of those were merged by Aaron Schulz on the 5th. Is this bug resolved now?
Comment 4 Alex Monk 2013-02-16 22:23:15 UTC
Let's assume it is then.
Comment 5 Faidon Liambotis 2013-02-17 00:11:17 UTC
The patches were merged but a) there are more changes pending, b) the videos need to be actually moved via a maintenance script.
Comment 6 Jan Gerber 2013-03-06 04:48:00 UTC
bug 45294 is fixed now so the migration is done.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links