Last modified: 2014-01-13 20:21:59 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T61721, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 59721 - Provide Redis feed of recent changes for Wikimedia wikis
Provide Redis feed of recent changes for Wikimedia wikis
Status: NEW
Product: Wikimedia Labs
Classification: Unclassified
Infrastructure (Other open bugs)
unspecified
All All
: Low enhancement
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks:
  Show dependency tree / graph
 
Reported: 2014-01-06 14:53 UTC by Tim Landscheidt
Modified: 2014-01-13 20:21 UTC (History)
5 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description Tim Landscheidt 2014-01-06 14:53:17 UTC 
Several tools on Tools and probably some on Labs digest the IRC feed of recent changes for Wikimedia wikis to act on/process/filter/etc.

Recently, the RedisPubSubFeedEngine feed engine was added to MediaWiki.  It would be nice to use this to set up a more reliable and supported way to feed recent changes to tools in the Labs/Tools project.

With Redis replication available, one Redis collector would gather all recent changes in the cluster, properly firewalled, and then provide this feed to probably multiple slaves in Labs that can be accessed from any Labs/Tools host.  As the bandwidth and CPU cycles already exists for the IRC readers, the infrastructure should be able to handle this.

Apparently, by default RedisPubSubFeedEngine posts all recent changes to a channel "rc".  This would need to be prefixed à la "#en.wikipedia".
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links