API:Recent changes stream

You can use EventSource in a web browser, or any other EventSource / HTTP client, to subscribe to the firehose of change events from Wikimedia sites. More details at wikitech:EventStreams

A core MediaWiki feature is that all changes to pages are visible: you can see who made what change to a page. On an active wiki, the overall pattern of activity is as interesting as the specific changes to pages: you can see spikes in overall activity, sudden interest in particular pages in response to news events, when editors are active, etc.

On MediaWiki wikis, the page Special:RecentChanges lists these changes. So you could reload this page and scan it to look for patterns. But there's a better way.

stream.wikimedia.org broadcasts all changes to all public wikis run by Wikimedia Foundation to clients over HTTP via wikitech:EventStreams.

For years, the only recent changes feed was IRCColourfulRCFeedFormatter.php, which sent formatted IRC (Internet Relay Chat) messages to an IRC daemon on irc.wikimedia.org that broadcasted changes on various IRC channels.

In 2017, wikitech:EventStreams was launched to expose arbitrary stream data over HTTP. This service replaces RCStream (described below). It uses the same JSONRCFeedFormatter.php to format RecentChanges, but also has the ability to resume from a older stream position, and also to expose more streams than just RecentChanges. Manual:RCFeed describes the properties of the change, which include the title of the page, the editor's comment about the change, the old and new revision IDs, the old and new length of the page, etc.

"EventStreams" on Wikitech describes the API.

See codepen.io/ottomata/pen/VKNyEw/ for a simple demo. It uses the EventSource library to connect with the stream and displays each change.

There are many implementations of EventSource clients. The EventStreams page shows an equivalent code samples in Python and NodeJS.

When MediaWiki writes a change to the RecentChanges page, it also calls notifyRCFeeds(). The $wgRCFeeds lets you configure different kinds of recent changes feeds, with different kinds of formatting. includes/rcfeed in core has their implementation. If you run a wiki of your own and would like to adapt these visualizations and monitors to it, you can enable similar feeds to a similar client that publishes changes over HTTP, WebSockets or on an IRC channel. As usual, all aspects of WMF's setup are free and open source.

The regular MediaWiki API has various modules that report on changes. These use a "pull" model, you make an API request asking for changes rather than consuming a stream of changes "pushed" over HTTP, WebSockets or IRC.

This module provides changes to pages as an RSS feed. The feedformat you specify (atom or RSS, both XML output) determines the format of the API response, overriding the format parameter

For example, to request a feed of 14 days of changes in Category:Open requests for comment, excluding edits marked as "bot" edits, in the Atom format:.

For more information, see Special:ApiHelp/feedrecentchanges.

You can use this to query for changes. It doesn't generate the same
← Older revision Revision as of some date
output as feedrecentchanges, but it provides the revision IDs of page changes and can provide other information. To make a similar kind of request as the feedrecentchanges example above, use a generator of categorymembers=Category:Open request for comment. (Broken?)

Query recentchanges for pages in Category:Open requests for comment, excluding bot edits, in recent time.

For more information, see Special:ApiHelp/query+recentchanges.

Real-Time Recent Changes is a JavaScript tool that uses the recentchanges query module to monitor recent changes of a wiki in real-time.

• wikitech:EventStreams – the program that broadcasts changes over HTTP
• wikitech:stream.wikimedia.org – the domain where EventStreams is available in production