In my last blog entry, I shared some nodejs-code to read CouchDB’s _changes feed and publish the data to a website. In order to update the page in a continous fashion, I used socket.io which provides a nifty abstraction across server- to client-side transports — for example, websockets and ajax longpoll. Full-throttle When we tested the code for a few days over the weekend, the largest issue we ran into was that the stream moved too fast....
I recently had the extreme pleasure to use node.js and socket.io on a project. Here are some insights. Objective So the objective of the project was to read data from the _changes feed of our CouchDB cluster (hosted by Cloudant) and publish the data to a widget which we can use to display a constant stream of “what are people doing right now”. The core of the problem we faced was not just taking this stream of data and feeding it on to a page, but since we’ll deploy this widget to our homepage we needed to make sure that no matter how many clients see it, the impact on the database cluster is minimal; for example, it would be a single client (or down the road up to three for failover) who actually read data from the cluster....