Based on ideas from friends and family who share our interest in online politics, we built the Political Video Barometer as a fun and informative way to discover what videos liberal and conservative bloggers are writing about. You can use it to watch and track videos linked-to by bloggers who share your opinions or view clips popular with your political "enemies."
But how does it work?
The videos shown in the Barometer are chosen by queries against a large database built by network analysis engines from Morningside Analytics. Every few months a crawler (or "spider") visits millions of blogs and collects their contents and links.
Next, a program mines the links in these blogs and, using advanced graph mathematics, groups the blogs based on two criteria: how do blogs link to one-another (primarily via their blog rolls), and, over time, what else do the bloggers link to in common?
These groups are called "Attentive Clusters." Clusters can be large or small, and the bigger ones can contain many sub-clusters and even sub-sub-clusters.
Only after the machines have mapped out the high level clusters, do we bring in some live eyeballs so we can figure out what the blogs in a cluster have in common. But we do not need to look at very many: from as few as 10 to 20 blogs in a cluster, we can determine what the cluster is all about.
As shown on the left, American liberal bloggers and American conservative bloggers form the two largest clusters in the English language blogosphere, and the Barometer draws upon roughly the 8.000 "most linked-to" blogs in each of these clusters to position the videos on the graph.
Still another program feeds the Barometer by scanning these 16,000 blogs every six hours, looking for new links to YouTube videos (or YouTube videos embedded right in the blogs). By counting these links we learn what videos political bloggers are promoting. Some videos are linked to almost exclusively by liberal bloggers, some are linked to mostly by conservative bloggers, and a few are linked to more or less evenly by both groups. Once the program determines that a video has traction in the political clusters, it scans through other parts of the blogospere to count how many "non-political" bloggers link to it as well.
The Political Video Barometer is just one illustration of the insight we gain and applications we build from Morningside's data and engines. We can look at altogether different groups (technology, celebrity gossip, etcetera) or identify new sub-clusters of particular interest. We program custom, data-driven applications and write deep quantitative reports for both planning and monitoring campaigns of all kinds.