October 10, 2008

latent semantic politics, or red v. blue

Andy Baio and Joshua Schachter today shipped Memeorandum Colors, a Firefox extension and Greasemonkey script that helps you visualize political bias of the sites linked to on Memeorandum.

With the help of del.icio.us founder Joshua Schachter, we used a recommendation algorithm to score every blog on Memeorandum based on their linking activity in the last three months. Then I wrote a Greasemonkey script to pull that information out of Google Spreadsheets, and colorize Memeorandum on-the-fly. Left-leaning blogs are blue and right-leaning blogs are red, with darker colors representing strong biases.

Andy’s post is worth reading; as he usually does he describes in detail their methodology for crawling Memeorandum, analyzing link relationships using the Singular Value Decomposition method (on top of NumPy, btw) to discover political bias, and then stitching together a Greasemonkey coloring script using Google Docs, its ability to output XML and some simple XMLHttpRequest. Voila, latent semantic politics[1].

What’s incredibly cool is what you see after you install the extension / script.

Memeorandum-colors

Memeorandum suddenly became about ten times better for me, because now the discussion links are more interesting than the main stories. The blue and red highlighting make me want to click through to see what a “deep red” blogger is saying about Obama, or a “deep blue” blogger is saying about McCain…and I’m now diving into more interesting conversations.

[1] Hat tip to David Jacobs for that lovely phrase. And I can’t believe I actually said “hat tip.”