Sunday, July 17, 2005

Building on the wisdom of the crowds

Chris Anderson posts some interesting thoughts on aggregation and recommendation systems:
Amazon and Google ... have built their brands on the power of their filters ... Google's search algorithms [and] Amazon's recommendations ... are nothing more than the wisdom of the crowds, the statistically measured opinions of millions of ... people. That's why we trust them.
Chris makes a great point. The power of people drives Amazon's and Google's systems. Algorithms may sort, sift, and aggregate the data, but the source of the knowledge is the actions of individuals.

Some talk about social software as if it is unique in the ability to tap into the wisdom of the crowds. Sharing is explicit in social software systems -- people have to explicitly state relationships and explicitly share recommendations -- so perhaps it is not obvious that there are more subtle ways to share this knowledge.

Systems like Amazon's recommendations and Google's PageRank implicitly share the wisdom of the crowds. Collaborative filtering-based systems like Amazon's recommendations use algorithms to find people with similar interests and share their wisdom. Google's PageRank algorithm mines the link graph -- links people made between web pages -- to surface authoritative and useful sources of information.

Implicit systems like Amazon's and Google's surface the wisdom of the crowds anonymously, quietly, and with no effort from users.

1 comment:

Edward said...

I guess sometimes it feels the whole world is in the room chatting away about this or that.

When something is great, perhaps even exceptional there is a distinct and clear chance it will now stand out and get noticed reasonably quickly.

What is not so simple is diversity and quality - being able to influence or learn from assets that exist with these tags has become something the global crowd can not help with.

These assets take longer to be noticed and we rely more on topic focused YASNs and feedback from members in their communities of practice.

When closed YASNs use similar algorithms to google and amazon we'll see them leverage their collective intelligence beyond that of the click-heads as JB would put it.