Talk on Amazon.com A/B testing

Two former Directors of the Personalization group at Amazon.com, Ronny Kohavi and Matt Round, jointly gave a talk called "Front Line Internet Analytics at Amazon.com" (PDF) at EMetrics in 2004.

I think the talk is most likely to be of interest to people starting on slide 10 when it goes into details about Amazon.com's A/B testing framework and the results of past tests.

By the way, Ronny Kohavi is now the GM of Microsoft's Experimental Platform. That group seeks to "enable product groups at Microsoft and developers using Windows Live to innovate using controlled experiments with live users."