tag:blogger.com,1999:blog-6569681.post114237348449736314..comments2024-03-24T10:38:16.997-07:00Comments on Geeking with Greg: Beyond the commons: Personalized web searchGreg Lindenhttp://www.blogger.com/profile/09216403000599463072noreply@blogger.comBlogger5125tag:blogger.com,1999:blog-6569681.post-1142905468706789602006-03-20T17:44:00.000-08:002006-03-20T17:44:00.000-08:00Just a quick update: Microsoft also now appears to...Just a quick update: <A HREF="http://datamining.typepad.com/data_mining/2006/03/microsoft_deliv.html" REL="nofollow">Microsoft also now appears to be taking the Vivisimo route</A>, and offering more of a tool-based approach.. eliciting explicit feedback rather than implicit personalization.<BR/><BR/>And, as a funny example of what happens when things go wrong, <A HREF="http://www.buygoogle.com/2006/03/endangered-species-cookie-recipe.html" REL="nofollow">here is someone</A> who typed in "endangered species africa" into Google, and gets back Google's automatic "we will organize the world's information <I>for you</I>" set of links to <I>cookie recipes</I>. Lol.<BR/><BR/>So these things sometimes go wrong. And when they do go wrong, I would have much rather had a tool where I could have given feedback, and said "no" to cookie recipes, rather than have it automatically foisted upon me.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142585492045362572006-03-17T00:51:00.000-08:002006-03-17T00:51:00.000-08:00Greg,You may have seen this already, but Raul make...Greg,<BR/><BR/>You may have seen this already, but Raul makes some cases against personalization <A HREF="http://battellemedia.com/archives/002071.php" REL="nofollow">here</A>. While he is obviously biased, I think he has some valid points. The strongest being the one pointed out by jeremy already which is people are not static, and so personalization will fare poorly when it fails to catch up w/ my changing interests, or on one-off searches. <BR/><BR/>I do think personalization can be useful, but I would definitely also want an easy way to turn it off as well so I can see the unbiased global list. Also, would you build different profiles for different languages? (e.g., I often search in two different languages, some times more). <BR/><BR/>Great blog btw, I really enjoy your writings. Please keep up the good work. <BR/><BR/>yu-kuanAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142489074936062012006-03-15T22:04:00.000-08:002006-03-15T22:04:00.000-08:00I agree with Jeremy on the point re: an either / o...I agree with Jeremy on the point re: an either / or choice. I'm not sure Greg if you disgagree with this either.<BR/><BR/>One thing I did want to say is this: I'm finding Findory to have a real knack for finding posts that are right up my street. So whatever you're doing in the background is working. Thanks.<BR/><BR/>Do you fancy doing a podcast soon? If so, please ping me: alexbarn at thatbigsoftwarecompnayinredmond dot etc.<BR/><BR/>Alex.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142475903879233672006-03-15T18:25:00.000-08:002006-03-15T18:25:00.000-08:00One more comment on this: Ultimately, I don't thin...One more comment on this: Ultimately, I don't think this is an either/or choice. Just because you do tools doesn't mean you can't have any automatic, history-based personalization inferences. And vice versa. I could easily imagine a system that does its first ranking based on my history-inferred preferences, and then gives me tools/choices to either (1) return to the global, unpersonalized list, or (2) further personalize the list by giving explicit feedback on my current intent. So these two approaches are not mutually exclusive. It is when a search engine only takes one approach, to the exclusion of the other, that I think it becomes problematic.<BR/><BR/>Check out <A HREF="http://blog.searchenginewatch.com/blog/051003-124141" REL="nofollow">this article by Danny Sullivan</A>. The "New York hotel" example is telling. The issue is whether someone is looking for hotels in New York, or that are named New York (such as the one in Vegas). Let's suppose that I do a lot of business travel to New York, so my own personal behavior tends to favor the former interpretation. But now suppose I now travel to Las Vegas once, for a conference. The behavior-based personalized search is going to say "well, all the other times, he meant <I>in</I> New York, so that's what I'll give him again this time." And so the user's query will fail. And the user will have no way of modifying those results, except perhaps to turn off personalized search. And when that doesn't work either, because most hotels in the world are in New York and not named New York, the user will be at a dead end, and frustrated. <BR/><BR/>Oh, one more thing I just noticed: Look at Google blog search. They are now offering yet another tool/widget: Sort by relevance vs. Sort by date. This is an explicit feedback widget, something Google expects users to go out of their way to use. They're not doing the implicit thing, where they say "oh, this person mostly wants popular, or mostly timely, blog information", and making that decision for you. They are offering you a way of explicitly making your information need clear. <BR/><BR/>This is good. I hope we see more of this.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142460424998652662006-03-15T14:07:00.000-08:002006-03-15T14:07:00.000-08:00(Before I launch into this again, I want to just a...(Before I launch into this again, I want to just ask you to please tell me to stop leaving comments if I'm going overboard here. I don't want to fill this space up if I'm not being useful.)<BR/><BR/>So.. thanks for the post. Good paper. And yeah, Sue Dumais. Venerable IR researcher. Her experience and expertise certainly carries a lot more weight than my own.<BR/><BR/>However, as I read through it, I realized that the only experimentally verified result in the paper centered around this idea: "<I>For example, the Trailblazer example above did not clarify exactly what kind<BR/>of information (e.g., pricing or safety ratings) was sought. This suggests searchers either need help communicating their intent or that search systems should try to infer it.</I>"<BR/><BR/>This is essentially the point on which you and I agree as well: Personalization is needed. The issue, however, is <I>how</I> this personalization is done. Should the system help the user more clearly express their intent? (my approach) Or should the system automatically infer that intent, from past user behavior? (your approach)<BR/><BR/>Teevan/Dumais/Horvitz do not experimentally verify either of these approaches. They only express a preference for the 2nd method, and a preference against the 1st method. They do cite a number of papers to support their preference. But I would have to go and read those papers before I would be able to discuss this more.<BR/><BR/>However, <A HREF="http://ciir.cs.umass.edu/pubfiles/ir-279.pdf" REL="nofollow">there is also work</A> from 2002-2003 that shows no real improvement using search histories/behavior for personalization. So what does that say about the history-inferred approach? Well, it's only one datapoint right now, so not much. But I think the jury is really out on the tools/explicit feedback approach, too. I hear all the time that users are too lazy to use tools. But I also read about how when Google introduced the spelling correction feedback tool (force users to explicitly click it, rather than try to "personalize" or correct it automatically), traffic literally doubled. And only after they put the tool in the "right" place, too. People use it like mad. And that seems to lend credence to the tools camp.Anonymousnoreply@blogger.com