tag:blogger.com,1999:blog-6569681.post8390004125835153846..comments2024-01-15T13:17:33.771-08:00Comments on Geeking with Greg: Evaluating search result pagesGreg Lindenhttp://www.blogger.com/profile/09216403000599463072noreply@blogger.comBlogger2125tag:blogger.com,1999:blog-6569681.post-59116108918888414382008-10-24T12:41:00.000-07:002008-10-24T12:41:00.000-07:00I had a nice conversation with Marti Hearst about ...I had a nice conversation with Marti Hearst about the question of defining "user satisfaction" at the HCIR workshop, after Raman Chandrasekar's talk about search experience satisfaction.<BR/><BR/>Chandra suggested that user are satisfied when they use a system because they want to, rather than because they have to. I'm inclined to agree, and suspect that the best way to measure satisfaction with a tool or application is based on whether users voluntarily continue using it.<BR/><BR/>The only catch is that, in order to measure satisfaction this way, you have to mitigate status quo bias, making the adoption vs. switching costs as even as possible. For example, require someone to use a new tool for a week, and then ask them if they want to continue using it or go back to their more familiar tool.Daniel Tunkelanghttps://www.blogger.com/profile/10240432137428080022noreply@blogger.comtag:blogger.com,1999:blog-6569681.post-58151268810264659422008-10-24T10:57:00.000-07:002008-10-24T10:57:00.000-07:00But what if I am doing a search, just to check a s...But what if I am doing a search, just to check a simple fact. I click the link, verify the fact, and then close/exit the page almost immediately. The page could be very relevant, but because I am in "fact validation" mode, my clickstream behavior is different.<BR/><BR/>Similarly, what if I am in exploratory search mode? Ie.. what if I am trying to learn more about a topic. Then I will be clicking *lots* of links. And spending lots of time on those pages, and maybe even going further from some of those pages by following their links.<BR/><BR/>But in the end, only some of those pages that I've spent a lot of time on are going to be relevant, and many are going to be non-relevant. But my click-behavior on both will be the same, because I am in exploratory mode. <BR/><BR/>Does this mean that people doing click-based analysis and evaluation completely ignore entire swaths of information seeking behaviors?Anonymousnoreply@blogger.com