Findory just launched a new alpha test version of its personalized web search. You can get to it by using the search box in the upper right corner of the screen and selecting "Web" from the drop down menu.
In the web search results, any item with a personalized icon after the title is recommended by Findory. Findory recommends and reorders web search results based on each person's previous searches, the search results on which that person has clicked, and what other web searchers have found interesting.
The obvious question to ask about this is whether it is effective. That is somewhat hard to answer given the data, traffic, and resources of a tiny startup, but I do have some evaluation numbers.
My initial analysis used a larger data set and attempted to determine how often personalized web search could narrow in on the result on which the searcher would click. In this test, 52% of the time, the item that would be clicked was in the candidate recommendation set.
This first test merely shows that there is potential to recommend the item that would be clicked. It does not say that the recommender would successfully identify that item over other items or that, in reordering the search results, that it would not improperly reduce the rank of the to be clicked item by promoting other, less important items.
The second, more complicated analysis tried to get to these questions. It fired off queries to Google, reordered the results using the recommendations, and then looked at the new ranking of the item which would be clicked.
The results from this were promising. 32% of the time, the clicked result was in the top 5 of the reordered search results, slightly higher than the norm for the unchanged Google search results. About 3% of the time, the reordering moved the clicked result to the top slot or one of the top 5 slots when it was not there already. Only 1% of the time did it move the clicked item from the top slot (not a good thing to do), and it never moved the clicked item out of the top 5 results.
Because major search engines have limits on being hammered with queries, I was only able to run this second analysis over a small randomized sample of 500 queries. A longer run would be desirable, as would being able to A/B test variants on the algorithm under heavy, live traffic. As a tiny startup, both are impossible, at least for now.
If you want to try out Findory personalized web search, you can get to it using the search box of at the top right corner of every Findory page. Select "Web" from the drop down, enter your query, and look for results with a personalized icon after the title. Click on a few search results if you like, then search again or for the same or a related term.
Here are direct links to a few searches -- "video games", "amazon", "windows live" -- to get you started.
Please take it easy on this. It is pretty cool, but it is just an alpha stage product by a tiny little startup. I hope you enjoy trying it, and please let me know if you have any thoughts or comments.
Update: If you find yourself getting kicked out to a Google search result page instead of seeing the results on Findory, that is because Google failed to return search results to Findory. It is rare, only occurring when the Google API coughs up a smurf. When this happens, rather than display an error page, Findory asks Google to serve up the results directly.
Update: If you want to try making Findory the default web search in Firefox for a little while, there is a Firefox plug-in available.