System and method for measuring and improving search result relevance based on user satisfaction

摘要

Systems and methods for measuring and improving search result relevance based on user satisfaction are disclosed. An event log is preferably scanned to determine the start and the end of a session. User behaviors within the session are preferably identified. User satisfaction is preferably estimated based on the user behaviors. User satisfaction is preferably a measure of the user's perception of the extent to which a result correlates to his intent based on his behaviors. User satisfaction is preferably estimated to be one of three satisfaction levels: satisfied, partially-satisfied, and dissatisfied. Symptoms, which are indications of a need for improvement within a search system, are preferably observed based on the user behaviors and the user satisfaction. Diagnostics, which are conditions that prevent a search system from performing optimally, are preferably derived based on the symptoms. A performance report for the search system based, at least in part, on the user satisfaction and the diagnostics may be generated. Such a report may be analyzed to determine methods for improving the relevance of results generated by the search system.