Ranking test framework for search results on an online social network

摘要

In one embodiment, a method includes accessing a first set of scored results received from a client system of a first user, the first set of scored results including: one or more results, each having a rank with respect to the other results, generated by a first search algorithm, and one or more scores inputted by the first user corresponding to the results. The method includes calculating a discounted cumulative gain for each scored result based on the rank and score of the result. The method includes generating a second search algorithm based on the calculated gains and the first search algorithm, the second search algorithm including a modification of the first search algorithm to improve the ranking of results, and, if a quality metric of the second search algorithm is higher than a quality metric of the first, substituting the second search algorithm for the first.