Compositional Feature Subset Based Ranking System (CFBRS) for Learning to Rank with User Feedback

摘要

This paper proposed a new method for learning to rank documents using a compositional feature subset based ranking system in the presence of implicit user feedback of various classes of the users. The objective of this research was to provide an alternative method for learning ranking functions using important compositions of the LETOR (Learning to Rank) features. The proposed model allows the search engine to dynamically utilize the implicit user feedback of the various classes of the users in learning ranking models repeatedly. The experiments performed on the LETOR MQ2008 dataset show that the proposed model gives better NDCG (Normalized Discounted Cumulative Gain) scores for the subsets of the users in the ensemble settings. Results also show that the variance of the predicted ranking can be controlled by controlling the hyper-parameters like the probability of the selection of a subset, feedback on the subsets and the weights of each subset used in training the low-level ranker. We have used cross-entropy pairwise learner RankNet and the maximum margin type svmRank as low-level rankers, but their objective functions are modified for the feature subsets. Results obtained by bagging and boosting based ensemble methods show that the proposed method is flexible enough to model a family of the feedback weights on the individual models and can be used to provide personalized rank learning functions to the selected subsets of the users.