User behavior analysis of automobile websites based on distributed computing and sequential pattern mining

摘要

Nowadays Internet user behavior becomes more and more complicated due to application diversity. It is important to analyze user behavior on specific websites such as e-commerce, education, and healthcare in order for personalized recommendation or targeted advertisement. In this paper, based on the large-scale traffic flow data of real network and crawling data from websites, we focus on the analysis of user browsing behavior on automobile websites. First of all, data pre-processing and statistical analysis based on MapReduce framework are designed and implemented, which is mainly to transform the flow data type to sequential dataset. By improving regular expressions matching method in distributed computing, the running time is reduced from O(N) to O(1). Secondly, we apply the sequential pattern mining algorithm AprioriAll to analyze the sequential dataset. The analysis result reflects the preference of the users when browsing automobile websites to acquire their wanted information.