Web mining and its SQL based parallel execution

摘要

Web mining can be classified into two categories, Web access log mining and Web structure mining. We performed association rule mining and sequence pattern mining against the access log which was accumulated at NTT Software Mobile Info Search portal site. Detail web log mining process and the rules we derived are reported in this paper. The parallel association rule mining is explored on large scale PC cluster system. Parallelism is key to improve the performance. We achieved substantial speed up through parallel SQL execution.