Design of a low cost and convenient Hadoop application for extracting consumer behavior

摘要

Access Log of an e-commerce website contains the movement of the consumers. This movement carries valuable information about the needs, choices and purchase history of the consumers. This information can be extracted to influence the purchase of the consumers through appropriate ads, offers and discounts. Moreover, this information has interesting correlations with various business parameters, which helps to make a strong prediction for business intelligence. To make these insights more sensible, log data should be as big as possible. It makes big data analytics suitable for such application. Hadoop is an open source platform for big data analysis and can be used for the benefit of the e-commerce companies. But without proper tools like Pig, Hive etc, Hadoop applications are difficult to access. In this article, a unique and convenient system called Command Line Interface for Consumer Behavior is presented to solve this particular problem. One can easily find the consumer behavior using the access logs with this system. It has used command line feature of Hadoop to pass the IP or Hostname to extract consumer behavior.