Data Processing Architecture using Opensource Bigdata Technology to Increase Transaction Speed

摘要

Data is the sources of decision making in any businesses, whether they are in a big or small operation. Data can provide insights that can help to answer the key business questions through dashboard, and dashboard leads to insights. In this research is conducted to solve the problem about Decision Support System in telecommunication company. Business owners and managers can turn those insights into decisions and actions that improve the business. To turn the data into a dashboard, the data should follow several steps. This process could take a long time for a huge amount of data. The time required for data processing from raw until transform into aggregated value need more than 2 hours. Thus, could hold up decision making process. Therefore, it is needed to develop a good data processing architecture to process the huge data, to make the data processing faster. In this research, data aggregation is processed using Apache Spark. Afterwards, Apache Zeppelin is used to display the information of telecommunication data. This technology is fast enough to process a lot of data in a short time. The result show that the data processing could be shown in the dashboard in a short time and could help the decision making faster.