RUBP: a storm-based real-time computing model for textual unstructured data

摘要

Nowadays, the internet generates vast amounts of unstructured data every day. And among them, the textual unstructured data is a very important part. How to find the real value from textual unstructured data is a huge challenge. Apache Storm is a real-time computation system, which is a free and open source, it can make up for the inadequacy of real-time computing. Based on the business requirements, this paper proposes the RUBP (Real-time framework of Unstructured Big data Processing) computing model which is based on Storm for the analysis of massive data, to find the value from these large amounts of textual unstructured data efficiently, accurately and quickly. The experiment proved that the RUBP computing model in real-time calculation of textual unstructured data is feasible.