A big data platform for monitoring the quality of data transfer services and relevant market indicators of mobile operators

摘要

We present a platform that monitors and reports the quality of the data services offered by mobile operators. The platform is based on a set of nodes and a mobile application that captures quality of service measurements and other relevant data. This information is sent to collector nodes where it is analyzed to generate reports about the quality of the data services. The platform also provides information about the mobile sector, like the market share of mobile operators, smartphone manufacturers and models, and mobile technologies deployed. Since the platform has the potential to grow to a large-scale nation-wide project, the collector nodes are based on Hadoop for the storage and data analysis. We deployed a proof of concept in Mexico with a mobile App for the Android mobile operating system. The QoS servers were deployed on virtual machines on Amazon's AWS cloud. In order to test the capability of the Big Data based collector and BI nodes, we built a discrete-event simulator that generates QoS records with different random distributions, market behaviors and relevant patterns that would be interesting to observe.