Design of the mass multimedia files storage architecture based on Hadoop

摘要

With the development of social network and video sites, the amount of images and videos being uploaded to the internet is rapidly increasing, and it is more and more difficult to storage and process the mass network images and videos. How to storage, manage and classify mass network images and videos effectively, and provide an excellent experience for users has been an urgent problem. Hadoop distributed file system (HDFS) becomes a representative cloud storage platform, benefiting from its reliable, scalable and low-cost storage capability. However, HDFS is not designed for storing mass small files. This paper presents a Hadoop-based mass multimedia files storage architecture. The core idea of this architecture is that merge the small images and video files to a Bundle, and provide a unified interface to handle mass images and videos. It's a good solution to the problem of small files. The experimental results show that the approach can achieve a better performance.