Big data has become a buzz word. Among various big-data challenges, real-time data analytics has been identified as one of the most exciting and promising areas for both academia and industry. We are facing the challenges at all levels ranging from sophisticated algorithms and procedures to mine the gold from massive data to high-performance computing (HPC) techniques and systems to get the useful data in time. In this tutorial, we review the system design and implementation of HPC technologies (including GPUs, FPGAs and RDMA etc) as weapons to address the performance requirement of real-time data analytics. Particularly, we focus on the interplay between HPC and real-time data analytics, where real-time data analytics also poses significant challenges to the design and implementation of HPC technologies. I will also present our recent research efforts in developing real-time data analytics systems by Xtra Computing Group at NTU Singapore as well as related research from other groups. Finally, I will outline some open problems in this field.
展开▼
