Outlier detection techniques for big data streams: focus on cyber security

摘要

In recent years, detecting outliers in big data streams has become a main challenge in several domains (e.g., medical monitoring, government security, information security, natural disasters, and online financial frauds). In fact, unlike regular static data, streams raise many issues like high multidimensionality, dynamic data distribution, unpredictable relationships, data sequences, uncertainty and transiency. Most of the proposed approaches can handle some of these issues but not all. In addition, they provide limited considerations with regard to scalability and performance. Real-world applications require high performance, resources optimisation and real-time responsiveness when detecting outliers. This is useful to extract knowledge, detect incidents and predict patterns changes. In this paper, we review and compare recent studies in detecting outliers for data streams. We investigate how researchers improved the outcome of different models and monitoring systems, especially in the context of cyber security.