Log analytics on cloud using pattern recognition a practical perspective to cloud based approach

摘要

Every application nowadays produces huge amounts of log data which can give critical insights if properly monitored. The biggest problem in monitoring such large amounts of log data by using the existing techniques is that they are compute intensive, and require a lot of effort. And also usually log data is unformatted and may contain some redundant data as well that needs to be removed. This critical information is more valuable, a potential predictive analytics improves the proactive control of the application. Data analytics paradigm shows new ways of handing this critical information by providing various technologies to handle this in an effective way. Visualization is used to convey the findings from data analytics in an easily understandable way. Due to the huge size of data that has to be analyzed, a highly scalable approach is required which provides additional optimization. In this paper an approach for data analytics with the combination of cloud computing is proposed and demonstrated.