Real Time Anomaly Detection in Massive Data Streams with ELK Stack
- 1 South East European University, Macedonia
- 2 University of Prizren, Kosovo
Copyright: © 2020 Jakup Fondaj and Zirije Hasani. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Real time anomaly detection is very popular topic nowadays this because the number of data generated every day is larger and larger. Facing with the phenomena of Big Data is not an easy task. The main aim of this research is to fine appropriate architecture for real-time big data analytic and its main task is to detect anomalies in this real-time data. In this paper we show the implementation of anomaly detection algorithm in real time infrastructure in order to find anomalies as soon as possible. We have proposed architecture for real time anomaly detection by adding some new components and the main part of the infrastructure is Timelion which enable implementation of different algorithms for anomaly detection. The research is focused to develop infrastructure to monitor e-dnevnik (education national system in Macedonia) application server and to detect errors in order to scale up the performance.
- 798 Views
- 1,069 Downloads
- 0 Citations
- Real Time
- Big Data
- Infrastructure for Anomaly Detection