Research Article Open Access

Data Analytics for the Cyber Security of an Information System Based on a Markov Decision Process Model

Lidong Wang1, Randy Jones1 and Terril C. Falls1
  • 1 Institute for Systems Engineering Research, Mississippi State University, Vicksburg, MS 39180, United States

Abstract

Intrusion detection is an important research topic in information systems and cyber security. Both a defender and an attacker detect and learn about each other during an intrusion process. The defender can expel the attacker as soon as the attacker is detected or wait and observe to know more about the attacker for the detection and prevention of other attacks in the future. An optimal decision is often required in this situation. Data analytics is conducted to achieve an optimal decision for the cyber security of an information system based on a Markov Decision Process (MDP) model in this study. The state of the information system is completely observable in the model. The model is validated using various algorithms that include policy iteration, value iteration, and Q-learning. Data analytics over a finite planning horizon and an infinite planning horizon is conducted, respectively. The expected total cost for each state is analyzed at various parameters of the transition probability and various parameters of the transition cost.

American Journal of Engineering and Applied Sciences
Volume 15 No. 4, 2022, 288-294

DOI: https://doi.org/10.3844/ajeassp.2022.288.294

Submitted On: 21 September 2022 Published On: 7 December 2022

How to Cite: Wang, L., Jones, R. & Falls, T. C. (2022). Data Analytics for the Cyber Security of an Information System Based on a Markov Decision Process Model. American Journal of Engineering and Applied Sciences, 15(4), 288-294. https://doi.org/10.3844/ajeassp.2022.288.294

  • 2,009 Views
  • 1,013 Downloads
  • 0 Citations

Download

Keywords

  • Cyber Security
  • Information System
  • Markov Decision Process
  • Data Analytics
  • Q-Learning