Himanshu Neema receives a Johns Hopkins University Applied Physics Laboratory award for his project titled, “Scalable Cyber-Physical Simulation for Automated Cyber Agent Training”

Himanshu Neema landed a Johns Hopkins University Applied Physics Laboratory (JHU-APL) award for his project titled, “Scalable Cyber-Physical Simulation for Automated Cyber Agent Training.” This project is the first award as part of the new relationship that Himanshu developed with APL that enables Vanderbilt PIs to submit proposals collaboratively with APL PIs to APL's internal research and development (IRAD) missions on a yearly basis. Once funded, the project usually will gain options increasing budget if necessary and for continuation beyond the initial year.

Brief Project Summary: Modern cyber-physical systems (CPS) are highly complex systems-of-systems, in which understanding the breadth and severity of cyberattacks is highly challenging. As cyberattacks and defensive operations become increasingly automated, there is a greater need to understand the complexities of interactions between the cyber and physical worlds. A scalable, detailed simulation platform will provide a means of developing and evaluating automated techniques within these complex systems. We will leverage the Cyber-Physical Systems Wind Tunnel (CPSWT), a model-based framework for rapidly synthesizing heterogeneous simulation integration, to develop a standard method for assessing cyber operations within these systems. We will leverage the Cyber AI Gym Environment (CAGE), an APL developed tool, to assess the feasibility of Reinforcement Learning (RL) within the integrative simulation environment, demonstrating the ability to select and target attacks based on the secondary observables generated in non-cyber simulations. The overarching project goal is to increase adaptability of automated learning solutions by (a) showing that we can learn offensive and defensive maneuvers simultaneously within realistic simulation environments, (b) showing that we can customize, deploy, and validate general RL policies to highly realistic modeling and simulation (and to the real-world using hardware-in-the-loop simulation), and (c) showing that high-fidelity simulation provides a viable approach towards better understanding and validating cyber effects.