Surrogate-agent modeling for improved training

• Published in: Engineering applications of artificial intelligence 2018-09, Vol.74, p.280-293
• Main Authors: Tavcar, Ales, Gams, Matjaz
• Format: Article
• Language: English
• Subjects: Agent-based simulation training; Behavior analysis; Data farming; Decision making; Multi-agent systems
• ISSN: 0952-1976; 1873-6769
• DOI: 10.1016/j.engappai.2018.07.001

Extensive skill training using simulations for improving decision making has become a common practice in a multitude of domains and professions due to the expense or danger of training in real-life circumstances, or to speed up the learning process. In this work we propose a novel approach called PATDS (Performance Analysis of Training through Data-Farming Simulations) in which a simulated agent as a virtual copy of a human trainee is constructed and tested in all circumstances to provide feedback and decision support for another round of human learning. PATDS includes the analysis of behavior demonstrated by the trainee in simulations and the identification of relevant behavior patterns; that is, strategies. The identified patterns are in turn used to model a surrogate agent of the trainee. The created agent is then evaluated with data-farming experiments on a variety of simulation parameters to estimate the key weaknesses in its behavior and the overall performance. In subsequent rounds of training, the trainee improves the behavior based on the identified weaknesses and strategic decision recommendations; a new surrogate agent is designed adding new skills from the trainee until the desired overall performance is achieved. We evaluated the proposed approach on two asymmetric urban-terrain threat scenarios where a squad of security forces interacts with hostile crowds. We demonstrate that the data-farming-based evaluation in the complete simulation parameter space is beneficial for improving the trainees’ capabilities. •High-level knowledge of the trainee is extracted from observing his performance.•Behavior patterns can create a realistic surrogate agent of the trainee.•Behavior evaluation helps identifying weaknesses and improves decision making.•Data-farming-based evaluation helps improving the trainees’ capabilities.