Design Specifications for the Scenario-Based Training Automated Collection and Evaluation System (SBT-ACES)

• Published in: Proceedings of the Human Factors and Ergonomics Society Annual Meeting 2010-09, Vol.54 (27), p.2243-2247
• Main Authors: Stagl, Kevin C., Schatz, Sae, Fowlkes, Jennifer, Santarelli, Thomas
• Format: Article
• Language: English
• ISSN: 1541-9312; 1071-1813; 2169-5067
• DOI: 10.1177/154193121005402705

Evaluation is a powerful mechanism for realizing engaging, effective and efficient training. The data distilled from summative and formative evaluations can be used to iteratively improve synthetic learning environments, scenario-based content, and assessment tools, thereby enabling more personally meaningful learning experiences. In this paper, we leverage the science of training, psychometric theory, and artificial intelligence to inform the design of the Scenario-Based Training - Automated Collection and Evaluation System (SBT-ACES). SBT-ACES provides instructors with an integrated analytics toolset to facilitate the collection, manipulation, analysis and visualization of evaluative data from a federation of systems, titled the Instructional Support System (ISS). The ISS is a constellation of applications, databases and devices supporting Marine Air Ground Task Force (MAGTF) training via the Digital Virtual Training Environment (DVTE), a laptop-based simulation suite deployed worldwide. A machine learning component within the ISS can leverage post-synthesized SBT-ACES data to continuously tune training such that, over time, accumulated evidence enables content to be adaptively tailored to optimize trainees' learning experiences.