Measuring Pilot Knowledge in Training: The Pathfinder Network Scaling Technique

Researchers have attempted to measure pilot knowledge and changes in knowledge, in both simulated and live-fly events. However, measurement in these training environments has been more successful in measuring overall flight performance outcomes rather than on underlying changes in knowledge. Researc...

Full description

Saved in:
Bibliographic Details
Main Authors: Rowe, Leah J, Schvaneveldt, Roger W, Bennett, Jr, Winston
Format: Report
Language:English
Subjects:
AIR FORCE FACILITIES
AIR FORCE RESEARCH
AIR FORCE TRAINING
COGNITION
DISTRIBUTED MISSION OPERATIONS
DMO(DISTRIBUTED MISSION OPERATIONS)
FLIGHT
Information Science
KNOWLEDGE BASED SYSTEMS
KNOWLEDGE MANAGEMENT
KNOWLEDGE MEASUREMENT
LEARNING
METHODOLOGY
MISSIONS
PATHFINDER NETWORK SCALING TECHNQIUE
PE62202F
PERFORMANCE MEASUREMENTS
Personnel Management and Labor Relations
PILOT KNOWLEDGE
PILOTS
SYMPOSIA
TRAINING
TRAINING ENVIRONMENTS
TRAINING EVALUATION
WUAFRL1123AS09
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Researchers have attempted to measure pilot knowledge and changes in knowledge, in both simulated and live-fly events. However, measurement in these training environments has been more successful in measuring overall flight performance outcomes rather than on underlying changes in knowledge. Research to assess changes in pilots' knowledge as a result of training is underway at the Air Force Research Laboratory (AFRL) in Mesa, Arizona, using the Pathfinder Network Scaling technique. The Pathfinder method uses individual judgments of the relationships between concepts/constructs in a domain as a basis to develop an empirically derived representation of knowledge about the concepts/constructs. These representations can be compared and changes in representation can be quantified to assess the impact of an intervention on knowledge. Previous research has demonstrated the value of Pathfinder for assessing the impact of both education and training interventions in domains such as computer programming. At AFRL, pilots, as part of a week-long 4-ship F-16 Distributed Mission Operations (DMO) training research program, participated in a Pathfinder study to asses F-16 pilot understanding of complex combat mission constructs/concepts critical to mission performance. The objective was to assess training effects that are more fundamental and process-orientated. This paper will report findings from a sample of 71 F-16 pilots who vary in experience level. Our results will be discussed both in terms of practical utility of the Pathfinder technique as a measurement methodology and in terms of knowledge measurement as a criterion for evaluating training. Prepared in cooperation with Arizona State University, Meza, Arizona. Presented at the Interservice/Industry Training, Simulation and Education Conference held in Orlando, Florida on 26-29 November, 2007.