USAF Enlisted Air Traffic Controller Selection: Examination of the Predictive Validity of the FAA Air Traffic Selection and Training Battery versus Training Performance

• Main Authors: Carretta, Thomas R, King, Raymond E
• Format: Report
• Language: English
• Subjects: ACHIEVEMENT TESTS; AIR FORCE PERSONNEL; AIR FORCE TRAINING; AIR TRAFFIC CONTROLLERS; APTITUDE TESTS; ASVAB(ARMED SERVICES VOCATIONAL APTITUDE BATTERY); ATTRITION; ENLISTED PERSONNEL; FAA FAA AT-SAT(AIR TRAFFIC SELECTION AND TRAINING BATTERY); FAILURE; GRADUATES; Military Forces and Organizations; PERFORMANCE(HUMAN); Personnel Management and Labor Relations; PERSONNEL RETENTION; PERSONNEL SELECTION; PREDICTIONS; PREDICTIVE VALIDITY; Psychology; SCORING; STUDENTS; TEST SCORES; TEST VALIDATION; TEST VALIDITY; TRAINEES; TRAINING; TRAINING ATTRITION; TRAINING PERFORMANCE; TRAINING SCORES; VALIDATION

Over the past decade, the U.S. military has conducted several studies to evaluate determinants of enlisted air traffic controller (ATC) performance. Research has focused on validation of the Armed Services Vocational Aptitude Battery (ASVAB) and has shown it to be a good predictor of training performance. Despite these efforts, enlisted ATC training and post-training attrition is higher than desirable, prompting interest in alternate selection methods to augment current procedures. The current study examined the utility of the FAA Air Traffic Selection and Training (AT-SAT) battery for incrementing the predictiveness of the ASVAB versus several enlisted ATC training criteria. Subjects were 448 USAF enlisted ATC students who were administered the ASVAB and FAA AT-SAT subtests and subsequently graduated or were eliminated from apprentice-level training. Training criteria were a dichotomous graduation/elimination training score, average ATC fundamentals course score, and FAA certified tower operator test score. Results confirmed the predictive validity of the ASVAB and showed that one of the AT-SAT subtests resembling a low-fidelity ATC work sample significantly improved prediction of training performance beyond the ASVAB alone. The results suggest that training attrition could be reduced by raising the current ASVAB minimum qualifying score. However, this approach may make it difficult to identify sufficient numbers of trainees and lead to adverse impact. Although the AT-SAT ATC work sample subtest showed incremental validity to the ASVAB, its length (95 minutes) may be problematic in operational testing. Recommendations are made for additional studies to address issues affecting operational implementation. Work was accomplished under approved task AM-HRR-523. Prepared in cooperation with the FAA Civil Aerospace Medical Institute, Oklahoma City, OK.