New Tools and Methods in Selection of Air Traffic Controllers Based on Multimodal Psychophysiological Measurements

• Published in: IEEE access 2019, Vol.7, p.174873-174888
• Main Authors: Cosic, Kresimir, Popovic, Sinisa, Sarlija, Marko, Mijic, Igor, Kokot, Mirko, Kesedzic, Ivan, Strangman, Gary, Ivkovic, Vladimir, Zhang, Quan
• Format: Article
• Language: English
• Subjects: Acoustics; Air traffic control; Air traffic controllers; Astronauts; ATC selection; attention deficit; cognitive capacity; Cost analysis; Data analysis; Emergency response; Extraterrestrial measurements; Fatigue; multimodal physiology; Optical tracking; performance assessment; Physiology; Psychological stress; Resilience; resilience assessment; speech and oculometric features; Stimuli; Stress; Stress measurement; Task analysis; Workload; Workloads
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2019.2957357

Comprehensive multimodal psychophysiological measurements and smart data analysis based on wearable and low-cost technologies could enhance traditional air traffic controller (ATC) selection process. Many recent studies in neuro-cognitive science and stress resilience illustrated effectiveness of these multimodal measurements and appropriate metrics in comprehensive assessment of ATCs' mental states, such as cognitive workload, cognitive decline, attention deficit, fatigue, emotional and behavioural problems, etc. Accordingly, this article is focused on innovation efforts in ATC selection protocols based on a set of comprehensive stimuli and corresponding multimodal psychophysiological measurements. The concept of enhancement of ATC selection process presented in this article includes complex physiological, oculometric and speech measurements and appropriate metrics. From these multimodal measurements during specific stimulation tasks, which include different versions of acoustic startle stimuli, airblasts, semantically relevant aversive images and sounds, different versions of Stroop tests, visual tracking test, a complex set of multimodal-multidimensional features is computed as predictors of ATC candidates' future performance, like: stress resilience, workload capacity, attention, visual performance, working memory etc. Such cost-effective, more objective, non-invasive preliminary measurements, lasting no longer than 45 minutes may have good discriminative power and might be used in ATC selection processes as enhancement of current selection procedures. Comprehensive analysis of presented multimodal features during different experimental conditions might also be very useful in selection processes of other stressful professional jobs, like first responders, pilots, astronauts etc.