Skip to main content
Original Article

Nontechnical Skills Training in Air Traffic Management Including Computer-Based Simulation Methods

From Scientific Analyses to Prototype Training

Published Online:https://doi.org/10.1027/2192-0923/a000103

Abstract. The aim of the present paper is to introduce a simulation-based nontechnical skills training for air traffic controllers, by presenting the scientific analyses for the training development as well as the prototype training. The training combines theoretical background about human factors (situation awareness, decision making, stress and workload management, communication, team work, threat and error management, and fatigue management) with the training of scenarios in a simulation. Furthermore, the training comprises support material for briefings and debriefings as well as an instructor training. The use of simulation-based methods allows for an active learning environment that reinforces transfer processes from training to real work settings of controllers, an adaptation to changing training contents, and thus guarantees an innovative approach to flight safety.

References

  • Anseel, F., Lievens, F. & Schollaert, E. (2009). Reflection as a strategy to enhance task performance after feedback. Organizational behavior and human decision processes, 110, 23–35. doi: 10.1016/j.obhdp. 2009.05.003 First citation in articleCrossrefGoogle Scholar

  • Atkins, P. W. & Wood, R. E. (2002). Self‐versus others’ ratings as predictors of assessment center ratings: Validation evidence for 360‐degree feedback programs. Personnel Psychology, 55, 871–904. doi: 10.1111/j.1744-6570.2002.tb00133.x First citation in articleCrossrefGoogle Scholar

  • Barbarino, M. (1996). Guidelines for developing and implementing team resource management. (Report No. HUM.ET1.ST10.1000-GUI-01). Brussels, Belgium: Eurocontrol. First citation in articleGoogle Scholar

  • Boeing Commercial Airplanes. (2015). Statistical summary of commercial jet airplane accidents: Worldwide operations 1959–2014. Seattle, WA: Author. First citation in articleGoogle Scholar

  • Broad, M. L. (2008). Overview of transfer of training: from learning to performance. Performance Improvement Quarterly, 10, 7–21. doi: 10.1111/j.1937-8327.1997.tb00046.x First citation in articleCrossrefGoogle Scholar

  • Bunjevac, S. & Seychell, A. F. (2015). Eurocontrol guidelines for TRM good practices. Brussels, Brussels: Eurocontrol. First citation in articleGoogle Scholar

  • Cohen, J. (1968). Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213–220. doi: 10.1037/h0026256 First citation in articleCrossrefGoogle Scholar

  • Cohen, L., Manion, L. & Morrison, K. (2007). Research methods in education (6th ed.). London, UK: Routledge. First citation in articleGoogle Scholar

  • Cook, A. (2007). European air traffic management. Principles, practice and research. Aldershot, UK: Ashgate. First citation in articleGoogle Scholar

  • D’Arcy, J. F. & Rocco, P. S. (2001). Air traffic control specialist decision making and strategic planning-A field survey (No. DOT/FAA/CT-TN01/05). Washington, DC: U.S. Department of Transportation. First citation in articleCrossrefGoogle Scholar

  • DiCicco-Bloom, B. & Crabtree, B. F. (2006). The qualitative research interview. Medical Education, 40, 314–321. doi: 10.1111/j.1365-2929.2006.02418.x First citation in articleCrossrefGoogle Scholar

  • Dismukes, R. K. & Smith, G. M. (2000). Facilitations and debriefing in aviation training and operations. Aldershot, UK: Ashgate. First citation in articleGoogle Scholar

  • Dismukes, K., Bergman, B. & Loukopoulous, L. (2007). The limits of expertise. Rethinking pilot error and the causes of airline accidents. Aldershot, UK: Ashgate. First citation in articleGoogle Scholar

  • Elfering, A. & Grebner, S. (2008). Stress and patient safety. In J. R. B. HalbeslebenEd., The handbook of stress and burnout in health care (pp. 173–186). Hauppauge, NY: Nova Science Publishers. First citation in articleGoogle Scholar

  • Endsley, M. R. & Rodgers, M. D. (1997). Distribution of attention, situation awareness, and workload in a passive air traffic control task: Implications for operational errors and automation (Office of Aviation Medicine Report No. DOT/FAA/AM-97/13). Washington, DC: Federal Aviation Administration. First citation in articleGoogle Scholar

  • Fedor, D. B., Davis, W. D., Maslyn, J. M. & Mathieson, K. (2001). Performance improvement efforts in response to negative feedback: The roles of source power and recipient self-esteem. Journal of Management, 27, 79–97. doi: 10.1177/014920630102700105 First citation in articleCrossrefGoogle Scholar

  • Fischer, K. (2014). Radar Operation Simulator & Editor. Retrieved from http://www.radarsimulator.de First citation in articleGoogle Scholar

  • Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 54, 327–358. doi: 10.1037/h0061470 First citation in articleCrossrefGoogle Scholar

  • Fleishman, E. A. (1995). Fleishman Job Analysis Survey. Rating scale booklet. Potomac, MD: Management Research Institute. First citation in articleGoogle Scholar

  • Flin, R., Martin, L., Goeters, K.-M., Hörmann, H.-J., Amalberti, R., Valot, C. & Nijhuis, H. (2003). Development of the NOTECHS (non-technical skills) system for assessing pilots’ CRM skills. Human Factors and Aerospace Safety, 3, 95–117. First citation in articleGoogle Scholar

  • Flin, R., O’Connor, P. & Crichton, M. (2008). Safety at the sharp end: A guide to non-technical skills. Farnham, UK: Ashgate. First citation in articleGoogle Scholar

  • Flin, R., O’Connor, P. & Mearns, K. (2002). Crew resource management proving team work in high reliability industries. Team Performance Management: An International Journal, 8, 68–78. doi: 10.1108/13527590210433366 First citation in articleCrossrefGoogle Scholar

  • Gregorich, S. & Wilhelm, J. (1993). Crew resource management training assessment. In E. WeinerB. KankiR. HelmreichEds., Cockpit resource management (pp. 173–198). San Diego, CA: Academic Press. First citation in articleGoogle Scholar

  • Harris, D. (2014). Improving aircraft safety. The Psychologist, 27, 90–95. First citation in articleGoogle Scholar

  • Harris, D. & Li, W.-C. (2011). Cultural determinants of error on the flight deck. In G. A. BoyEd., The handbook of human-machine interaction: A human-centred design approach (pp. 399–416). Farnham, UK: Ashgate. First citation in articleGoogle Scholar

  • Hollnagel, E. (2011). Simulator studies: The next best thing?. In A. B. SkjerveA. ByeEds., Simulator-based human factors studies across 25 years (pp. 59–69). London, UK: Springer. First citation in articleGoogle Scholar

  • Isaac, A., Shorrock, S. T., Kennedy, R., Kirwan, B., Andersen, H. & Bove, T. (2002). Technical review of human performance models and taxonomies of human error in ATM (HERA). (Report No. HRS/HSP-002-REP-01). Brussels, Belgium: Eurocontrol. First citation in articleGoogle Scholar

  • Keith, N. & Frese, M. (2008). Effectiveness of error management training: A meta-analysis. Journal of Applied Psychology, 93. doi: 10.1037/0021-9010.93.1.59 First citation in articleCrossrefGoogle Scholar

  • Klein, G., Calderwood, R. & Macgregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man and Cybernetics, 19, 462–472. doi: 10.1109/21.31053 First citation in articleCrossrefGoogle Scholar

  • Knecht, C. P., Muehlethaler, C. M. & Elfering, A. (2015). Serious incidents in aviation: Application of the Critical Behaviour Classification System (CBCS), Unpublished manuscript. University of Bern, Bern, Switzerland. First citation in articleGoogle Scholar

  • Kontogiannis, T. & Malakis, S. (2009). A proactive approach to human error detection and identification in aviation and air traffic control. Safety Science, 47, 693–706. doi: 10.1016/j.ssci.2008.09.007 First citation in articleCrossrefGoogle Scholar

  • Landis, J. R. & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174. doi: 10.2307/2529310 First citation in articleCrossrefGoogle Scholar

  • Locke, E. A. & Latham, G. P. (1990). A theory of goal setting and task performance. Englewood Cliffs, NJ: Prentice Hall. First citation in articleGoogle Scholar

  • McClelland, S. B. (1994). Training needs assessment data‐gathering methods: Part 1, survey questionnaires. Journal of European Industrial Training, 18, 22–26. doi: 10.1108/ 03090599410054317 First citation in articleCrossrefGoogle Scholar

  • O’Connor, P., Campbell, J., Newon, J., Melton, J., Salas, E. & Wilson, K. (2008). Crew resource management training effectiveness: A meta-analysis and some critical needs. International Journal of Aviation Psychology, 18, 353–368. doi: 10.1080/10508410802347044 First citation in articleCrossrefGoogle Scholar

  • Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y. & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903. doi: 10.1037/0021-9010.88.5.879 First citation in articleCrossrefGoogle Scholar

  • ROSE (version 2.10.434). [Computer Software]. Leidersbach, Germany: ATC-Sim Fischer. First citation in articleGoogle Scholar

  • Salas, E. & Cannon-Bowers, J. A. (1997). Methods, tools, and strategies for team training. In M. QuinonesE. EhresteinEds., Training for a rapidly changing workplace: Applications of psychological research. Washington, DC: American Psychological Association Press, 291–322. First citation in articleGoogle Scholar

  • Salas, E., Prince, C., Bowers, C. A., Stout, R. J., Oser, R. L. & Cannon-Bowers, J. A. (1999). A methodology for enhancing crew resource management training. Human Factors: The Journal of the Human Factors and Ergonomics Society, 41, 161–172. doi: 10.1518/001872 099779577255 First citation in articleCrossrefGoogle Scholar

  • Seamster, T. L., Cannon, J. R., Pierce, R. M. & Redding, R. E. (1992, October). Analysis of en route air traffic controller team communication and controller resource management (CRM). In HFESEds., Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 36, pp. 66–72). doi: 10.1177/154193129203600117 First citation in articleCrossrefGoogle Scholar

  • Seamster, T. & Kaempf, G. (2001). Identifying resource management skills for airline pilots. In E. SalasC. BowersJ. Cannon-BowersEds., Improving teamwork in organisations. Applications of resource management training. Mahwah, NJ: Lawrence Erlbaum. First citation in articleGoogle Scholar

  • Semmer, N. K., Grebner, S. & Elfering, A. (2004). Beyond self-report: Using observational, physiological, and event-based measures in research on occupational stress. In P. L. PerrewéD. C. GansterEds., Emotional and physiological processes and positive intervention strategies. Research in occupational stress and well-being (Vol. 3, 205–263). Amsterdam, The Netherlands: JAI. doi: 10.1016/S1479-3555(03)03006-3 First citation in articleCrossrefGoogle Scholar

  • Semmer, N. K. & Jacobshagen, N. (2010). Feedback im Arbeitsleben – eine Selbstwert-Perspektive [Feedback at work – a self-esteem perspective]. Gruppendynamik & Organisationsberatung, 41, 39–55. doi: 10.1007/s11612-010-0104-9 First citation in articleCrossrefGoogle Scholar

  • Semmer, N. & Regenass, A. (1997). Computer training: exploration vs. reception – Or meaningful vs. meaningless? Unpublished manuscript, Department of Psychology, University of Bern, Bern, Switzerland. First citation in articleGoogle Scholar

  • Shappell, S. A. & Wiegmann, D. A. (2001). Applying reason: The human factors analysis and classification system (HFACS). Human Factors and Aerospace Safety, 1, 59–86. First citation in articleGoogle Scholar

  • Shorrock, S. T. & Kirwan, B. (2002). Development and application of a human error identification tool for air traffic control. Applied Ergonomics, 33, 319–336. doi: 10.1016/S0003-6870(02)00010-8 First citation in articleCrossrefGoogle Scholar

  • Vincenzi, D. A., Wise, J. A., Mouloua, M. & Hancock, P. A. (2009). Human factors in simulation and training. Boca Raton, FL: CRC Press. First citation in articleGoogle Scholar

  • Wanous, J. P. & Hudy, M. J. (2001). Single-item reliability: A replication and extension. Organizational Research Methods, 4, 361–375. doi: 10.1177/109442810144003 First citation in articleCrossrefGoogle Scholar

  • Woldring, M. & Isaac, A. (1999). Team resource management test and evaluation (Report No. HUM.ET1.ST10.2000_REP-01). Brussels, Belgium: Eurocontrol. First citation in articleGoogle Scholar