Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Article

Predicting Commercial Pilot Training Performance

A Validation Study

Published Online:September 19, 2022https://doi.org/10.1027/2192-0923/a000232

Abstract

Abstract. The main purpose of this study was to examine the predictive validity of the system used for ab initio selection of candidates to a bachelor program in aviation. The selection includes paper-and-pencil tests, computer-based tests, and an interview. A total of 188 candidates participated in the validation study. The total test score predicted the results of three exams in aviation theory (r = .27–.38) and extra flying hours needed (−.22), but not mean university grade. The regression analyses indicated that all predictors (tests and interview ratings) explained 25% of the variance in aviation theory, 19% in extra flying hours needed, and 7% in mean university grade. The overall findings confirmed the predictive validity of selection tests, especially the computer-based tests.

References

  • ALMamari, K., & Traynor, A. (2019). Multiple test batteries as predictors for pilot performance: A meta-analytic investigation. International Journal of Selection and Assessment, 27(4), 337–356. https://doi.org/10.1111/ijsa.12258 First citation in articleCrossref, Google Scholar

  • ALMamari, K., & Traynor, A. (2020). Predictive validity of the Air Force Officer Qualification Test (AFOQT) for pilot performance. Aviation Psychology and Applied Human Factors, 10(2), 70–81. https://doi.org/10.1027/2192-0923/a000190 First citation in articleLink, Google Scholar

  • American Educational Research Association (AERA), American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. APA. First citation in articleGoogle Scholar

  • Barron, L. G., Carretta, T. R., & Bonto-Kane, M. V. A. (2016). Relations of personality traits to military aviator performance: It depends on the criterion. Aviation Psychology and Applied Human Factors, 6(2), 57–67. https://doi.org/10.1027/2192-0923/a000100 First citation in articleLink, Google Scholar

  • Broach, D., Schroeder, D., & Gildea, K. (2019). Best practices in pilot selection. Report no. DOT/FAA/AM-19/6. Office of Aerospace Medicine. https://www.faa.gov/data_research/research/med_humanfacs/oamtechreports/2010s/media/201906.pdf First citation in articleGoogle Scholar

  • Bruder, C., Eißfeldt, H., Grasshoff, D., Friedrich, M., Hasse, C., Hoermann, H.-J., Hoff, A., Papenfuß, A., Schulze Kissing, D., Uebbing-Rumke, M., Wenzel, J., & Zierke, O. (2013). Simulator-based research on operational monitoring and decision making for human operators in future aviation (Project Report Aviator II). DLR, Hamburg. First citation in articleGoogle Scholar

  • Burke, E. F., Kitching, A., & Valsler, C. (1997). The Pilot Aptitude Tester (PILAPT): On the development and validation of a new computer-based test battery for selecting pilots. Proceedings of the 9th International Symposium on Aviation Psychology. The Ohio State University. First citation in articleGoogle Scholar

  • Campbell, J. S., Castaneda, M., & Pulos, S. (2009). Meta-analysis of personality assessments as predictors of military aviation training success. The International Journal of Aviation Psychology, 20(1), 92–109. https://doi.org/10.1080/10508410903415872 First citation in articleCrossref, Google Scholar

  • Carretta, T. R. (2011). Pilot Candidate Selection Method. Still an effective candidate predictor for US Air Force pilot training performance. Aviation Psychology and Applied Human Factors, 1(1), 3–8. https://doi.org/10.1027/2192-0923/a00002 First citation in articleLink, Google Scholar

  • Carretta, T. R., & King, R. E. (2020). History of pilot selection. In R. BorC. EriksenT. P. HubbardR. KingEds., Pilot selection. Psychological principles and practice (pp. 9–20). CRC Press. First citation in articleGoogle Scholar

  • Carretta, T. R., & Ree, M. J. (2003). Pilot selection methods. In P. S. TsangM. A. VidulichEds., Principles and practice of aviation psychology (pp. 357–396). Lawrence Erlbaum Associates. First citation in articleGoogle Scholar

  • Carretta, T. R., Teachout, M. S., Ree, M. J., Barto, E. L., King, R. E., & Michaels, C. F. (2014). Consistency of the relations of cognitive ability and personality traits to pilot training performance. The International Journal of Aviation Psychology, 24(4), 247–264. https://doi.org/10.1080/10508414.2014.949200 First citation in articleCrossref, Google Scholar

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale. First citation in articleGoogle Scholar

  • Damos, D. (2011). KSAOs for military pilot selection: A review of the literature. Report number AFCAPS-FR-2011-0003. Air Force Personnel Center Strategic Research and Assessment. First citation in articleGoogle Scholar

  • Dockeray, F. C., & Isaacs, S. (1921). Psychological research in aviation in Italy, France, England, and the American Expeditionary Forces. Journal of Comparative Psychology, 1, 115–148. First citation in articleCrossref, Google Scholar

  • Eißfeldt, H. (2014). Commentary on the article by King: Select in/select out- what aviation psychology offers for pilot selection. The International Journal of Aviation Psychology, 24(1), 78–81. https://doi.org/10.1080/10508414.2014.860840 First citation in articleCrossref, Google Scholar

  • Eißfeldt, H., Grasshoff, D., Hasse, C., Hoermann, H.-J., Kissing, D. S., Stern, C., Wenzel, J., & Zierke, O. (2009). Aviator 2030. Ability requirements in future ATM systems II: Simulations and experiments. Deutsches Zentrum für Luft- und Raumfahrt e. V. Institut für Luft- und Raumfahrtmedizin, Luft- und Raumfahrtpsychologie. http://www.dlr.de/me/Portaldata/25/Resources/dokumente/Aviator_2030_Report_FB_2009-28.pdf First citation in articleGoogle Scholar

  • Engvik, H. (1993). “Big Five” på norsk [Big Five in Norwegian]. Journal of the Norwegian Psychologists Association, 30, 884–896. First citation in articleGoogle Scholar

  • Engvik, H. (1997). 5PFmil 2.0 (Computer software). Department of Psychology, University of Oslo, Norway. First citation in articleGoogle Scholar

  • European Federation of Psychologists’ Association (EFPA). (2013). EFPA review model for the description and evaluation of psychological tests: Test review form and notes for reviewers, v 4.2.6. http://www.efpa.eu/professional-development First citation in articleGoogle Scholar

  • European Union Aviation Safety Agency (EASA). (2018a July 23). Commission regulation (EU) 2018/1042 (CAT.GEN.MPA.175). https://eur-lex.europa.eu/legal-content/EN/TXT/HTML/?uri=CELEX%3A32018R1042&from=EN First citation in articleGoogle Scholar

  • European Union Aviation Safety Agency (EASA). (2018b, November 28). Annex III to Decision 2018/012/R “AMC and GM to Part-CAT – Issue 2, Amendment 15”. https://www.easa.europa.eu/sites/default/files/dfu/Annex%20III%20to%20EDD%202018-012-R.pdf First citation in articleGoogle Scholar

  • Friborg, O., Barlaug, D., Martinussen, M., Rosenvinge, J. H., & Hjemdal, O. (2005). Resilience in relation to personality and intelligence. International Journal of Methods in Psychiatric Research, 14(1), 29–42. https://doi.org/10.1002/mpr.15 First citation in articleCrossref, Google Scholar

  • Goeters, K. M., Maschke, P., & Eißfeldt, H. (2004). Ability requirements in core aviation professions: Job analysis of airline pilots and air traffic controllers. In K. M. GoetersEd., Aviation psychology: Practice and research (pp. 99–119). Ashgate Publishing. First citation in articleGoogle Scholar

  • Hörmann, H. J., & Goerke, P. (2014). Assessment of social competence for pilot selection. The International Journal for Aviation Psychology, 24(1), 6–28. https://doi.org/10.1080/10508414.2014.860843 First citation in articleCrossref, Google Scholar

  • Hörmann, H. J., & Maschke, P. (1993). Personality scales as predictors of job success of airline pilots. In R. S. JensenEd., Proceedings of the 7th International Symposium on Aviation Psychology (pp. 450–454). The Ohio State University. First citation in articleGoogle Scholar

  • Hörmann, H. J., & Maschke, P. (1996). On the relation between personality and job performance of airline pilots. International Journal of Aviation Psychology, 6, 171–178. https://doi.org/10.1207/s15327108ijap0602_4 First citation in articleCrossref, Google Scholar

  • Hunter, D. R. (1989). Aviator selection. In M. F. WiskoffG. F. RamptonEds., Military personnel measurement: Testing, assignment, evaluation (pp. 129–167). Praeger. First citation in articleGoogle Scholar

  • Hunter, D. R., & Burke, E. F. (1994). Predicting aircraft pilot-training success: A meta-analysis of published research. International Journal of Aviation Psychology, 4(4), 297–313. https://doi.org/10.1207/s15327108ijap0404_1 First citation in articleCrossref, Google Scholar

  • International Civil Aviation Organization (IATA). (2019). Pilot aptitude testing. Guidance material and best practices for pilot aptitude testing (3rd ed.). https://www.iata.org/contentassets/19f9168ecf584fc7b4af8d6d1e35c769/pilot-aptitude-testing-guide.pdf First citation in articleGoogle Scholar

  • Johnson, J. F., Barron, L. G., Carretta, T. R., & Rose, M. R. (2017). Predictive validity of spatial ability and perceptual speed test for aviator training. The International Journal of Aerospace Psychology, 27(3–4), 109–120. https://doi.org/10.1080/24721840.2018.1442222 First citation in articleCrossref, Google Scholar

  • Johnson, J. T., & Ree, M. J. (1994). Rangej: A Pascal program to compute the multivariate correction for range restriction. Educational and Psychological Measurement, 54(3), 693–695. First citation in articleCrossref, Google Scholar

  • Lang-Ree, O. C. (2021). Test-retest reliability estimates of pilot selection tests: A small scale study. Internal short report. Norwegian Armed Forces Joint Medical Services, Oslo, Norway. First citation in articleGoogle Scholar

  • Lang-Ree, O. C., Martinussen, M., & Ødegaard, P. E. (2010, September 20–24). Pilot selection in the Norwegian Air Force: A validation study. Poster presented at the European Association for Aviation Psychology 29th Conference, Budapest, Hungary First citation in articleGoogle Scholar

  • Lawley, D. (1944). IV – A note on Karl Pearson’s selection formulae. Proceedings of the Royal Society of Edinburgh. Section A. Mathematical and Physical Sciences, 62(1), 28–30. https://doi.org/10.1017/S0080454100006385 First citation in articleCrossref, Google Scholar

  • Levashina, J., Hartwell, C. J., Morgeson, F. P., & Campion, M. A. (2014). The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psychology, 67(1), 241–293. https://doi.org/10.1111/peps.12052 First citation in articleCrossref, Google Scholar

  • Martinussen, M. (1996). Psychological measures as predictors of pilot performance: A meta-analysis. International Journal of Aviation Psychology, 6(1), 1–20. https://doi.org/10.1207/s15327108ijap0601_1 First citation in articleCrossref, Google Scholar

  • Martinussen, M. (2016). Pilot selection. An overview of aptitude and ability assessment. In R. BorC. EriksenM. OaksP. ScraggEds., Pilot mental health assessment and support (pp. 23–39). Routledge Taylor and Francis Group. First citation in articleGoogle Scholar

  • Martinussen, M., & Torjussen, T. (1998). Pilot selection in the Norwegian Air Force: A validation and meta-analysis of the test battery. The International Journal of Aviation Psychology, 8(1), 33–45. https://doi.org/10.1207/s15327108ijap0801_2 First citation in articleCrossref, Google Scholar

  • Martinussen, M., & Torjussen, T. M. (2004). Initial validation of a computer-based assessment battery for pilot selection in the Norwegian Air Force. Human Factors and Aerospace Safety, 4(3), 233–244. First citation in articleGoogle Scholar

  • Morgeson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J. R., Murphy, K., & Schmitt, N. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60, 683–729. https://doi.org/10.1111/j.1744-6570.2007.00089.x First citation in articleCrossref, Google Scholar

  • Paullin, C., Katz, L., Bruskiewicz, K. T., Houston, J., & Damos, D. (2006). Review of aviator selection (Technical report 1183). United States Army Research Institute for the Behavioral and Social Sciences. First citation in articleGoogle Scholar

  • Raven, J. C. (1986). Advanced progressive matrices. Psychologist Press. First citation in articleGoogle Scholar

  • Salgado, J. F. (1998). Big Five personality dimensions and job performance in army and civilian occupations: A European perspective. Human Performance, 11(2), 271–288. https://doi.org/10.1207/s15327043hup1102&3_8 First citation in articleCrossref, Google Scholar

  • Salgado, J. F., & Táuriz, G. (2014). The Five-Factor Model, forced-choice personality inventories and performance: A comprehensive meta-analysis of academic and occupational validity studies. European Journal of Work and Organizational Psychology, 23(1), 3–30. https://doi.org/10.1080/1359432X.2012.716198 First citation in articleCrossref, Google Scholar

  • Schmidt, F. L., Oh, I.-S., & Shaffer, J. A. (2016). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 100 years of research findings. Working paper. https://doi.org/10.13140/RG2.2.18843.26400 First citation in articleGoogle Scholar

  • The Pilot Aptitude Tester (PILAPT) and Controller Aptitude Tester (CONAPT). (2006). Manual. Peoples’ Technologies. First citation in articleGoogle Scholar

  • Zierke, O. (2014). Predictive validity of knowledge tests. Aviation Psychology and Applied Human Factors, 4(1), 98–105. https://doi.org/10.1027/2192-0923/a000061 First citation in articleLink, Google Scholar