Abstract
Tests of subject-specific knowledge (mathematics, physics, and English as a foreign language for non-English-speaking countries) are commonly used in test batteries for the selection of ab initio pilots – for example, the Air Force Officer Qualifying Test (AFOQT) or the German Aerospace Center (DLR) assessment. However, in validity research, knowledge tests are often underrepresented. This study evaluated the predictive validity of knowledge tests compared with cognitive ability tests and school grades. The validity criterion was the outcome of pilot training (pass/fail) of a preselected group of applicants (N = 402) who completed a 2-year flight training program. The predictive validity of the entire test battery was r = .55. Cognitive ability tests, knowledge tests, and school grades emerged as comparably valid predictors. These findings are discussed in the framework of Cattell’s theory of fluid and crystallized intelligence, suggesting that knowledge tests are predictively valid because they are indicators of motivation and of being a good learner.
References
(1992). Intelligence. San Diego, CA: Academic Press.
(2001). Predicting success in college: SAT studies of classes graduating since 1980 (College Board research report, No. 2). New York: College Entrance Examination Board.
(2011). Pilot candidate selection method: Still an effective predictor of US Air Force pilot training performance. Aviation Psychology and Applied Human Factors, 1, 3–8. doi: 10.1027/2192-0923/a00002
(1996). Factor structure of the Air Force Officer Qualifying Test: Analysis and comparison. Military Psychology, 8, 29–42.
(2003). Pilot selection methods. In (Series Ed.) Human factors in transportation: Principles and practices of aviation psychology (pp. 357–396). Mahwah, NJ: Erlbaum.
(1963). Theory of fluid and crystallized intelligence: A critical experiment. Journal of Educational Psychology, 54, 1–22.
(1983). The cost of dichotomization. Applied Psychological Measurement, 7, 249–253.
(1993). The validity of job knowledge measures. International Journal of Selection and Measurement, 1, 153–162.
(1994). RANGEJ: A Pascal program to compute the multivariate correction for range restriction. Educational and Psychological Measurement, 54, 693–695.
(2013). Standard cognitive psychological tests predict military pilot training outcomes. Aviation Psychology and Applied Human Factors, 3, 28–38. doi: 10.1027/2192-0923/a000040
(2002). The utility of the SAT I and SAT II for admissions decisions in California and the nation (Research report No. 2002–6). New York: Entrance Examination Board.
(2001). A comprehensive meta-analysis of the predictive validity of the Graduate Record Examinations: Implications for graduate student selection and performance. Psychological Bulletin, 127, 162–181.
(2007). Extended criteria and predictors in college admission: Exploring the structure of study success and investigating the validity of domain knowledge. Psychology Science, 49, 88–114.
(1943). A note on Karl Pearsons’s selection formulae. Proceedings of the Royal Society of Edinburgh, 62(Section A, Part 1), 28–30.
(2011). The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection. Journal of Applied Psychology, 96, 927–940.
(1996). Psychological measures as predictors of pilot performance: A meta-analysis. The International Journal of Aviation Psychology, 6, 1–20.
(1998). Pilot selection in the Norwegian Air Force: A validation and meta-analysis of the test battery. The International Journal of Aviation Psychology, 8, 33–45.
(2011). How do astronaut candidate profiles differ from airline pilot profiles? Aviation Psychology and Applied Human Factors, 1, 38–44.
(1994). Predicting pilot and navigator criteria: Not much more than g . Journal of Applied Psychology, 79, 845–851.
(2013). Predictive validity of a selection procedure for air traffic controller trainees. Aviation Psychology and Applied Human Factors, 3, 19–27. doi: 10.1027/2192-0923/a000039
(1998/1999). A test of three models of the role of g and prior job knowledge in the acquisition of subsequent job knowledge in training. Training Research Journal, 4, 135–150.
(1995). Role of ability and prior job knowledge in complex training performance. Journal of Applied Psychology, 80, 721–730.
(2004). Do psychosocial and study skill factors predict college outcomes? A meta-analysis. Psychological Bulletin, 130, 261–288.
(1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262–274.
(1904). “General intelligence”, objectively determined and measured. American Journal of Psychology, 15, 201–293.
(1996). Cognitive-components tests are not much more than g: An extension of Kyllonen’s analyses. The Journal of General Psychology, 123, 193–205.
(2013). Diagnostische Herausforderungen bei der Auswahl von Frühstudierenden
[Selecting high school students for advanced placement in universities: Diagnostic problems] . Diagnostica, 59, 61–72.(2007). Die Validität von Schulnoten zur Vorhersage des Studienerfolgs: eine Metaanalyse
[The validity of school grades for predicting academic achievement: A meta-analysis] . Zeitschrift für Pädagogische Psychologie, 21, 11–27.(1990). Predicting college grades: An analysis of institutional trends over two decades. Princeton, NJ: Educational Testing Service.
