Abstract
The predictive validity of scores from two cognitive functioning tests, the Multidimensional Aptitude Battery (MAB) and the MicroCog, was examined for initial pilot training performance. In addition to training completion, several training performance criteria were available for graduates: academic grades, daily flying grades, check ride grades, and class rank. Mean score comparisons and correlations in samples of between 5,582 and 12,924 trainees across the two tests showed small but statistically significant relationships with training performance. For example, after correction for range restriction and dichotomization of the criterion, the MAB full-scale IQ score and the MicroCog General Cognitive Functioning score were correlated .29 and .26 respectively with initial pilot training completion. The results pointed to general cognitive ability as the main predictor of training performance. Comparisons with results from studies involving US Air Force pilot aptitude tests showed lower validities for these cognitive functioning tests. This finding likely occurred because the pilot aptitude tests measure additional factors (e.g., aviation knowledge/experience and psychomotor skills) that are predictive of training success and that are not covered by the cognitive functioning tests.
References
(1986). Aptitude selection for Air Force officer non-aircrew jobs. Paper presented at the annual meeting of the Military Testing Association, Mystic, CT.
(1990). Air Force Officer Qualifying Test (AFOQT): Predictors of undergraduate pilot training and undergraduate navigator training success. (AFHRL-TP-89–52) Brooks AFB, San Antonio, TX: Air Force Human Resources Laboratory, Manpower and Personnel Division.
(2005). Psychological test profiles of USAF pilots before training vs. type aircraft flown. Aviation, Space, and Environmental Medicine, 76, 463–468.
(2005). Development and validation of the Test of Basic Aviation Skills (TBAS). (AFRL-HE-WP-TR-2005–0172) Wright-Patterson AFB, OH: Air Force Research Laboratory, Human Effectiveness Directorate.
(2008). Predictive validity of the Air Force Officer Qualifying Test for USAF air battle manager training performance (AFRL-RH-WP-TR-2009–0007) Wright-Patterson AFB, OH: Air Force Research Laboratory, Human Effectiveness Directorate, Warfighter Interface Division.
(2010). Predictive validity of the Air Force Officer Qualifying Test for non-rated officer specialties. Military Psychology, 22, 450–464.
(2011). Pilot candidate selection method: Still an effective predictor of US Air Force pilot training performance. Aviation Psychology and Applied Human Factors, 1, 3–8. doi: 10.1027/2192-0923/a00002
(2013). Predictive validity of pilot selection instruments for remotely piloted aircraft training outcome. Aviation, Space, and Environmental Medicine, 84, 1–7.
(1995). Air Force Officer Qualifying Test validity for predicting pilot training performance. Journal of Business and Psychology, 9, 379–388.
(1996). Factor structure of the Air Force Officer Qualifying Test: Analysis and comparison. Military Psychology, 8, 29–42.
(2003). Pilot selection methods. In , Human factors in Transportation: Principles and practice of aviation psychology (pp. 357–396). Mahwah, NJ: Erlbaum.
(1998). A comparison of two U.S. Air Force pilot aptitude tests. Aviation, Space, and Environmental Medicine, 69, 931–935.
(2010). Multiple Aptitude Battery-II normative intelligence test data that distinguish U.S. Air Force AC-130 gunship sensor operators. (AFRL-SA-BR-TR-2010–0006) Brooks AFB, San Antonio, TX: US Air Force School of Aerospace Medicine.
(2010). Joint use of the MAB-II and MicroCog for improvements in the clinical and neuropsychological screening and aeromedical waiver process of rated USAF pilots. (AFRL-SA-BR-TR-2010–0002) Brooks AFB, San Antonio, TX: US Air Force School of Aerospace Medicine.
(1983). The cost of dichotomization. Applied Psychological Measurement, 7, 249–253.
(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
(1989). The tenth mental measurements yearbook. Lincoln, NE: University of Nebraska Press.
(1985). The NEO personality inventory manual. Odessa, FL: Psychological Assessment Resources.
(2009). Fluid intelligence and spatial reasoning as predictors of pilot training performance in the South African Air Force (SAAF). South African Journal of Industrial Psychology, 35, 1–8.
(2010). Factor structure of the Air Force Officer Qualification Test Form S: Analysis and comparison with previous forms. Military Psychology, 22, 68–85.
(1985). Relationship between Air Force Officer Qualifying Test scores and success in air weapons controller training. (AFHRL-TR-85–13) Brooks AFB, San Antonio, TX: Air Force Human Resources Laboratory, Manpower and Personnel Division.
(1988). Validity of the academic aptitude composite of the Air Force Officer Qualifying Test (AFOQT). (AFHRL-TP-87–61) Brooks AFB, San Antonio, TX: Air Force Human Resources Laboratory, Manpower and Personnel Division.
(2011). A bibliographic database for the history of pilot training selection. (AFCAPS-FR-2011–0010) Randolph AFB, TX: Air Force Personnel Center.
(1995). Handbook of pilot selection. Brookfield, VT: Avebury Aviation.
(2004). Methods of meta-analysis. Thousand Oaks, CA: Sage.
(1984). Multidimensional Aptitude Battery: Manual. Port Huron, MI: Research Psychologists Press.
(1998). Multidimensional Aptitude Battery-II: Manual. Port Huron, MI: SIGMA Assessment Systems.
(1994). RANGEJ: A Pascal program to compute the multivariate correction for range restriction. Educational and Psychological Measurement, 54, 693–695.
(2012). Psychological testing for mental health screening, suitability determinations, and archival purposes to improve safety and reduce costs. Paper presented at the 30th meeting of the European Association of Aviation Psychology, Villasimius, Sardinia, Italy
(2011). Compilation of pilot personality norms. (AFRL-SA-WP-TR-2011–0008) Wright-Patterson AFB, OH: US Air Force School of Aerospace Medicine.
(2011). Compilation of pilot cognitive ability norms. (AFRL-SA-WP-TR-2012–0001) Wright-Patterson AFB, OH: US Air Force School of Aerospace Medicine, Aeromedical Research Department.
(1995). Defining and measuring the ‘Right Stuff’: Neuropsychiatrically enhanced flight screening (N-EFS). Aviation, Space, and Environmental Medicine, 66, 951–956.
(1991). The construct validity of the Multidimensional Aptitude Battery: A word of caution. Journal of Clinical Psychology, 47, 691–697.
(2001). A comprehensive meta-analysis of the predictive validity of the Graduate Record Examinations: Implications for graduate student selection and performance. Psychological Bulletin, 127, 162–181.
(2004). Academic performance, career potential, creativity, and job performance: Can one construct predict them all?. Journal of Personality and Social Psychology, 86, 148–161.
(1943). A note on Karl Pearson’s selection formulae. Proceedings of the Royal Society of Edinburgh, 62, (Sect. A, Pt. 1) 28–30.
(1990). Note on the construct validity of the Multidimensional Aptitude Battery. Psychological Reports, 67, 1219–1222.
(2000). Practical Meta-Analysis. Thousand Oaks, CA: Sage.
(1996). Psychological measures as predictors of pilot performance: A meta-analysis. International Journal of Aviation Psychology, 6, 1–20.
(1998). Pilot selection in the Norwegian air force: A validation and meta-analysis of the test battery. International Journal of Aviation Psychology, 8, 35–45.
(1994). Predicting pilot and navigator criteria: Not much more than g . Journal of Applied Psychology, 79, 845–51.
(2006). Review of aviator selection. (Technical Report 1183) Arlington, VA: US Army Research Institute for the Behavioral and Social Sciences.
(1993). MicroCog: Assessment of cognitive functioning (Version 2.1) manual. San Antonio, TX: Psychological Corporation.
(1996). Central role of g in military pilot selection. International Journal of Aviation Psychology, 6, 111–123.
(1995). Role of ability and prior job knowledge in complex training performance. Journal of Applied Psychology, 80, 721–730.
(1995). USAF pilot training completion and retention: A ten year follow-up on psychological testing. (AL/AO-TR-1995–0124) Brooks AFB, San Antonio, TX: Armstrong Laboratory.
(1996). Gender and racial equity of the Air Force Officer Qualifying Test in officer training school selection decisions. Military Psychology, 8, 95–113.
(1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262–274.
. (2011). Medical examinations and standards. (Air Force Instruction 48–123). Washington, DC: Department of the Air Force.
(2000). Clinician’s guide to neuropsychological assessment (2nd ed.). Mahwah, NJ: Erlbaum.
(1988). Investigating the construct validity of the Multidimensional Aptitude Battery. Psychological Reports, 62, 871–878.
(1989). A further note on the construct validity of the Multidimensional Aptitude Battery. Journal of Clinical Psychology, 45, 429–433.
(1981). Wechsler Adult Intelligence Scales–Revised (WAIS-R). New York: Psychological Corporation.
(1998). Entry to USAF undergraduate flying training. (AFRL-HE-AZ-TR-1998–0077) Brooks AFB, San Antonio, TX: Air Force Research Laboratory, Training Effectiveness Branch, Warfighter Training Research Division.
(2012). Predictive validity in aviation psychology: Really not much more than g? Paper presented at the 30th meeting of the European Association of Aviation Psychology, Villasimius, Sardinia, Italy.
