Grit
Two Related but Independent Constructs Instead of One. Evidence From Item Response Theory
Abstract
Abstract. The Grit scale is a popular measure of achievement-striving behavior. Consisting of two subscales, Consistency of Interests (CI) and Perseverance of Effort (PE), this scale has been repeatedly demonstrated to have high reliability and validity. At the same time, an increasing number of studies explicitly report a low correlation between the subscales and distinct patterns of associations with external measures that each subscale forms. We explored whether there is psychometric evidence that a substantive single grit construct underlies the scale. To answer this question, we investigated the scale structure in a more robust framework than the classical test theory and factor analyses could previously provide. The Russian version of the Grit scale was developed and implemented on a representative sample of high school students (n = 2,269), and different models of item response theory (IRT), both unidimensional and multidimensional, were compared to find the best fitting model. The results confirmed that the subscales reflect related but independent constructs rather than the whole grit construct. The psychometric properties of the subscales were analyzed with the two-dimensional Partial Credit Model. Both subscales of the Russian version of the Grit scale are unidimensional, have good psychometric properties, and can be used to estimate respondents’ ability.
References
1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1–23. doi: 10.1177/0146621697211001
(1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716–723. doi: 10.1109/TAC.1974.1100705
(1988). Rasch models for measurement. Newbury Park, CA: Sage.
(2013). The predictive role of grit on metacognition in Turkish university students. Studia Psychologica, 55, 311–320.
(1993). An examination of the psychometric properties of measures of negative affect in the PANAS-X scales. Journal of Personality and Social Psychology, 65, 836–851. doi: 10.1037/0022-3514.65.4.836
(1999). The ITC international guidelines for test use. Hull, UK: University of Hull, Psychology Department.
(2004). The relationship of entrepreneurial traits, skill, and motivation to subsequent venture growth. The Journal of Applied Psychology, 89, 587–598. doi: 10.1037/0021-9010.89.4.587
(2015). Keep on truckin’ or stay the course? Exploring grit dimensions as differential predictors of educational achievement, satisfaction, and intentions. Social Psychological and Personality Science, 6, 639–645. doi: 10.1177/1948550615574300
(2003). An introduction to multidinemsional measurement using Rasch models. Journal of Applied Measurement, 4, 87–100.
(2014). Grit and academic performance: Is being grittier better? (Doctoral dissertation). Miami, FL: University of Miami.
(2012). Development and validation of a motivational persistence scale. Psihologija, 45, 99–120. doi: 10.2298/PSI1202099C
(2016). Much ado about grit: A meta-analytic synthesis of the grit literature. Journal of Personality and Social Psychology, . doi: 10.1037/pspp0000102
(1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302. doi: 10.1037/h0040957
(2015). Perseverance counts but consistency does not! Validating the short grit scale in a collectivist setting. Current Psychology, 35, 121–130. doi: 10.1007/s12144-015-9374-2
(2014). Self-control and grit: Related but separable determinants of success. Current Directions in Psychological Science, 23, 319–325. doi: 10.1177/0963721414541462
(2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92, 1087–1101. doi: 10.1037/0022-3514.92.6.1087
(2009). Positive predictors of teacher effectiveness. The Journal of Positive Psychology, 4, 540–547. doi: 10.1080/17439760903157232
(1990). Examining the relationships among self-report measures of the Type A behavior pattern: The effects of dimensionality, measurement error, and differences in underlying constructs. The Journal of Applied Psychology, 75, 440–454. doi: 10.1037/0021-9010.75.4.440
(2000). Item response theory for psychologists. Hillsdale, NJ: Erlbaum.
(2014). The grit effect: Predicting retention in the military, the workplace, school and marriage. Frontiers in Psychology, 5, 36. doi: 10.3389/fpsyg.2014.00036
(2016). Grit in Latino middle school students: Construct validity and psychometric properties of the short grit scale (Master’s thesis). New Brunswick, NJ: Rutgers University, Graduate School – New Brunswick.
(2015). Factor validity of a proactive and reactive aggression rating scale. Journal of Child and Family Studies, 24, 2734–2744. doi: 10.1007/s10826-014-0075-5
(2009). Model selection indices for polytomous items. Applied Psychological Measurement, 33, 499–518. doi: 10.1177/0146621608327800
(2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3, 85–106.
(2011). A user’s guide to WINSTEPS program manual 3.71.0, Retrieved from http://www.winsteps.com/a/winsteps.pdf
(1985). A strategy for the graphical representation of Rasch model residuals. Educational and Psychological Measurement, 45, 851–859. doi: 10.1177/0013164485454015
(1996). Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology, 70, 810–819. doi: 10.1037/0022-3514.70.4.810
(2015). Work ethic and grit: An examination of empirical redundancy. Personality and Individual Differences, 86, 401–405. doi: 10.1016/j.paid.2015.07.009
(2012). Association of “grit” and satisfaction in rural and nonrural doctors. The Journal of the American Board of Family Medicine, 25, 832–839. doi: 10.3122/jabfm.2012.06.110044
(2014). True grit: Trait-level perseverance and passion for long-term goals predicts effectiveness and retention among novice teachers. Teachers College Record, 116, 030302
(2015). The relationships among creativity, grit, academic motivation, and academic success in college students (Doctoral dissertation). Lexington, KY: Universtity of Kentucky. Retrieved from http://uknowledge.uky.edu/edp_etds/39/
(2014). The relationship between grit and resident well-being. The American Journal of Surgery, 207, 251–254. doi: 10.1016/j.amjsurg.2013.09.006
(1978). Estimating the dimension of a model. Annals of Statistics, 6, 461–464. doi: 10.1214/aos/1176344136
(2014). Storm clouds in the mind: A comparison of hope, grit, happiness, and life satisfaction in traditional and alternative high school students (Doctoral dissertation). Hempstead, NY: Hofstra University.
(2013). Gritty people try harder: Grit and effort-related cardiac autonomic activity during an active coping challenge. International Journal of Psychophysiology, 88, 200–205. doi: 10.1016/j.ijpsycho.2013.04.007
(2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3, 205–231.
(2003).
(Substantive scale construction . In E. V. SmithR. M. SmithEds., Introduction to Rasch measurement (pp. 282–297). Maple Grove, MN: JAM Press.1996). Translating tests. European Psychologist, 1, 89–99. doi: 10.1027/1016-9040.1.2.89
(2002). Normative factor structure of the AAMR adaptive behavior scale-school, second edition. Journal of Psychoeducational Assessment, 20, 337–345. doi: 10.1177/073428290202000402
(2014). A replication and extension of psychometric research on the grit scale (Master’s thesis). College Park, MD: University of Maryland.
(1998). ConQuest: Generalized item modelling software [Computer program]. Camberwell, VIC, Australia: ACER Press.
(2014). Investigating grit and its relations with college students’ self-regulated learning and academic achievement. Metacognition and Learning, 10, 293–311.
(1982). Rating scale analysis. Chicago, IL: MESA Press.
(