A Psychometric Evaluation of the Short Grit Scale
A Closer Look at its Factor Structure and Scale Functioning
Abstract
Abstract. Grit, the passion and perseverance for long-term goals, has received attention from personality psychologists because it predicts success and academic achievement. Grit has also been criticized as simply another measure of self-control or conscientiousness. A precise psychometric representation of grit is needed to understand how the construct is unique and how it overlaps with other constructs. Previous research suggests that the Short Grit Scale (Grit-S) has several psychometric limitations, such as uncertain factor structure within and across populations, uncertainty about reporting total or subscale scores, and different assessment precision at low and high levels on the construct. We conducted modern psychometric techniques including parallel analysis, measurement invariance, extrinsic convergent validity, and Item Response Theory models on two American samples. Our results suggest that the Grit-S is essentially unidimensional and that there is construct overlap with the self-control construct. Subscale factors were the result of an item doublet, where two items had highly correlated uniquenesses, showed similar item information, and were more likely to exhibit measurement bias. Findings replicated across samples. Finally, we discuss recommendations for the use of the Grit-S based on the theoretical interpretation of the unidimensional factor and our empirical findings.
References
2003). The benefits of being present: Mindfulness and its role in psychological well-being. Journal of Personality and Social Psychology, 84, 822–848. https://doi.org/10.1037/0022-3514.84.4.822
(2004). A psychometric analysis of the Self-Regulation Questionnaire. Addictive Behaviors, 29, 253–260. https://doi.org/10.1016/j.addbeh.2003.08.001
(2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48, 1–29. https://doi.org/10.18637/jss.v048.i06
(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5
(2014). Comparative measures of grit, tenacity and perseverance. International Journal of Learning, Teaching and Educational Research, 8, 16–30.
(2017). Much ado about grit: A meta-analytic synthesis of the grit literature. Journal of Personality and Social Psychology, 113, 492–511. https://doi.org/10.1037/pspp0000102
(2011). Self‐regulation strategies improve self‐discipline in adolescents: Benefits of mental contrasting and implementation intentions. Educational Psychology, 31, 17–26. https://doi.org/10.1080/01443410.2010.506003
(2014). Self-control and grit: Related but separable determinants of success. Current Directions in Psychological Science, 23, 319–325. https://doi.org/10.1177/0963721414541462
(2011). Deliberate practice spells success: Why grittier competitors triumph at the National Spelling Bee. Social Psychological and Personality Science, 2, 174–181. https://doi.org/10.1177/1948550610385872
(2007). Grit: perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92, 1087–1101. https://doi.org/10.1037/0022-3514.92.6.1087
(2009). Development and validation of the Short Grit Scale (GRIT-S). Journal of Personality Assessment, 91, 166–174. https://doi.org/10.1080/00223890802634290
(2018). A diagnostic procedure to detect departures from local independence in item response theory models. Psychological Methods, 23, 138–149. https://doi.org/10.1037/met0000121
(2018). Applying novel technologies and methods to inform the ontology of self-regulation. Behavior Research and Therapy, 101, 46–57. https://doi.org/10.1016/j.brat.2017.09.014
(2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
(2014). The grit effect: Predicting retention in the military, the workplace, school and marriage. Frontiers in Psychology, 5, 36. https://doi.org/10.3389/fpsyg.2014.00036
(2016). Using wise interventions to motivate deliberate practice. Journal of Personality and Social Psychology, 111, 728–744.
(1971). Measuring the concepts of personality. Chicago, IL: Aldine.
(2003). Individual differences in two emotion regulation processes: Implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85, 348–362. https://doi.org/10.1037/0022-3514.85.2.348
(2016). Development and evaluation of Turkish language versions of three positive psychology assessments. International Journal for the Advancement of Counseling, 38, 286–297. https://doi.org/10.1007/s10447-016-9272-9
(1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179–185. https://doi.org/10.1007/BF02289447
(2016). The problem with having two watches: Assessment of fit when RMSEA and CFI disagree. Multivariate Behavioral Research, 51, 220–239. https://doi.org/10.1080/00273171.2015.1134306
(2016). Psychometric assessment of the Short Grit Scale among Chinese adolescents. Journal of Psychoeducational Assessment, 36, 291–296. https://doi.org/10.1177/0734282916674858
(2004). Introduction to the special section on cognitive abilities: 100 years after Spearman’s (1904) “‘General intelligence’, objectively determined and measured”. Journal of Personality and Social Psychology, 86, 96–111. https://doi.org/10.1037/0022-3514.86.1.96
(2008). Introduction to statistical mediation analysis. New York, NY: Erlbaum.
(1956). A criticism of studies comparing item-weighting methods. Journal of Applied Psychology, 40, 343–344.
(2011). Statistical approaches to measurement invariance. New York, NY: Routledge.
(2012).
(Investigating measurement invariance using confirmatory factor analysis . In R. HoyleEd., Handbook of structural equation modeling (pp. 380–392). New York, NY: Gilford Press.2017). How true is grit? Assessing its relations to high school and college students’ personality characteristics, self-regulation, engagement, and achievement. Journal of Educational Psychology, 109, 599–620. https://doi.org/10.1037/edu0000153
(2016). Grit under duress: Stress, strengths, and academic success among non-citizen and citizen Latina/o first-generation college students. Hispanic Journal of Behavioral Sciences, 38, 446–466. https://doi.org/10.1177/0739986316660775
(2017). psych: Procedures for personality and psychological research (Version 1.7.5.). Evanston, IL: Northwestern University. Retrieved from https://CRAN.R-project.org/package=psych
(2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21, 137–150. https://doi.org/10.1037/met0000045
(2012). Psychometric properties of the academic grit scale. Lexington, KY: University of Kentucky.
(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. https://doi.org/10.18637/jss.v048.i02
(2017). Measuring grit: A German validation and domain-specific approach to Grit. European Journal of Psychological Assessment. Advance online publication. https://doi.org/10.1027/1015-5759/a000407
(2013). Promoting grit, tenacity, and perseverance: Critical factors for success in the 21st century. Washington, DC: US Department of Education, Department of Educational Technology.
(2014). What role does grit play in the academic success of black male collegians at predominantly white institutions? Journal of African American Studies, 18, 1–10. https://doi.org/10.1007/s12111-012-9243-0
(2004). High self‐control predicts good adjustment, less pathology, better grades, and interpersonal success. Journal of Personality, 72, 271–324. https://doi.org/10.1111/j.0022-3506.2004.00263.x
(Thissen, D.Wainer, H. (Eds.). (2001). Test scoring. New York, NY: Routledge.
2017). Grit: Two related but independent constructs instead of one. Evidence from Item Response Theory. European Journal of Psychological Assessment. Advance online publication. https://doi.org/10.1027/1015–5759/a000424
(2014). A replication and extension of psychometric research on the grit scale (Unpublished master’s thesis). University of Maryland, College Park, MD.
(1959). The comparison of regression variables. Journal of the Royal Statistical Society, Series B, 21, 396–399.
(