Skip to main content
Original Article

Ruminating in English, Ruminating in Spanish

Psychometric Evaluation and Validation of the Ruminative Thought Style Questionnaire in Spain, Argentina, and USA

Published Online:https://doi.org/10.1027/1015-5759/a000465

Abstract. The present study aimed to adapt and validate a Spanish version of the Ruminative Thought Style Questionnaire (RTSQ) and test for measurement invariance of the RTSQ across college students in the US, Spain, and Argentina (n = 1,632). Additionally, we examined/compared across these countries, criterion-related (i.e., concurrent) validity of RTSQ factors (i.e., problem-focused thoughts, counterfactual thinking, repetitive thoughts, and anticipatory thoughts) on constructs theoretically-associated with rumination. Consistent with previous findings, we found that a 15-item 4-factor RTSQ provided a more adequate model compared to single-factor CFA models (15- and 20-item versions) in every country. The reliability and validity of the subscales for the Spanish version were satisfactory-to-good in Spain and Argentina. Using multigroup confirmatory factor analyses, we found the 15-item 4-factor version of the RTSQ to be invariant across countries and sex. Bivariate correlations provided evidence for the criterion-related validity of the 4-factor RTSQ across the countries. Our findings suggest that self-report items of the RTSQ convey the same meaning, and that responses to those items load onto the same set of factors, across languages and cultures of administration. Taken together, our findings serve as a foundation for future cross-cultural work testing models in which rumination is a central facet.

References

  • Bravo, A. J., Pearson, M. R., & Henson, J. M. (2017). Drinking to cope with depressive symptoms and ruminative thinking: A multiple mediation model among college students. Substance Use & Misuse, 52, 52–62. https://doi.org/10.1080/10826084.2016.1214151 First citation in articleCrossrefGoogle Scholar

  • Brinker, J. K., & Dozois, D. J. A. (2009). Ruminative thought style and depressed mood. Journal of Clinical Psychology, 65, 1–19. https://doi.org/10.1002/jclp.20542 First citation in articleCrossrefGoogle Scholar

  • Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834 First citation in articleCrossrefGoogle Scholar

  • Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5 First citation in articleCrossrefGoogle Scholar

  • Conway, M., Csank, P. A., Holm, S. L., & Blake, C. K. (2000). On assessing individual differences in rumination on sadness. Journal of Personality Assessment, 75, 404–425. https://doi.org/10.1207/S15327752JPA7503_04 First citation in articleCrossrefGoogle Scholar

  • d’Acremont, M., & Van der Linden, M. (2007). How is impulsivity related to depression in adolescence? Evidence from a French validation of the cognitive emotion regulation questionnaire. Journal of Adolescence, 30, 271–282. https://doi.org/10.1016/j.adolescence.2006.02.007 First citation in articleCrossrefGoogle Scholar

  • Extremera, N., & Fernández-Berrocal, P. (2006). Validity and reliability of Spanish versions of the ruminative responses scale-short form and the distraction responses scale in a sample of Spanish high school and college students. Psychological Reports, 98, 141–150. https://doi.org/10.2466/PR0.98.1.141-150 First citation in articleCrossrefGoogle Scholar

  • Fisher, R. A. (1915). Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika, 10, 507–521. https://doi.org/10.2307/2331838 First citation in articleGoogle Scholar

  • Helmig, S., Meyer, A. H., & Bader, K. (2016). Validierung einer deutschen Version des Ruminative Thought Style Questionnaire (RTS-D) [Validation of a German version of the Ruminative Thought Style Questionnaire (RTS-D)]. Zeitschrift für Klinische Psychologie und Psychotherapie, 45, 49–60. https://doi.org/10.1026/1616-3443/a000345 First citation in articleLinkGoogle Scholar

  • International Test Commission. (2015). Guidelines for practitioner use of test revisions, obsolete tests, and test disposal. Retrieved from https://www.intestcom.org/files/guideline_test_disposal.pdf First citation in articleGoogle Scholar

  • Johnson, D. P., & Whisman, M. A. (2013). Gender differences in rumination: A meta-analysis. Personality and Individual Differences, 55, 367–374. https://doi.org/10.1016/j.paid.2013.03.019 First citation in articleCrossrefGoogle Scholar

  • Li, C. H. (2015). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48, 936–949. https://doi.org/10.3758/s13428-015-0619-7 First citation in articleCrossrefGoogle Scholar

  • Loewenthal, K. M. (2001). An introduction to psychological tests and scales. East Sussex, UK: Psychology Press. First citation in articleGoogle Scholar

  • Lubke, G. H., & Muthén, B. O. (2004). Applying multigroup confirmatory factor models for continuous outcomes to Likert scale data complicates meaningful group comparisons. Structural Equation Modeling, 11, 514–534. https://doi.org/10.1207/s15328007sem1104_2 First citation in articleCrossrefGoogle Scholar

  • Lynam, D. R., Smith, G. T., Whiteside, S. P., & Cyders, M. A. (2006). The UPPS-P: Assessing five personality pathways to impulsive behavior. West Lafayette, IN: Purdue University. First citation in articleGoogle Scholar

  • Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11, 320–341. https://doi.org/10.1207/s15328007sem1103_2 First citation in articleCrossrefGoogle Scholar

  • Masten, W. G., Caldwell-Colbert, A. T., Alcala, S. J., & Mijares, B. E. (1986). Confiabilidad y validez de la escala de Depresión del Centro de Estudios Epidemiológicos [Reliability and validity of the Center for Epidemiological Studies Depression Scale]. Hispanic Journal of Behavioral Sciences, 8, 77–84. First citation in articleCrossrefGoogle Scholar

  • Mitchell, M. A., Contractor, A. A., Dranger, P., & Shea, M. T. (2016). Unique relations between counterfactual thinking and DSM-5 PTSD symptom clusters. Psychological Trauma: Theory, Research, Practice, and Policy, 8, 293–300. https://doi.org/10.1037/tra0000089 First citation in articleCrossrefGoogle Scholar

  • Morizot, J. (2014). Construct validity of adolescents’ self-reported big five personality traits: Importance of conceptual breadth and initial validation of a short measure. Assessment, 21, 580–606. https://doi.org/10.1177/1073191114524015 First citation in articleCrossrefGoogle Scholar

  • Muris, P., Roelofs, J., Rassin, E., Franken, I., & Mayer, B. (2005). Mediating effects of rumination and worry on the links between neuroticism, anxiety and depression. Personality and Individual Differences, 39, 1105–1111. https://doi.org/10.1016/j.paid.2005.04.005 First citation in articleCrossrefGoogle Scholar

  • Muthén, L. K., & Muthén, B. O. (1998–2015). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén. First citation in articleGoogle Scholar

  • Nolen-Hoeksema, S. (1991). Responses to depression and their effects on the duration of depressive episodes. Journal of Abnormal Psychology, 100, 569–582. https://doi.org/10.1037/0021-843X.100.4.569 First citation in articleCrossrefGoogle Scholar

  • Nolen-Hoeksema, S., Wisco, B. E., & Lyubormisky, S. (2008). Rethinking rumination. Perspectives on Psychological Science, 3, 400–424. https://doi.org/10.1111/j.1745-6924.2008.00088.x First citation in articleCrossrefGoogle Scholar

  • Olatunji, B. O., Naragon-Gainey, K., & Wolitzky-Taylor, K. B. (2013). Specificity of rumination in anxiety and depression: A multimodal meta‐analysis. Clinical Psychology: Science and Practice, 20, 225–257. https://doi.org/10.1111/cpsp.12037 First citation in articleCrossrefGoogle Scholar

  • Ortet, G., Martínez, T., Mezquita, L., Morizot, J., & Ibáñez, M. I. (2017). Big Five Personality Trait Short Questionnaire: Preliminary validation with Spanish adults. The Spanish Journal of Psychology, 20, E7. https://doi.org/10.1017/sjp.2017.8 First citation in articleCrossrefGoogle Scholar

  • Perczek, R., Carver, C. S., Price, A. A., & Pozo-Kaderman, C. (2000). Coping, mood, and aspects of personality in Spanish translation and evidence of convergence with English versions. Journal of Personality Assessment, 74, 63–87. https://doi.org/10.1207/S15327752JPA740105 First citation in articleCrossrefGoogle Scholar

  • Pilatti, A., Lozano, O. M., & Cyders, M. A. (2015). Psychometric properties of the Spanish version of the UPPS-P Impulsive Behavior Scale: A Rasch rating scale analysis and confirmatory factor analysis. Psychological Assessment, 27, e10–e21. https://doi.org/10.1037/pas0000124 First citation in articleCrossrefGoogle Scholar

  • Potthoff, S., Garnefski, N., Miklósi, M., Ubbiali, A., Domínguez-Sánchez, F. J., Martins, E. C., … Kraaij, V. (2016). Cognitive emotion regulation and psychopathology across cultures: A comparison between six European countries. Personality and Individual Differences, 98, 218–224. https://doi.org/10.1016/j.paid.2016.04.022 First citation in articleCrossrefGoogle Scholar

  • Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385–401. First citation in articleCrossrefGoogle Scholar

  • Roelofs, J., Huibers, M., Peeters, F., Arntz, A., & van Os, J. (2008). Rumination and worrying as possible mediators in the relation between neuroticism and symptoms of depression and anxiety in clinically depressed individuals. Behaviour Research and Therapy, 46, 1283–1289. https://doi.org/10.1016/j.brat.2008.10.002 First citation in articleCrossrefGoogle Scholar

  • Roley, M. E., Claycomb, M. A., Contractor, A. A., Dranger, P., Armour, C., & Elhai, J. D. (2015). The relationship between rumination, PTSD, and depression symptoms. Journal of Affective Disorders, 180, 116–121. https://doi.org/10.1016/j.jad.2015.04.006 First citation in articleCrossrefGoogle Scholar

  • Satorra, A. (2000). Scaled and adjusted restricted tests in multi-sample analysis of moment structures. In R. D. H. HeijmansD. S. G. PollockA. SatorraEds., Innovations in multivariate statistical analysis. A Festschrift for Heinz Neudecker (pp. 233–247). London, UK: Kluwer Academic. First citation in articleGoogle Scholar

  • Satorra, A., & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514. https://doi.org/10.1007/BF02296192 First citation in articleCrossrefGoogle Scholar

  • Selby, E. A., Anestis, M. D., & Joiner, T. E. (2008). Understanding the relationship between emotional and behavioral dysregulation: Emotional cascades. Behaviour Research and Therapy, 46, 593–611. https://doi.org/10.1016/j.brat.2008.02.002 First citation in articleCrossrefGoogle Scholar

  • Tanner, A., Voon, D., Hasking, P., & Martin, G. (2013). Underlying structure of ruminative thinking: Factor analysis of the Ruminative Thought Style Questionnaire. Cognitive Therapy and Research, 37, 633–646. https://doi.org/10.1007/s10608-012-9492-1 First citation in articleCrossrefGoogle Scholar

  • Treynor, W., Gonzalez, R., & Nolen-Hoeksema, S. (2003). Rumination reconsidered: A psychometric analysis. Cognitive Therapy and Research, 27, 247–259. https://doi.org/10.1023/A:1023910315561 First citation in articleCrossrefGoogle Scholar

  • Verdejo-García, A., Lozano, Ó., Moya, M., Alcázar, M. Á., & Pérez-García, M. (2010). Psychometric properties of a Spanish version of the UPPS-P impulsive behavior scale: Reliability, validity and association with trait and cognitive impulsivity. Journal of Personality Assessment, 92, 70–77. https://doi.org/10.1080/00223890903382369 First citation in articleCrossrefGoogle Scholar

  • Voon, D., Hasking, P., & Martin, G. (2014). Change in emotion regulation strategy use and its impact on adolescent non-suicidal self-injury: A three-year longitudinal analysis using latent growth modeling. Journal of Abnormal Psychology, 123, 487–498. First citation in articleCrossrefGoogle Scholar