Validating Four Standard Scales in Spiritually Practicing and Nonpracticing Samples Using Propensity Score Matching
Abstract
Validation studies of standard scales in the particular sample that one is studying are essential for accurate conclusions. We investigated the differences in answering patterns of the Brief-Symptom-Inventory (BSI), Transpersonal Trust Scale (TPV), Sense of Coherence Questionnaire (SOC), and a Social Support Scale (F-SoZu) for a matched sample of spiritually practicing (SP) and nonpracticing (NSP) individuals at two measurement points (t1, t2). Applying a sample matching procedure based on propensity scores, we selected two sociodemographically balanced subsamples of N = 120 out of a total sample of N = 431. Employing repeated measures ANOVAs, we found an intersample difference in means only for TPV and an intrasample difference for F-SoZu. Additionally, a group × time interaction effect was found for TPV. While Cronbach’s α was acceptable and comparable for both samples, a significantly lower test-rest-reliability for the BSI was found in the SP sample (rSP = .62; rNSP = .78). Thus, when researching the effects of spiritual practice, one should not only look at differences in means but also consider time stability. We recommend propensity score matching as an alternative for randomization in variables that defy experimental manipulation such as spirituality.
References
2003). Psychometrische Überprüfung der Skala “Transpersonales Vertrauen” (TPV) in einer repräsentativen Bevölkerungsstichprobe [
(A psychometric investigation of the transpersonal trust scale in a sample representative for the German population ]. Transpersonale Psychologie und Psychotherapie, 9(1), 86–98.1979). Health, stress, and coping: New perspectives on mental and physical well-being. San Francisco: Jossey Bass.
(1993). The structure and properties of the Sense of Coherence Scale. Social Sciences and Medicine, 36, 725–733.
(2001). Changes in waiting-list patients over time: Data on some commonly-used measures. Beware! Behavior Research and Therapy, 39, 1227–1247.
(2002). Psychotherapy and social support: Integrating research on psychological helping. Clinical Psychology Review, 22, 361–379.
(2001). Tun und Lassen: Ein komplementäres Konzept der Lebenskunst [
(Acting and resting: A complementary concept for balancing life ]. Transpersonale Psychologie und Psychotherapie, 7(2), 85–102.2003). Ergebnisse empirischer Forschung zur Transpersonalen Psychotherapie [
(Transpersonal psychotherapy – Some empirical results ]. In , Den Horizont erweitern – Die transpersonale Dimension in der Psychotherapie [Broadening one’s horizons – The transpersonal dimension within psychotherapy ] (pp. 93–135). Berlin, Germany: Ulrich Leutner.1972). Social statistics. New York: McGraw-Hill.
(2006). Variable selection for propensity score models. American Journal of Epidemiology, 163, 1149–1156.
(1994). SCL-90-R, Brief Symptom Inventory, and matching clinical rating scales. The use of psychological testing for treatment planning and outcome assessment, 217–248.
(2005). Methodological pitfalls in the study of religiosity and spirituality. Western Journal of Nursing Research, 27, 628–647.
(2002). F-SozU – Fragebogen zur sozialen Unterstützung (F-SozU) [
(F-SoZu: a scale for measuring social support ]. In , Diagnostische Verfahren in der Psychotherapie [Diagnostic instruments for psychotherapy ] (pp. 150–153). Göttingen: Hogrefe.2000). Spirituality and health: What we know, what we need to know. Journal of Social and Clinical Psychology, 19, 102–116.
(1997). Some conceptual considerations on the sense of coherence. Social Science and Medicine, 44, 1771–1779.
(2003). Advances in the conceptualization and measurement of religion and spirituality: Implications for physical and mental health research. American Psychologist, 58, 64–74.
(2002). Social support interventions: Do they work? Clinical Psychology Review, 22, 381–440.
(2002). Brief Symptom Inventory von L.R. Derogatis. In , Brickenkamp Handbuch psychologischer und pädagogischer Tests [
(Brickenkamp manual of psychological and pedagogical tests ] (pp. 822–825). Göttingen: Hogrefe.2001). Handbook of religion and health. New York: Oxford University Press.
(2004). Außergewöhnliche Erfahrungen – Blinder Fleck der Psychologie? [
(Exceptional experiences: The blind spot of psychology? ]. Münster, Germany: Lit.2006). Exceptional experiences and spiritual practice – A new measurement approach. Spirituality and Health International, 7(3), 125–150.
(2007). Psychological distress, experiences of ego loss and spirituality. Exploring the Effects of Spiritual Practice Social Behavior and Personality, 35, 1301–1316.
(in press ). Measure the unmeasurable by ticking boxes and actually opening pandoras box? The Archive for the Psychology of Religion.2003). Spirituality’s potential relevance to physical and emotional health: A brief review of quantitative research. Journal of Psychology and Theology, 31, 37–51.
(2005). Propensity scores: An introduction and experimental test. Evaluation Review, 29, 530–558.
(2004). Propensity matching via SPSS. Syntax for the SPSS software package. Retrieved January 15, 2007, from www.unc.edu/~painter/SPSSsyntax/propen.txt
(2002). Overt bias in observational studies. In , Observational studies (pp. 71–104). New York: Springer.
(1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41–55.
(1984). Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association, 79(387), 516–524.
(2000). The Symptom Check-List-90-R (SCL-90-R): A German validation study. Quality of Life Research, 9, 185–193.
(2000). Deutsche Normierung der Sense of Coherence Scale von Antonovsky [
(Antonovsky‘s Sense of Coherence Scale – A German validation study ]. Diagnostica, 46, 208–213.2000). Die Sense of Coherence Scale von Antonovsky – Teststatistische Überprüfung in einer repräsentativen Bevölkerungsstichprobe und Konstruktion einer Kurzskala [
(Antonovsky‘s Sense of Coherence Scale: Psychometric investigation in a sample representative of the German population and construction of a short form ]. Psychotherapie, Psychosomatik, med. Psychologie, 50, 472–482.1999). Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science and Medicine, 48, 1531–1548.
(1999). Religion, spirituality and medicine. Lancet, 353, 664–667.
(2002). Spirituality and health: What’s the evidence and what’s needed? Annals of Behavioral Medicine, 24(1), 3–13.
(2006). The meeting of meditative disciplines and Western psychology: A mutually enriching dialog. American Psychologist, 61, 227–339.
(
Access content
To read the fulltext, please use one of the options below to sign in or purchase access.- Personal login
- Register for access
- Claim
-
Restore content access
This functionality works only for purchases made as a guest