Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Article

Longitudinal Measurement Invariance of the Brief Symptom Inventory (BSI)-18 in Psychotherapy Patients

Published Online:August 03, 2018https://doi.org/10.1027/1015-5759/a000480

Abstract

Abstract. The Brief Symptom Inventory (BSI)-18 is a widely-used tool to assess changes in general distress in patients despite an ongoing debate about its factorial structure and lack of evidence for longitudinal measurement invariance (LMI). We investigated BSI-18 scores from 1,081 patients from an outpatient clinic collected after the 2nd, 6th, 10th, 18th, and 26th therapy session. Confirmatory factor analysis (CFA) was used to compare models comprising one, three, and four latent dimensions that were proposed in the literature. LMI was investigated using a series of model comparisons, based on chi-square tests, effect sizes, and changes in comparative fit index (CFI). Psychological distress diminished over the course of therapy. A four-factor structure (depression, somatic symptoms, generalized anxiety, and panic) showed the best fit to the data at all measurement occasions. The series of model comparisons showed that constraining parameters to be equal across time resulted in very small decreases in model fit that did not exceed the cutoff for the assumption of measurement in variance. Our results show that the BSI-18 is best conceptualized as a four-dimensional tool that exhibits strict longitudinal measurement invariance. Clinicians and applied researchers do not have to be concerned about the interpretation of mean differences over time.

References

  • Abraham, D. S., Gruber-Baldini, A. L., Harrington, D. & Shulman, L. M. (2017). The factor structure of the Brief Symptom Inventory-18 (BSI-18) in Parkinson disease patients. Journal of Psychosomatic Research, 96, 21–26. https://doi.org/10.1016/j.jpsychores.2017.03.002 First citation in articleCrossref, Google Scholar

  • Andreu, Y., Galdón, M. J., Dura, E., Ferrando, M., Murgui, S., García, A. & Ibáñez, E. (2008). Psychometric properties of the Brief Symptoms Inventory-18 (BSI-18) in a Spanish sample of outpatients with psychiatric disorders. Psicothema, 20, 844–850. First citation in articleGoogle Scholar

  • Asner-Self, K. K., Schreiber, J. B. & Marotta, S. A. (2006). A cross-cultural analysis of the Brief Symptom Inventory-18. Cultural Diversity & Ethnic Minority Psychology, 12, 367–375. https://doi.org/10.1037/1099-9809.12.2.367 First citation in articleCrossref, Google Scholar

  • Borsboom, D. (2006). When does measurement invariance matter? Medical Care, 44, S176–S181. First citation in articleCrossref, Google Scholar

  • Bruce, S. E., Yonkers, K. A., Otto, M. W., Eisen, J. L., Weisberg, R. B., Pagano, M., … Keller, M. B. (2005). Influence of psychiatric comorbidity on recovery and recurrence in generalized anxiety disorder, social phobia, and panic disorder: A 12-year prospective study. The American Journal of Psychiatry, 162, 1179–1187. First citation in articleCrossref, Google Scholar

  • Carleton, R. N., Duranceau, S., Freeston, M. H., Boelen, P. A., McCabe, R. E. & Antony, M. M. (2014). “But it might be a heart attack”: Intolerance of uncertainty and panic disorder symptoms. Journal of Anxiety Disorders, 28, 463–470. First citation in articleCrossref, Google Scholar

  • Cheung, G. W. & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. First citation in articleCrossref, Google Scholar

  • Derogatis, L. R. (2000). The Brief Symptom Inventory-18 (BSI-18): Administration, scoring, and procedures manual. Minneapolis, MN: National Computer Systems. First citation in articleGoogle Scholar

  • Derogatis, L. R. & Melisaratos, N. (1983). The Brief Symptom Inventory: An introductory report. Psychological Medicine, 13, 595–605. First citation in articleCrossref, Google Scholar

  • Durá, E., Andreu, Y., Galdón, M. J., Ferrando, M., Murgui, S., Poveda, R. & Jimenez, Y. (2006). Psychological assessment of patients with temporomandibular disorders: Confirmatory analysis of the dimensional structure of the Brief Symptoms Inventory 18. Journal of Psychosomatic Research, 60, 365–370. First citation in articleCrossref, Google Scholar

  • Ferro, M. A. & Speechley, K. N. (2013). Factor structure and longitudinal invariance of the Center for Epidemiological Studies Depression Scale (CES-D) in adult women: Application in a population-based sample of mothers of children with epilepsy. Archives of Women’s Mental Health, 16, 159–166. First citation in articleCrossref, Google Scholar

  • Fokkema, M., Smits, N., Kelderman, H. & Cuijpers, P. (2013). Response shifts in mental health interventions: An illustration of longitudinal measurement invariance. Psychological Assessment, 25, 520–531. https://doi.org/10.1037/a0031669 First citation in articleCrossref, Google Scholar

  • Fried, E. I., van Borkulo, C. D., Epskamp, S., Schoevers, R. A., Tuerlinckx, F. & Borsboom, D. (2016). Measuring depression over time… or not? Lack of unidimensionality and longitudinal measurement invariance in four common rating scales of depression. Psychological Assessment, 28, 1354–1367. https://doi.org/10.1037/pas0000275 First citation in articleCrossref, Google Scholar

  • Galdón, M. J., Durá, E., Andreu, Y., Ferrando, M., Murgui, S., Pérez, S. & Ibañez, E. (2008). Psychometric properties of the Brief Symptom Inventory-18 in a Spanish breast cancer sample. Journal of Psychosomatic Research, 65, 533–539. First citation in articleCrossref, Google Scholar

  • Geisheim, C., Hahlweg, K., Fiegenbaum, W., Frank, M., Schröder, B. & von Witzleben, I. (2002). Das Brief Symptom Inventory (BSI) als Instrument zur Qualitätssicherung in der Psychotherapie [The German version of the Brief Symptom Inventory (BSI): Reliability and validity in a sample of outpatient psychotherapy patients]. Diagnostica, 48, 28–36. First citation in articleLink, Google Scholar

  • Hirschfeld, G., von Brachel, R. & Thielsch, M. (2014). Selecting items for Big Five questionnaires: At what sample size do factor loadings stabilize? Journal of Research in Personality, 53, 54–63. https://doi.org/10.1016/j.jrp.2014.08.003 First citation in articleCrossref, Google Scholar

  • Hu, L. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. First citation in articleCrossref, Google Scholar

  • Kline, R. B. (2015). Principles and practice of structural equation modeling. New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Little, T. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53–76. First citation in articleCrossref, Google Scholar

  • Loutsiou-Ladd, A., Panayiotou, G. & Kokkinos, C. M. (2008). A review of the factorial structure of the Brief Symptom Inventory (BSI): Greek evidence. International Journal of Testing, 8, 90–110. First citation in articleCrossref, Google Scholar

  • McTeague, L. M. & Lang, P. J. (2012). The anxiety spectrum and the reflex physiology of defense: From circumscribed fear to broad distress. Depression and Anxiety, 29, 264–281. First citation in articleCrossref, Google Scholar

  • Newsom, J. T. (2015). Longitudinal structural equation modeling. New York, NY: Routledge. First citation in articleCrossref, Google Scholar

  • Petkus, A. J., Gum, A. M., Small, B., Malcarne, V. L., Stein, M. B. & Wetherell, J. L. (2010). Evaluation of the factor structure and psychometric properties of the Brief Symptom Inventory-18 with homebound older adults. International Journal of Geriatric Psychiatry, 25, 578–587. First citation in articleGoogle Scholar

  • Piersma, H. L., Reaume, W. M. & Boes, J. L. (1994). The Brief Symptom Inventory (BSI) as an outcome measure for adult psychiatric inpatients. Journal of Clinical Psychology, 50, 555–563. First citation in articleCrossref, Google Scholar

  • Prelow, H. M., Weaver, S. R., Swenson, R. R. & Bowman, M. A. (2005). A preliminary investigation of the validity and reliability of the Brief-Symptom Inventory-18 in economically disadvantaged Latina American mothers. Journal of Community Psychology, 33, 139–155. First citation in articleCrossref, Google Scholar

  • Prinz, U., Nutzinger, D. O., Schulz, H., Petermann, F., Braukhaus, C. & Andreas, S. (2013). Comparative psychometric analyses of the SCL-90-R and its short versions in patients with affective disorders. BMC Psychiatry, 13, 1. First citation in articleCrossref, Google Scholar

  • Raghavan, S. S., Rosenfeld, B. & Rasmussen, A. (2015). Measurement invariance of the Brief Symptom Inventory in survivors of torture and trauma. Journal of Interpersonal Violence, 32, 1708–1729. https://doi.org/10.1177/0886260515619750 First citation in articleCrossref, Google Scholar

  • Recklitis, C. J., Parsons, S. K., Shih, M.-C., Mertens, A., Robison, L. L. & Zeltzer, L. (2006). Factor structure of the Brief Symptom Inventory-18 in adult survivors of childhood cancer: results from the childhood cancer survivor study. Psychological Assessment, 18, 22–32. https://doi.org/10.1037/1040-3590.18.1.22 First citation in articleCrossref, Google Scholar

  • Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. First citation in articleCrossref, Google Scholar

  • Satorra, A. & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514. First citation in articleCrossref, Google Scholar

  • Spitzer, C., Hammer, S., Löwe, B., Grabe, H. J., Barnow, S., Rose, M., … Franke, G. H. (2011). The short version of the Brief Symptom Inventory (BSI-18): preliminary psychometric properties of the German translation. Fortschritte der Neurologie – Psychiatrie, 79, 517–523. https://doi.org/10.1055/s-0031-1281602 First citation in articleCrossref, Google Scholar

  • Torres, L., Miller, M. J. & Moore, K. M. (2013). Factorial invariance of the Brief Symptom Inventory-18 (BSI-18) for adults of Mexican descent across nativity status, language format, and gender. Psychological Assessment, 25, 300–305. First citation in articleCrossref, Google Scholar

  • Wang, J., Kelly, B. C., Booth, B. M., Falck, R. S., Leukefeld, C. & Carlson, R. G. (2010). Examining factorial structure and measurement invariance of the Brief Symptom Inventory (BSI)-18 among drug users. Addictive Behaviors, 35, 23–29. https://doi.org/10.1016/j.addbeh.2009.08.003 First citation in articleCrossref, Google Scholar

  • Widaman, K. F., Ferrer, E. & Conger, R. D. (2010). Factorial invariance within longitudinal structural equation models: Measuring the same construct across time. Child Development Perspectives, 4, 10–18. First citation in articleCrossref, Google Scholar

  • Wiesner, M., Chen, V., Windle, M., Elliott, M. N., Grunbaum, J. A., Kanouse, D. E. & Schuster, M. A. (2010). Factor structure and psychometric properties of the Brief Symptom Inventory-18 in women: A MACS approach to testing for invariance across racial/ethnic groups. Psychological Assessment, 22, 912–922. First citation in articleCrossref, Google Scholar

  • Wu, P.-C. (2016). Response shifts in depression intervention for early adolescents: Response shifts in depression intervention. Journal of Clinical Psychology, 72, 663–675. https://doi.org/10.1002/jclp.22291 First citation in articleCrossref, Google Scholar

  • Zabora, J., Brintzenhofeszoc, K., Jacobsen, P., Curbow, B., Piantadosi, S., Hooker, C., … Derogatis, L. (2001). A new psychosocial screening instrument for use with cancer patients. Psychosomatics, 42, 241–246. First citation in articleCrossref, Google Scholar