Skip to main content
Multistudy Report

Psychometric Properties of the Severity Indices of Personality Problems (SIPP) in Two Samples

A Norwegian Community Sample and Clinical Samples of Patients With and Without Personality Disorders

Published Online:https://doi.org/10.1027/1015-5759/a000436

Abstract. This study investigated psychometric properties of a dimensional measure of maladaptive core pathology for personality disorders, the Severity Indices of Personality Problems (SIPP). The study analyzed data from 941 respondents in a community sample, 949 psychiatric patients with Personality Disorders (PD), and 413 psychiatric patients without PD in Norway. The facets of SIPP had acceptable internal consistency, but the construct validity of some facets had potentials for improvement. The original SIPP domains (the factor structures of the facets) were not supported, and factor analysis gave different results across the three current study samples. All facets of SIPP have good discriminative properties with respect to differentiating between a nonclinical sample, a clinical sample without PD, and a clinical PD sample. Further research and improvements in SIPP are suggested.

References

  • American Psychiatric Association . (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: American Psychiatric Association. First citation in articleGoogle Scholar

  • Andrea, H., Verheul, R., Berghout, C., Dolan, C., Vanderkroft, P., Busschbach, J., … Fonagy, P. (2007). Measuring the core components of maladaptive personality: Severity Indices of Personality Problems (SIPP-118) – The first technical report. Amsterdam, The Netherlands: Viersprong Institute for Studies on Personality Disorders (VISPD) Medical Psychology and Psychotherapy. First citation in articleGoogle Scholar

  • Arnevik, E., Wilberg, T., Andrea, H., Monsen, J. T. & Karterud, S. (2009). A cross-national validity study of the Severity Indices of Personality Problems (SIPP-118). Personality and Mental Health, 3, 41–55. doi: 10.1002/pmh.60 First citation in articleCrossrefGoogle Scholar

  • Bales, D. L., Timman, R., Andrea, H., Busschbach, J. J. V., Verheul, R. & Kamphuis, J. H. (2014). Effectiveness of day hospital mentalization-based treatment for patients with severe borderline personality disorder: A matched control study. Clinical Psychology and Psychotherapy, 22, 409–417. doi: 10.1002/cpp.1914 First citation in articleCrossrefGoogle Scholar

  • Bales, D. L., van Beek, N., Smits, M., Willemsen, S., Busschbach, J. J. V., Verheul, R. & Andrea, H. (2012). Treatment outcome of 18-month, day hospital mentalization-based treatment (MBT) in patients with severe borderline personality disorder in the Netherlands. Journal of Personality Disorders, 26, 568–582. doi: 10.1521/pedi.2012.26.4.568 First citation in articleCrossrefGoogle Scholar

  • Bastiaansen, L., De Fruyt, F., Rossi, G., Schotte, C. & Hofmans, J. (2013). Personality disorder dysfunction versus traits: Structural and conceptual issues. Personality Disorders: Theory, Research, and Treatment, 4, 293–303. doi: 10.1037/per0000018 First citation in articleCrossrefGoogle Scholar

  • Beavers, A. S., Lounsbury, J. W., Richards, J. K., Huck, S. W., Skolits, G. J. & Esquivel, S. L. (2013). Practical considerations for using exploratory factor analysis in educational research. Practical Assessment, Research & Evaluation, 18, 1–13. First citation in articleGoogle Scholar

  • Bentler, P. M. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238–246. First citation in articleCrossrefGoogle Scholar

  • Berghuis, H., Kamphuis, J. H. & Verheul, R. (2012). Core features of personality disorder: Differentiating general personality dysfunctioning from personality traits. Journal of Personality Disorders, 26, 704–716. doi: 10.1521/pedi.2012.26.5.704 First citation in articleCrossrefGoogle Scholar

  • Berghuis, H., Kamphuis, J. H., Verheul, R., Larstone, R. & Livesley, J. (2013). The General Assessment of Personality Disorder (GAPD) as an instrument for assessing the core features of personality disorders. Clinical Psychology and Psychotherapy, 20, 544–557. doi: 10.1002/cpp.1811 First citation in articleCrossrefGoogle Scholar

  • Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS and SIMPLIS: Basic concepts, applications and programming. Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psycometrika, 16, 297–334. First citation in articleCrossrefGoogle Scholar

  • Davidov, E., Meuleman, B., Cieciuch, J., Schmidt, P. & Billiet, J. (2014). Measurement equivalence in cross-national research. Annual Review of Sociology, 40, 55–75. First citation in articleCrossrefGoogle Scholar

  • Diamantopoulos, A. & Siguaw, J. A. (2000). Introducing LISREL. London, UK: Sage. First citation in articleCrossrefGoogle Scholar

  • Enders, C. K. (2010). Applied missing data analysis. New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Feenstra, D. J., Hutsebaut, J., Verheul, R. & Busschbach, J. J. (2011). Severity Indices of Personality Problems (SIPP-118) in adolescents: Reliability and validity. Psychological Assessment, 23, 646–655. doi: 10.1037/a0022995 First citation in articleCrossrefGoogle Scholar

  • Feenstra, D. J., Hutsebaut, J., Verheul, R. & van Limbeek, J. (2014). Changes in the identity integration of adolescents in treatment for personality disorders. Journal of Personality Disorders, 28, 101–112. doi: 10.1521/pedi.2014.28.1.101 First citation in articleCrossrefGoogle Scholar

  • First, M. B., Gibbon, M., Spitzer, R. L., Williams, J. B. W. & Benjamin, L. S. (1997). The structured clinical interview for DSM-IV Axis II personality disorders (SCID-II). Washington, DC: American Psychiatric Press. First citation in articleGoogle Scholar

  • First, M. B., Spitzer, R. L., Gibbon, M. & Williams, J. B. W. (1995). The structured clinical interview for DSM-III-R Personality Disorders (SCID-II): Part I. Description. Journal of Personality Disorders, 9, 83–91. doi: 10.1521/pedi.1995.9.2.83 First citation in articleCrossrefGoogle Scholar

  • Floyd, F. J. & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7, 286–299. First citation in articleCrossrefGoogle Scholar

  • Graham, J. M. (2006). Congeneric and (Essentially) tau-equivalent estimates of score reliability – What they are and how to use them. Educational and Psychological Measurement, 66, 930–944. doi: 10.1177/0013164406288165 First citation in articleCrossrefGoogle Scholar

  • Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44, 78–94. doi: 10.1097/01.mlr.0000245454.12228.8f First citation in articleCrossrefGoogle Scholar

  • Gudjonsson, G. H., Sigurdsson, J. F., Guðmundsdóttir, H. B., Sigurjónsdóttir, S. & Smari, J. (2010). The relationship between ADHD symptoms in college students and core components of maladaptive personality. Personality and Individual Differences, 48, 601–606. doi: 10.1016/j.paid.2009.12.015 First citation in articleCrossrefGoogle Scholar

  • Harkness, J. A. (2006). ZUMA-Nachrichten Spezial Volume 12: Conducting Cross-National and Cross-Cultural Surveys. Mannheim, Germany: ZUMA. First citation in articleGoogle Scholar

  • Harzing, A. W. (2006). Response styles in cross-national survey research. A 26-country Study. International Journal of Cross Cultural Management, 6, 243–266. doi: 10.1177/1470595806066332 First citation in articleCrossrefGoogle Scholar

  • Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107–128. First citation in articleCrossrefGoogle Scholar

  • Hirschfeld, G., von Brachel, R. & Thielsch, M. T. (2014). Selecting items for Big Five questionnaires: At what sample size do factor loadings stabilize? Journal of Research in Personality, 53, 54–63. doi: 10.1016/j.jrp.2014.08.003 First citation in articleCrossrefGoogle Scholar

  • Hox, J. J., Maas, J. M. M. & Brinkhuis, M. J. S. (2010). The effect of estimation method and sample size in multilevel structural equation modeling. Statistica Neerlandica, 64, 157–170. doi: 10.1111/j.1467-9574.2009.00445.x First citation in articleCrossrefGoogle Scholar

  • Hu, L. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. doi: 10.1080/10705519909540118 First citation in articleCrossrefGoogle Scholar

  • IBM . (2010). IBM SPSS Statistics for Windows (Version 19.0). Armonk, NY: IBM Corp. First citation in articleGoogle Scholar

  • Karterud, S., Pedersen, G., Friis, S., Urnes, Ø., Irion, T., Brabrand, J., … Falkum, L. R. (1998). The Norwegian network of psychotherapeutic day hospitals. Therapeutic Communities, 1, 15–28. First citation in articleGoogle Scholar

  • Lien, I. E. & Arnevik, E. A. (2016). Assessment of personality problems among patients with substance use disorders. Nordic Studies on Alcohol and Drugs, 33, 399–414. doi: 10.1515/nsad-2016-0033 First citation in articleCrossrefGoogle Scholar

  • MacCallum, R. C., Browne, M. W. & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149. First citation in articleCrossrefGoogle Scholar

  • Morey, L. C., Berghuis, H., Bender, D. S., Verheul, R., Krueger, R. F. & Skodol, A. E. (2011). Toward a model for assessing level of personality functioning in DSM-5, part II: Empirical articulation of a core dimension of personality pathology. Journal of Personality Assessment, 93, 347–353. doi: 10.1080/00223891.2011.577853 First citation in articleCrossrefGoogle Scholar

  • Muthén, L. K. & Muthén, B. O. (2012). Mplus User’s Guide (1998–2012) (7th ed.). Los Angeles, CA: Muthén & Muthén. First citation in articleGoogle Scholar

  • Pedersen, G. & Karterud, S. (2010). Using measures from the SCL-90-R to screen for personality disorders. Personality and Mental Health, 4, 121–132. doi: 10.1002/pmh.122 First citation in articleCrossrefGoogle Scholar

  • Pedersen, G., Karterud, S., Hummelen, B. & Wilberg, T. (2013). The impact of extended longitudinal observation on the assessment of personality disorders. Personality and Mental Health, 7, 277–287. doi: 10.1002/pmh.1234 First citation in articleCrossrefGoogle Scholar

  • Rossi, G., Debast, I. & van Alphen, S. P. J. (2016). Measuring personality functioning in older adults: Construct validity of the Severity Indices of Personality Functioning – Short Form (SIPP-SF). Aging and Mental Health, 21, 703–711. doi: 10.1080/13607863.2016.1154012 First citation in articleCrossrefGoogle Scholar

  • Sheehan, D. V. & Lecrubier, Y. (1994). Mini International Neuropsychiatric Interview (M.I.N.I.). Tampa, Florida/Paris, France: University of South Florida Institute for Research in Psychiatry/INSERM-Hôpital de la Salpétrière. First citation in articleGoogle Scholar

  • Statistics Norway . (2014). Population’s level of education, 1 October 2014, Retrieved from http://www.ssb.no/en/utdanning/statistikker/utniv/aar First citation in articleGoogle Scholar

  • Steiger, J. H. (1990). Structural model evaluation and modification. Multivariate Behavioral Research, 25, 173–180. doi: 10.1207/s15327906mbr2502_4 First citation in articleCrossrefGoogle Scholar

  • Steiger, J. H. (2007). Understanding the limitations of global fit assessment in structural equation modelling. Personality and Individual Differences, 42, 893–898. doi: 10.1016/j.paid.2006.09.017 First citation in articleCrossrefGoogle Scholar

  • Tavakol, M. & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. doi: 10.5116/ijme.4dfb.8dfd First citation in articleCrossrefGoogle Scholar

  • Tucker, L. R. & Lewis, C. (1973). The reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10. First citation in articleCrossrefGoogle Scholar

  • Verheul, R., Andrea, H., Berghout, C. C., Dolan, C., Busschbach, J. J., van der Kroft, P. J., … Fonagy, P. (2008). Severity Indices of Personality Problems (SIPP-118): Development, factor structure, reliability, and validity. Psychological Assessment, 20, 23–34. doi: 10.1037/1040-3590.20.1.23 First citation in articleCrossrefGoogle Scholar

  • Yuan, K. H. & Bentler, P. M. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, 30, 165–200. doi: 10.1111/0081-1750.00078 First citation in articleCrossrefGoogle Scholar