Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Article

Gender Differences or Gender Bias?

Examination of the Assessment of Sadistic Personality Using Item Response Theory and Differential Item Functioning

Published Online:February 11, 2021https://doi.org/10.1027/1015-5759/a000634

Abstract

Abstract. Sadism, defined by the infliction of pain and suffering on others for pleasure or subjugation, has recently garnered substantial attention in the psychological research literature. The Assessment of Sadistic Personality (ASP) was developed to measure levels of everyday sadism and has been shown to possess excellent reliability and validity using classical test theory methods. However, it is not known how well ASP items discriminate between respondents of different trait levels, or which Likert categories are endorsed by persons of various trait levels. Additionally, individual items should be evaluated to ensure that men and women of similar levels of sadism have an equal probability of response endorsement. The purpose of this research was to apply item response theory (IRT) and differential item functioning (DIF) to investigate item properties of the ASP across its three translations: English, Polish, and Italian. Overall, the results of the IRT analysis showed that with the exception of Item 9, the ASP demonstrated sound item properties. The DIF rate analyses identified two items from each questionnaire that were of practical significance across gender. Implications of these results are discussed.

References

  • Archer, J., & Coyne, S. M. (2005). An integrated review of indirect, relational, and social aggression. Personality and Social Psychology Review, 9(3), 212–230. https://doi.org/10.1207/s15327957pspr0903_2 First citation in articleCrossref, Google Scholar

  • Baughman, H. M., Giammarco, E. A., Veselka, L., Schermer, J. A., Martin, N. G., Lynskey, M., & Vernon, P. A. (2012). A behavioral genetic study of humor styles in an Australian sample. Twin Research and Human Genetics, 15(3), 663–667. https://doi.org/10.1017/thg.2012.23 First citation in articleCrossref, Google Scholar

  • Bettencourt, B. A., & Miller, N. (1996). Gender differences in aggression as a function of provocation: A meta-analysis. Psychological Bulletin, 119(3), 442–447. https://doi.org/10.1037/0033-2909.119.3.422 First citation in articleCrossref, Google Scholar

  • Buckels, E. E., & Paulhus, D. L. (2014). Comprehensive Assessment of Sadistic Tendencies (CAST). (Unpublished instrument) University of British Columbia. First citation in articleGoogle Scholar

  • Chabrol, H., Van Leeuwen, N., Rodgers, R., & Séjourné, N. (2009). Contributions of psychopathic, narcissistic, Machiavellian, and sadistic personality traits to juvenile delinquency. Personality and Individual Differences, 47(7), 734–739. https://doi.org/10.1016/j.paid.2009.06.020 First citation in articleCrossref, Google Scholar

  • Chen, W. H., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22(3), 265–289. https://doi.org/10.3102/10769986022003265 First citation in articleCrossref, Google Scholar

  • Chester, D. S., DeWall, C. N., & Enjaian, B. (2019). Sadism and aggressive behavior: Inflicting pain to feel pleasure. Personality and Social Psychology Bulletin, 45(8), 1252–1268. https://doi.org/10.1177/0146167218816327 First citation in articleCrossref, Google Scholar

  • Christensen, K. B., Makransky, G., & Horton, M. (2017). Critical values for Yen’s Q3: Identification of local dependence in the Rasch model using residual correlations. Applied Psychological Measurement, 41(3), 178–194. https://doi.org/10.1177/0146621616677520 First citation in articleCrossref, Google Scholar

  • Cochran, W. G. (1954). Some methods for strengthening the common χ2 tests. Biometrics, 10(4), 417–451. https://doi.org/10.2307/3001616 First citation in articleCrossref, Google Scholar

  • Costa, P. T. Jr., Terracciano, A., & McCrae, R. R. (2001). Gender differences in personality traits across cultures: Robust and surprising findings. Journal of Personality and Social Psychology, 81(2), 322–331. https://doi.org/10.1037/0022-3514.81.2.322 First citation in articleCrossref, Google Scholar

  • DeMars, C. (2010). Item response theory, Oxford University Press. First citation in articleCrossref, Google Scholar

  • Dinić, B. M., Bulut Allred, T., Petrović, B., & Wertag, A. (2020). A test of three sadism measures. Journal of Individual Differences, 41(4), 219–227. https://doi.org/10.1027/1614-0001/a000319 First citation in articleLink, Google Scholar

  • Edelen, M. O., McCaffrey, D. F., Marshall, G. N., & Jaycox, L. H. (2009). Measurement of teen dating violence attitudes: An item response theory evaluation of differential item functioning according to gender. Journal of Interpersonal Violence, 24(8), 1243–1263. https://doi.org/10.1177/0886260508322187 First citation in articleCrossref, Google Scholar

  • Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists, Erlbaum. First citation in articleGoogle Scholar

  • Hambleton, R. K., & Swaminathan, H. (2013). Item response theory: Principles and applications, Springer Science & Business Media. First citation in articleGoogle Scholar

  • Holden, R. R., Fekken, G. C., & Jackson, D. N. (1985). Structured personality test item characteristics and validity. Journal of Research in Personality, 19(4), 386–394. https://doi.org/10.1016/0092-6566(85)90007-8 First citation in articleCrossref, Google Scholar

  • Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. WainerH. I. BraunEds., Test validity (pp. 129–145). Erlbaum. First citation in articleGoogle Scholar

  • Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/BF02289447 First citation in articleCrossref, Google Scholar

  • Jackson, D. A. (1993). Stopping rules in principal component analysis: A comparison of heuristical and statistical approaches. Ecology, 74(8), 2204–2214. https://doi.org/10.2307/1939574 First citation in articleCrossref, Google Scholar

  • Kowalski, C. M., Di Pierro, R., Plouffe, R. A., Rogoza, R., & Saklofske, D. H. (2020). Enthusiastic acts of evil: The Assessment of Sadistic Personality in Polish and Italian populations. Journal of Personality Assessment, 102(6), 770–780. https://doi.org/10.1080/00223891.2019.1673760 First citation in articleCrossref, Google Scholar

  • Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22(4), 719–748. https://doi.org/10.1093/jnci/22.4.719 First citation in articleGoogle Scholar

  • Marais, I. (2013). Local dependence. In K. B. ChristensenS. KreinerM. MesbahEds., Rasch models in health (pp. 111–130). Wiley. First citation in articleGoogle Scholar

  • Meyer, J. P. (2014). Applied measurement with jMetrik, Routledge. First citation in articleCrossref, Google Scholar

  • Meyer, J. P. (2018). jMetrik (Version 4.1.1). http://www.itemanalysis.com First citation in articleGoogle Scholar

  • Min, H., Pavisic, I., Howald, N., Highhouse, S., & Zickar, M. J. (2019). A systematic comparison of three sadism measures and their ability to explain workplace mistreatment over and above the Dark Triad. Journal of Research in Personality, 82, Article 103862. https://doi.org/10.1016/j.jrp.2019.103862 First citation in articleCrossref, Google Scholar

  • Mullet, E., Neto, F., & Riviere, S. (2005). Personality and its effects on resentment, revenge, forgiveness, and self-forgiveness. In E. L. Worthington Jr.Ed., Handbook of forgiveness (pp. 159–181). Routledge. First citation in articleGoogle Scholar

  • O’Meara, A., Davies, J., & Hammond, S. (2011). The psychometric properties and utility of the Short Sadistic Impulse Scale (SSIS). Psychological Assessment, 23(2), 523–531. https://doi.org/10.1037/a0022400 First citation in articleCrossref, Google Scholar

  • Paulhus, D. N., & Jones (2015). Measures of dark personalities. In G. J. BoyleD. H. SaklofskeG. MatthewsEds., Measures of personality and social psychological constructs (pp. 562–594). Academic Press. First citation in articleGoogle Scholar

  • Persson, B. N., Kajonius, P. J., & Garcia, D. (2017). Testing construct independence in the Short Dark Triad using item response theory. Personality and Individual Differences, 117, 74–80. https://doi.org/10.1016/j.paid.2017.05.025 First citation in articleCrossref, Google Scholar

  • Plouffe, R. A., Saklofske, D. H., & Smith, M. M. (2017). The Assessment of Sadistic Personality: Preliminary psychometric evidence for a new measure. Personality and Individual Differences, 104, 166–171. https://doi.org/10.1016/j.paid.2016.07.043 First citation in articleCrossref, Google Scholar

  • Plouffe, R. A., Smith, M. M., & Saklofske, D. H. (2019). A psychometric investigation of the Assessment of Sadistic Personality. Personality and Individual Differences, 140, 57–60. https://doi.org/10.1016/j.paid.2018.01.002 First citation in articleCrossref, Google Scholar

  • Plouffe, R. A., Wilson, C. A., & Saklofske, D. H. (2020). The role of dark personality traits in intimate partner violence: A multi-study investigation. Current Psychology. Advance online publication. https://doi.org/10.1007/s12144-020-00871-5 First citation in articleGoogle Scholar

  • Podsakoff, P. M., MacKenzie, S. B., Lee, J., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879 First citation in articleCrossref, Google Scholar

  • R Development Core Team. (2019). R: A language and environment for statistical computing, R Foundation for Statistical Computing. http://www.R-project.org First citation in articleGoogle Scholar

  • Reeve, B. B., & Fayers, P. (2005). Applying item response theory modeling for evaluating questionnaire item and scale properties. In P. FayersR. D. HaysEds., Assessing quality of life in clinical trials: Methods of practice (2nd ed., pp. 55–73). Oxford University Press. First citation in articleGoogle Scholar

  • Revelle, W. (2016). An overview of the psych package. ftp://cran.r-project.org/pub/R/web/packages/psych/vignettes/overview.pdf First citation in articleGoogle Scholar

  • Rizopoulos, D. (2006). ltm: An R package for latent variable modelling and item response theory analyses. Journal of Statistical Software, 17(5), 1–25. First citation in articleCrossref, Google Scholar

  • Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34, 100. First citation in articleGoogle Scholar

  • Samejima, F. (1996). Graded response model. In W. J. van der LindenR. K. HambletonEds., Handbook of modern item response theory (pp. 85–100). Springer. First citation in articleGoogle Scholar

  • Sargent, S. L., Zillman, D., & Weaver, J. B. III (1998). The gender gap in the enjoyment of televised sports. Journal of Sport and Social Issues, 22(1), 46–64. https://doi.org/10.1177/019372398022001005 First citation in articleCrossref, Google Scholar

  • Van Sonderen, E., Sanderman, R., & Coyne, J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLoS One, 8(7), e68967. https://doi.org/10.1371/journal.pone.0068967 First citation in articleCrossref, Google Scholar

  • Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321–327. First citation in articleCrossref, Google Scholar

  • Zwick, R., Thayer, D. T., & Mazzeo, J. (1997). Describing and categorizing DIF in polytomous items. ETS Research Report Series, 1, I-52. https://doi.org/10.1002/j.2333-8504.1997.tb01726.x First citation in articleGoogle Scholar