Multidimensional Modeling of Traits and Response Styles
Abstract
Abstract. Response styles can influence item responses in addition to a respondent’s latent trait level. A common concern is that comparisons between individuals based on sum scores may be rendered invalid by response style effects. This paper investigates a multidimensional approach to modeling traits and response styles simultaneously. Models incorporating different response styles as well as personality traits (Big Five facets) were compared regarding model fit. Relationships between traits and response styles were investigated and different approaches to modeling extreme response style (ERS) were compared regarding their effects on trait estimates. All multidimensional models showed a better fit than the unidimensional models, indicating that response styles influenced item responses with ERS showing the largest incremental variance explanation. ERS and midpoint response style were mainly trait-independent whereas acquiescence and disacquiescence were strongly related to several personality traits. Expected a posteriori estimates of participants’ trait levels did not differ substantially between two-dimensional and unidimensional models when a set of heterogeneous items was used to model ERS. A minor adjustment of trait estimates occurred when the same items were used to model ERS and the trait, though the ERS dimension in this approach only reflected scale-specific ERS, rather than a general ERS tendency.
References
(1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1–23. doi: 10.1177/0146621697211001
(1973).
Information theory and an extension of the maximum likelihood principle . In B. N. PetrovB. F. CsakiEds., Second international symposium on information theory (pp. 267–281). Budapest, Hungary: Academiai Kiado.(2006). Individual differences in response scale use: Mixed Rasch modelling of responses to NEO-FFI items. Personality and Individual Differences, 40, 1235–1245. doi: 10.1016/j.paid.2005.10.018
(1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1–26.
(2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 28, 143–156.
(1981). Marginal maximum-likelihood estimation of item parameters – application of an EM algorithm. Psychometrika, 46, 443–459. doi: 10.1007/Bf02293801
(2012). Modeling multiple response processes in judgment and choice. Psychological Methods, 17, 665–678. doi: 10.1037/a0028111
(2009). Addressing score bias and differential item functioning due to individual differences in response style. Applied Psychological Measurement, 33, 335–352. doi: 10.1177/0146621608329891
(2011). Multiscale measurement of extreme response style. Educational and Psychological Measurement, 71, 814–833. doi: 10.1177/0013164410388411
(1993). NEO-Fünf-Faktoren-Inventar
[NEO Five Factor Inventory] . Göttingen, Germany: Hogrefe.(1987). Model selection and Akaike Information Criterion (AIC): The general theory and its analytical extensions. Psychometrika, 52, 345–370. doi: 10.1007/Bf02294361
(2011). Personality and longevity: Knowns, unknowns, and implications for public health and personalized medicine. Journal of Aging Research, 2011, 759170. doi: 10.4061/2011/759170
(1988). Statistical power analysis for the behavioral sciences. New York, NY: Erlbaum.
(1992). Revised NEO personality inventory (NEO-PI-R) and NEO Five-Factor inventory (NEO-FFI). Odessa, FL: Psychological Assessment Resources.
(2000). Detecting measurement invariance in organizational surveys. European Journal of Psychological Assessment, 16, 20–30.
(1992). Measuring extreme response style. Public Opinion Quarterly, 56, 328–351.
(2001). Culture’s consequences. Thousand Oaks, CA: Sage.
(2005). The relation between culture and response styles – evidence from 19 countries. Journal of Cross-Cultural Psychology, 36, 264–277. doi: 10.1177/0022022104272905
(1996). Multidimensional Rasch models for partial-credit scoring. Applied Psychological Measurement, 20, 155–168. doi: 10.1177/014662169602000205
(1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149–174. doi: 10.1007/Bf02296272
(2008). Exploring the effect of a middle response category on response style in attitude measurement. Quality & Quantity, 42, 779–794. doi: 10.1007/s11135-006-9067-x
(1991). A note on a general definition of the coefficient of determination. Biometrika, 78, 691–692. doi: 10.1093/biomet/78.3.691
(1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660–679. doi: 10.1037/0021-9010.81.6.660
(2004). NEO-PI-R: NEO-Persönlichkeitsinventar nach Costa und McCrae
[NEO-PI-R: NEO Personality Inventory after Costa and McCrae] . Göttingen, Germany: Hogrefe.(2014). Validity of multiprocess IRT models for separating content and response styles. Educational and Psychological Measurement, 74, 875–899. doi: 10.1177/0013164413514998
(1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danmarks Paedagogiske Institut.
(1961). On general laws and the meaning of measurement in psychology. Berkeley, CA: University of California Press.
(1990). Rasch models in latent classes – an integration of 2 approaches to item analysis. Applied Psychological Measurement, 14, 271–282. doi: 10.1177/014662169001400305
(1997).
Applying the mixed Rasch model to personality questionnaires . In J. RostR. LangeheineEds., Applications of latent trait and latent class models in the social sciences (pp. 324–332). Retrieved from http://www.ipn.uni-kiel.de/aktuell/buecher/rostbuch/ltlc.htm.(1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464. doi: 10.1214/aos/1176344136
(2013). Response styles in survey research: A literature review of antecedents, consequences, and remedies. International Journal of Public Opinion Research, 25, 195–217. doi: 10.1093/Ijpor/Eds021
(2010). The effect of rating scale format in response styles: The number of response categories and response category labels. International Journal of Research in Marketing, 27, 236–247. doi: 10.1016/j.ijresmar.2010.02.004
(2010). The stability of individual response styles. Psychological Methods, 15, 96–110. doi: 10.1037/a0018721
(2013). Consistency of extreme response style and non-extreme response style across traits. Journal of Research in Personality, 47, 178–189. doi: 10.1016/j.jrp.2012.10.010
(2015). The stability of extreme response style and acquiescence over 8 years. Assessment, Advance online publication. doi: 10.1177/1073191115583714
(2007). ConQuest [Computer software]. Camberwell, Australia: Australian Council for Educational Research.
