The Impact of the Number of Dyads on Estimation of Dyadic Data Analysis Using Multilevel Modeling
Abstract
Abstract. Dyadic data often appear in social and behavioral research, and multilevel models (MLMs) can be used to analyze them. For dyadic data, the group size is 2, which is the minimum group size we could have for fitting a multilevel model. This Monte Carlo study examines the effects of the number of dyads, the intraclass correlation (ICC), the proportion of singletons, and the missingness mechanism on convergence, bias, coverage rates, and Type I error rates of parameter estimates of dyadic data analysis using MLMs. Results showed that the estimation of variance components could have nonconvergence problems, nonignorable bias, and deviated coverage rates from nominal values when ICC is low, the proportion of singletons is high, and/or the number of dyads is small. More dyads helped obtain more reliable and valid estimates. Sample size guidelines based on the simulation model are given and discussed.
References
(1995, April). Determination of sample size for multilevel model design, Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
(2005). Using multilevel models to analyze couple and family treatment data: Basic and advanced issues. Journal of Family Psychology, 19, 98.
(2009). The crossover of daily work engagement: Test of an actor-partner interdependence model. Journal of Applied Psychology, 94, 1562–1571.
(1988). Large and small sample properties of maximum likelihood estimates for the hierarchical linear model, Unpublished doctoral dissertation, Michigan State University, East Lansing, MI.
(2001). Variance component testing in multilevel models. Journal of Educational and Behavioral Statistics, 26, 133–152.
(1978). Robustness? The British Journal of Mathematical and Statistical Psychology, 31, 144–152.
(2008). Modeling dyadic and interdependent data in the developmental and behavioral sciences. New York, NY: Routledge.
(2002). Statistical inference (2nd ed.). Pacific Grove, CA: Duxbury/Thomson Learning.
(2007). Addressing data sparseness in contextual population research using cluster analysis to create synthetic neighborhoods. Sociological Methods & Research, 35, 311–351.
(2006). Justice and leader-member exchange: The moderating role of organizational culture. Academy of Management Journal, 49, 395–406.
(2003). Treatment of missing data at the second level of hierarchical linear models. Educational and Psychological Measurement, 63, 204–238.
(1995). Multilevel statistical models (2nd ed.). London, UK: Griffin.
(2006). The handbook of marketing research: Uses, misuses, and future advances. Thousand Oaks, CA: Sage.
(1998). Robustness studies in covariance structure modeling an overview and a meta-analysis. Sociological Methods & Research, 26, 329–367.
(2010). Multilevel analysis: Techniques and applications (2nd ed.). New York, NY: Routledge.
(2001). The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling, 8, 157–174.
(2012). Authentic leadership and employee voice behavior: A multi-level psychological process. Journal of Business Ethics, 107, 349–361.
(2008). Growth curve models for indistinguishable dyads using multilevel modeling and structural equation modeling: The case of adolescent twins’ conflict with their mothers. Developmental Psychology, 44, 316.
(2015). Detecting individual differences in change: Methods and comparisons. Structural Equation Modeling, 22, 382–400. doi: 10.1080/10705511.2014.936096
(1995). The effect of nonindependence on significance testing in dyadic research. Personal Relationship, 2, 67–75.
(2001). Accuracy and bias in the perception of the partner in a close relationship. Journal of Personality and Social Psychology, 80, 439–448.
(1986). Consequences of violating the independence assumption in analysis of variance. Psychological Bulletin, 99, 422–431.
(2006). Dyadic data analysis. New York, NY: Guilford Press.
(1996). Are multilevel techniques necessary? An overview, including simulation studies, Unpublished manuscript, California State University at Los Angeles.
(2002). Statistical analysis with missing data (2nd ed.). New York, NY: Wiley.
(2004). The influence of violations of assumptions on multilevel parameter estimates and their standard errors. Computational Statistics & Data Analysis, 46, 427–440.
(2005). Sufficient sample sizes for multilevel modeling. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 1, 86–92.
(2008). Conflict negotiation and autonomy processes in adolescent romantic relationships: An observational study of interdependency in boyfriend and girlfriend effects. Journal of Adolescence, 31, 691–707.
(2007). A simulation study of sample size for multilevel logistic regression models. BMC Medical Research Methodology, 7, 34–43.
(2002). A multilevel structural equation model for dyadic data. Structural Equation Modeling, 9, 431–447.
(2011). Sample size and accuracy of estimates in multilevel models. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 7, 111–120.
(2010). A practical guide to multilevel modeling. Journal of School Psychology, 48, 85–112.
(2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). CA: Sage.
(1994). Missing data: A conceptual review for applied psychologists. Personnel Psychology, 47, 537–560.
(1976). Inference and missing data. Biometrika, 63, 581–592. doi: 10.1093/biomet/63.3.581
(2009). The presence of friends increases food intake in youth. The American Journal of Clinical Nutrition, 90, 282–287.
(2003). The effect of multicollinearity on multilevel modeling parameter estimates and standard errors. Educational and Psychological Measurement, 63, 951–985.
(2003). Applied longitudinal data analysis: Modeling change and event occurrence. New York, NY: Oxford University Press.
(2004). White paper on evaluation of sampling design options for the national children’s study. Columbus, OH: Battelle.
(2000). Employee retaliation: The neglected consequence of poor leader-member exchange relations. Journal of Occupational Health Psychology, 5, 457.
(1997). Applications of bootstrap methods for two-level models, April Paper presented at the Multilevel Conference, Amsterdam.
(1980). The adult-child dyad as a problem-solving system. Child Development, 51, 1215–1221.
(2016). Moderation analysis with missing data in the predictors. Psychological Methods, Manuscript under review.
