A Reliability Generalization Study for a Multidimensional Loneliness Scale
The Loneliness and Aloneness Scale for Children and Adolescents
Abstract
Abstract. Research on the average reliability and factors that affect the reliability of loneliness scales has been restricted to unidimensional measures. A reliability generalization (RG) study was conducted for a multidimensional loneness measure, that is, the Loneliness and Aloneness Scale for Children and Adolescents (LACA). Multilevel meta-analyses were performed on 79 studies that comprised 92 samples (for a total of 41,076 participants). Average reliability (Cronbach’s alpha) across samples was good (i.e., .80 or above) for all four subscales. Studies with higher sampling quality yielded slightly higher alphas for one of the subscales (i.e., Parent-related loneliness). For adolescents, as compared to children, alphas were somewhat lower for three of the four subscales and higher for the Affinity for aloneness subscale. Suggestions for future research are outlined. From a reliability perspective, the LACA is a good option for researchers who want to use a multidimensional loneliness measure with children and adolescents.
References
2010). Varying coefficient meta-analytic methods for alpha reliability. Psychological Methods, 15, 368–385. doi: 10.1037/a0020142
(2011). Introduction to meta-analysis. New York, NY: Wiley.
(1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.
(1993). The development and initial validation of the Social and Emotional Loneliness Scale for Adults (SELSA). Personality and Individual Differences, 14, 127–134. doi: 0.1016/0191-8869(93)90182-3
(2000). A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95, 89–98. doi: 10.2307/2669529
(Goossens L.Ed.. (2013). Leuvense Eenzaamheidsschaal voor Kinderen en Adolescenten: Handleiding
[Loneliness and Aloneness Scale for Children and Adolescents: Manual] . Unpublished manuscript, Department of School Psychology and Child and Adolescent Development (SCAD), KU Leuven, Belgium.2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39–65. doi: 10.1002/jrsm.5
(2006). The clinical significance of loneliness: A literature review. Clinical Psychology Review, 26, 695–718. doi: 10.1016/j.cpr.2006.04.002
(2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Erlbaum.
(1997). The emergence of solitude as a constructive domain of experience in early adolescence. Child Development, 68, 80–93. doi: 10.1111/j.1467-8624.1997.tb01927.x
(2006). Sas® for mixed models (2nd ed.). Cary, NC: SAS Institute.
(1993).
(Loneliness, attitude toward aloneness, and solitude: Age differences and developmental significance during adolescence . In S. JacksonH. Rodriguez-TomeEds., Adolescence and its social worlds (pp. 197–227). Hove, UK: Erlbaum.1987). Loneliness in pre through late adolescence: Exploring the contributions of a multidimensional approach. Journal of Youth and Adolescence, 16, 561–577. doi: 10.1007/bf02138821
(2007). A caution regarding rules of thumb for variance inflation factors. Quality and Quantity, 41, 673–690. doi: 10.1007/s11135-006-9018-6
(1981).
(Toward a social psychology of loneliness . In S. DuckR. GilmourEds., Personal relationships in disorder (Vol. 3, pp. 31–56). London, UK: Academic Press.2010). Childhood loneliness as a predictor of adolescent depressive symptoms: An 8-year longitudinal study. European Child & Adolescent Psychiatry, 19, 493–501. doi: 10.1007/s00787-009-0059-y
(2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). London, UK: Sage.
(2006). Meta-analysis of coefficient alpha. Psychological Methods, 11, 306–322. doi: 10.1037/1082-989x.11.3.306
(1982).
(The measurement of loneliness . In L. A. PeplauD. PerlmanEds., Loneliness: A sourcebook of current theory, research and therapy (pp. 81–104). New York, NY: Wiley.1980). The revised UCLA Loneliness Scale: Concurrent and discriminant validity evidence. Journal of Personality and Social Psychology, 39, 472–480. doi: 10.1037/0022-3514.39.3.472
(2013). Some recommended statistical analytic practices when reliability generalization studies are conducted. The British Journal of Mathematical and Statistical Psychology, . doi: 10.1111/j.2044-8317.2012.02057.x
(1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2, 110–114.
(1983). Measuring loneliness in different relationships. Journal of Personality and Social Psychology, 44, 1038–1047. doi: 10.1037/0022-3514.44.5.1038
(1992). Two and a half decades of leadership in measurement and evaluation. Journal of Counseling and Development, 70, 434–438.
(2003).
(Understanding reliability and coefficient alpha, really . In B. ThompsonEd., Score reliability: Contemporary thinking on reliability issues (pp. 3–23). California, CA: Sage.1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6–20. doi: 10.1177/0013164498058001002
(2011). Score reliability: A retrospective look back at 12 years of reliability generalization studies. Measurement and Evaluation in Counseling and Development, 44, 159–168. doi: 10.1177/0748175611409845
(2013). Three-level meta-analysis of dependent effect sizes. Behavior Research Methods, 45, 576–594. doi: 10.3758/s13428-012-0261-6
(2003). Multilevel meta-analysis: A comparison with traditional meta-analytical procedures. Educational and Psychological Measurement, 63, 765–790. doi: 10.1177/0013164402251027
(2008). A reliability generalization study of coefficient alpha for the UCLA Loneliness Scale. Journal of Personality Assessment, 90, 601–607. doi: 10.1080/00223890802388624
(2000). Assessing the reliability of Beck Depression Inventory scores: Reliability generalization across studies. Educational and Psychological Measurement, 60, 201–223. doi: 10.1177/00131640021970466
(