Skip to main content
Original Article

Measurement Equivalence of the PALS Academic Self-Efficacy Scale

Published Online:https://doi.org/10.1027/1015-5759/a000331

Abstract. There is consistent evidence of the importance of academic self-efficacy beliefs within educational research, as they are linked to critical academic outcomes. Ethnic and gender differences in academic self-efficacy have been found in nations outside of the United States, suggesting differences in how individual students perceive their academic abilities. However, if researchers are interested in making mean-level comparisons of academic self-efficacy across diverse subpopulations of students, it is imperative to assess the measurement equivalence of the scale used across these subgroups prior to drawing any conclusions based on score inferences. The current study assessed the measurement invariance of the academic self-efficacy scale of the Patterns of Adaptive Learning Scales (PALS; Midgley et al., 2000) across gender and race among 4,148 high school students in the Southeastern US. The results indicated partial measurement invariance across African American females, African American males, Caucasian females, and Caucasian males, providing initial support for the same factor structure across groups. However, caution should be taken in considering any mean-level differences, as support for only weak invariance was found.

References

  • American Educational Research Association, American Psychological Association, National Council on Measurement in Education. (1999). Standards for Educational and Psychological Testing. Washington, DC: APA. First citation in articleGoogle Scholar

  • Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice-Hall, Inc. First citation in articleGoogle Scholar

  • Bandura, A. (1997). Self-efficacy: The exercise of control. New York, NY: W. H. Freeman/Times Books/Henry Holt & Co. First citation in articleGoogle Scholar

  • Bandura, A. (2006). Guide for creating self-efficacy scales. In F. PajaresT. UrdanEds., Self-efficacy beliefs of adolescents (pp. 307–338). Greenwich, CT: Information Age Publishing. First citation in articleGoogle Scholar

  • Bembenutty, H. (2007). Self-regulation of learning and academic delay of gratification: Gender and ethnic differences among college students. Journal of Advanced Academics, 18(4), 586–616. doi: 10.4219/jaa-2007-553 First citation in articleCrossrefGoogle Scholar

  • Bong, M. (2005). Within-grade changes in Korean girls’ motivation and perceptions of learning environment across domains and achievement levels. Journal of Educational Psychology, 97, 656–672. doi: 10.1037/0022-0663.97.4.656 First citation in articleCrossrefGoogle Scholar

  • Brown, S. D., Tramayne, S., Hoxha, D., Telander, K., Fan, X. & Lent, R. W. (2008). Social cognitive predictors of college students’ academic performance and persistence: A meta-analytic path analysis. Journal of Vocational Behavior, 72, 298–308. doi: 10.1016/j.jvb.2007.09.003 First citation in articleCrossrefGoogle Scholar

  • Byrne, B. M. (2012). Structural Equation Modeling with Mplus. New York, NY: Routledge. First citation in articleGoogle Scholar

  • Byrne, B. M. & Watkins, D. (2003). The issue of measurement invariance revisited. Journal of Cross-Cultural Psychology, 34, 155–175. doi: 10.1177/0022022102250225 First citation in articleCrossrefGoogle Scholar

  • Cheung, G. W. & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. doi: 10.1207/S15328007SEM0902_5 First citation in articleCrossrefGoogle Scholar

  • Finney, S. J. & DiStefano, C. (2006). Non-normal and categorical data in structural equation modeling. In G. R. HancockR. O. MuellerEds., Structural equation modeling: A second course (pp. 269–314). Greenwich, CT: Information Age Publishing. First citation in articleGoogle Scholar

  • Flora, D. B. & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491. doi: 10.1037/1082-989X.9.4.466 First citation in articleCrossrefGoogle Scholar

  • Friedel, J. M., Cortina, K. S., Turner, J. C. & Midgley, C. (2007). Achievement goals, efficacy beliefs and coping strategies in mathematics: The roles of perceived parent and teacher goal emphases. Contemporary Educational Psychology, 32, 434–458. doi: 10.1016/j.cedpsych.2006.10.009 First citation in articleCrossrefGoogle Scholar

  • Gutman, L. M. (2006). How student and parent goal orientations and classroom goal structures influence the math achievement of African Americans during the high school transition. Contemporary Educational Psychology, 31, 44–63. doi: 10.1016/j.cedpsych.2005.01.004 First citation in articleCrossrefGoogle Scholar

  • Hackett, G., Betz, N. E., Casas, J. M. & Rocha-Singh, I. A. (1992). Gender, ethnicity, and social cognitive factors predicting the academic achievement of students in engineering. Journal of Counseling Psychology, 39, 527–538. First citation in articleCrossrefGoogle Scholar

  • Hopkins, D. J. & King, G. (2010). Improving anchoring vignettes designing surveys to correct interpersonal incomparability. Public Opinion Quarterly, 74, 201–222. First citation in articleCrossrefGoogle Scholar

  • Hsieh, P., Sullivan, J. R. & Guerra, N. S. (2007). A closer look at college students: Self-efficacy and goal orientation. Journal of Advanced Academics, 18, 454–476. doi: 10.4219/jaa-2007-500 First citation in articleCrossrefGoogle Scholar

  • Hu, L. & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453. doi: 10.1037/1082-989X.3.4.424 First citation in articleCrossrefGoogle Scholar

  • Huang, C. (2013). Gender differences in academic self-efficacy: A meta-analysis. European Journal of Psychological Education, 28, 1–35. doi: 10.1007/s10212-011-0097-y First citation in articleCrossrefGoogle Scholar

  • Joet, G., Usher, E. L. & Bressoux, P. (2011). Sources of self-efficacy: An investigation of elementary school students in France. Journal of Educational Psychology, 103, 649–663. doi: 10.1037/a0024048 First citation in articleCrossrefGoogle Scholar

  • Jöreskog, K. G. (1993). Testing structural equation models. In K. A. BollenJ. S. LongEds., Testing structural equation models (pp. 294–316). Newbury Park, CA: Sage. First citation in articleGoogle Scholar

  • King, G., Murray, C. J., Salomon, J. A. & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 98, 191–207. First citation in articleCrossrefGoogle Scholar

  • Kleitman, S. & Gibson, J. (2011). Metacognitive beliefs, self-confidence and primary learning environment of sixth grade students. Learning and Individual Differences, 21, 728–735. doi: 10.1016/j.lindif.2011.08.003 First citation in articleCrossrefGoogle Scholar

  • Liem, A. D., Lau, S. & Nie, Y. (2008). The role of self-efficacy, task value, and achievement goals in predicting learning strategies, task disengagement, peer relationship, and achievement outcome. Contemporary Educational Psychology, 33, 486–512. doi: 10.1016/j.cedpsych.2007.08.001 First citation in articleCrossrefGoogle Scholar

  • Machado, T. S. & Pardal, A. (2013). Adaptive learning strategies and emotion regulation in adolescents. Psicologia Educação Cultura, 17, 134–151. First citation in articleGoogle Scholar

  • MacPhee, D., Farro, S. & Canetto, S. S. (2013). Academic self-efficacy and performance of underrepresented STEM majors: Gender, ethnic, and social class patterns. Analyses of Social Issues and Public Policy, 13, 347–369. doi: 10.1111/asap.12033 First citation in articleCrossrefGoogle Scholar

  • Midgley, C., Maehr, M. L., Hruda, L. Z., Anderman, E., Anderman, L., Freeman, K. E., … Urdan, T. (2000). Manual for the Patterns of Adaptive Learning Scales. Ann Arbor, MI: University of Michigan. First citation in articleGoogle Scholar

  • Multon, K. D., Brown, S. D. & Lent, R. W. (1991). Relation of self-efficacy beliefs to academic outcomes: A meta-analytic investigation. Journal of Counseling Psychology, 38, 30–38. doi: 10.1037/0022-0167.38.1.30 First citation in articleCrossrefGoogle Scholar

  • Muthén, B., Du Toit, S. H. & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Psychometrika, 75, 1–45. First citation in articleGoogle Scholar

  • Muthén, L. K. & Muthén, B. O. (2004). Mplus User’s Guide (5th ed.). Los Angeles, CA: Muthén & Muthén. First citation in articleGoogle Scholar

  • Muthén, L. K. & Muthén, B. O. (2009). Mplus Short Courses Topic 2. Los Angeles, CA: Muthén & Muthén. First citation in articleGoogle Scholar

  • Nie, Y., Lau, S. & Liau, A. K. (2011). Role of academic self-efficacy in moderating the relation between task importance and test anxiety. Learning and Individual Differences, 21, 736–741. doi: 10.1016/j.lindif.2011.09.005 First citation in articleCrossrefGoogle Scholar

  • Pajares, F. (2009). Toward a positive psychology of academic motivation: The role of self-efficacy beliefs. In R. GilmanS. HuebnerM. FurlongEds., Handbook of positive psychology in schools (pp. 149–160). New York, NY: Routledge. First citation in articleGoogle Scholar

  • Pastorelli, C., Caprara, G. V., Barbaranelli, C., Rola, J., Rozsa, S. & Bandura, A. (2001). The structure of children’s perceived self-efficacy: A cross-national study. European Journal of Psychological Assessment, 17, 87–97. doi: 10.1027/1015-5759.17.2.87 First citation in articleLinkGoogle Scholar

  • Peetsma, T., Hascher, T., van der Veen, I. & Roede, E. (2005). Relations between adolescents’ self-evaluations, time perspectives, motivation for school and their achievement in different countries at different ages. European Journal of Psychology of Education, 20, 209–225. doi: 10.1007/BF03173553 First citation in articleCrossrefGoogle Scholar

  • Peña, E. D. (2007). Lost in translation: Methodological considerations in cross-cultural research. Child Development, 78, 1255–1264. doi: 10.1111/j.1467-8624.2007.01064.x First citation in articleCrossrefGoogle Scholar

  • Reise, S. P., Widaman, K. F. & Pugh, R. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552–566. doi: 10.1037/0033-2909.114.3.552 First citation in articleCrossrefGoogle Scholar

  • Robbins, S. B., Lauver, K., Le, H., Davis, D., Langley, R. & Carlstrom, A. (2004). Do psychosocial and study skill factors predict college outcomes? A meta-analysis. Psychological Bulletin, 130, 261–288. doi: 10.1037/0033-2909.130.2.261 First citation in articleCrossrefGoogle Scholar

  • Ross, M. E., Blackburn, M. & Forbes, S. (2005). Reliability generalization of the patterns of adaptive learning survey goal orientation scales. Educational and Psychological Measurement, 65, 451–464. doi: 10.1177/0013164404272496 First citation in articleCrossrefGoogle Scholar

  • Sass, D. A. (2011). Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment, 29, 347–363. doi: 10.1177/0734282911406661 First citation in articleCrossrefGoogle Scholar

  • Satorra, A. & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514. First citation in articleCrossrefGoogle Scholar

  • Van de Vijver, F. & Tanzer, N. K. (2004). Bias and equivalence in cross-cultural assessment: An overview. Revue européenne de psychologie appliquée, 54, 119–135. doi: 10.1016/j.erap.2003.12.004 First citation in articleCrossrefGoogle Scholar