Skip to main content
Original Article

Homework Expectancy Value Scale for Undergraduates in Online Environments

Measurement Invariance and Latent Mean Differences Across Gender

Published Online:https://doi.org/10.1027/1015-5759/a000455

Abstract. The goal of the current study was to validate the Homework Expectancy Value Scale (HEVS) for undergraduates in online learning environments. After randomly splitting the sample in halves, we conducted exploratory factor analysis (EFA) with the first half (n = 306) and confirmatory factor analysis (CFA) with the second half (n = 306). Both EFA and CFA results indicated that HEVS consisted of two factors: Expectancy and Value. Given an adequate level of measurement invariance, we further examined the latent mean difference across gender for the entire sample (n = 612). Our findings showed no statistically significant mean differences in Expectancy and Value across gender. Finally, consistent with theoretical expectations, Expectancy and Value were negatively correlated with homework distraction and the frequency of attending online classes without homework, and positively correlated with homework emotion regulation and homework completion.

References

  • Allen, E. & Seaman, J. (2014). Grade change: Tracking online education in the United States. The Sloan Consortium. Oakland, CA: Babson Survey Research Group and Quahog Research Group LLC. Retrieved from http://www.onlinelearningsurvey.com/reports/gradechange.pdf First citation in articleGoogle Scholar

  • Browne, M. W. & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. BollenJ. S. LongEds., Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage. First citation in articleGoogle Scholar

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834 First citation in articleCrossrefGoogle Scholar

  • Cheung, G. W. & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5 First citation in articleCrossrefGoogle Scholar

  • Eccles, J. S. (2009). Who am I and what am I going to do with my life? Personal and collective identities as motivators of action. Educational Psychologist, 44, 78–89. https://doi.org/10.1080/00461520902832368 First citation in articleCrossrefGoogle Scholar

  • Eccles, J. S. & Wigfield, A. (1995). In the mind of the actor: The structure of adolescents’ achievement task values and expectancy-related beliefs. Personality and Social Psychology Bulletin, 21, 215–225. https://doi.org/10.1177/0146167295213003 First citation in articleCrossrefGoogle Scholar

  • Gadermann, A. M., Guhn, M. & Zumbo, B. D. (2012). Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research and Evaluation, 17(3), 1–13. Retrieved from http://pareonline.net/pdf/v17n3.pdf First citation in articleGoogle Scholar

  • Henson, R. K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177–189. First citation in articleCrossrefGoogle Scholar

  • Henson, R. K. & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66, 393–416. https://doi.org/10.1177/0013164405282485 First citation in articleCrossrefGoogle Scholar

  • Hu, L. T. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118 First citation in articleCrossrefGoogle Scholar

  • Hulleman, C. S., Kosovich, J. J., Barron, K. E. & Daniel, D. B. (2017). Making connections: Replicating and extending the utility value intervention in the classroom. Journal of Educational Psychology, 109, 387–404. https://doi.org/10.1037/edu0000146 First citation in articleCrossrefGoogle Scholar

  • Joo, Y. J., Oh, E. & Kim, S. M. (2015). Motivation, instructional design, flow, and academic achievement at a Korean online university: A structural equation modeling study. Journal of Computing in Higher Education, 27, 28–46. https://doi.org/10.1007/s12528-015-9090-9 First citation in articleCrossrefGoogle Scholar

  • Kapitula, L. (2014). Estimating ordinal reliability using SAS. SAS Global Forum 2014 (Paper 2042), Available at http://www.sascommunity.org/wiki/Estimating_Ordinal_Reliability_Using_SAS%C2%AE First citation in articleGoogle Scholar

  • Khanlarian, C. & Singh, R. (2015). Does technology affect student performance? Global Perspective on Accounting Education, 12, 1–22. First citation in articleGoogle Scholar

  • Khojasteh, J. & Lo, W. J. (2015). Investigating the sensitivity of goodness-of-fit indices to detect measurement invariance in a bifactor model. Structural Equation Modeling, 22, 531–541. https://doi.org/10.1080/10705511.2014.937791 First citation in articleCrossrefGoogle Scholar

  • Kline, R. B. (2010). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Kosovich, J. J., Hulleman, C. S., Barron, K. E. & Getty, S. (2015). A practical measure of student motivation establishing validity evidence for the expectancy-value-cost scale in middle school. Journal of Early Adolescence, 35, 790–816. https://doi.org/10.1177/0272431614556890 First citation in articleCrossrefGoogle Scholar

  • Marsh, H. W., Hau, K. T. & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11, 320–341. https://doi.org/10.1207/s15328007sem1103_2 First citation in articleCrossrefGoogle Scholar

  • Marsh, H. W., Pekrun, R., Lichtenfeld, S., Guo, J., Arens, A. K. & Murayama, K. (2016). Breaking the double-edged sword of effort/trying hard: Developmental equilibrium and longitudinal relations among effort, achievement, and academic self-concept. Developmental Psychology, 52, 1273–1290. https://doi.org/10.1037/dev0000146 First citation in articleCrossrefGoogle Scholar

  • Maruyama, G. M. (1998). Basics of structural equation modeling. London, UK: Sage. First citation in articleCrossrefGoogle Scholar

  • Muthén, L. K. & Muthén, B. O. (1998–2012). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén. First citation in articleGoogle Scholar

  • Núñez, J. C., Suárez, N., Rosário, P., Vallejo, G., Cerezo, R. & Valle, A. (2015). Teachers’ feedback on homework, homework-related behaviors, and academic achievement. Journal of Educational Research, 108, 204–216. https://doi.org/10.1080/00220671.2013.878298 First citation in articleCrossrefGoogle Scholar

  • Richardson, M., Abraham, C. & Bond, R. (2012). Psychological correlates of university students’ academic performance: A systematic review and meta-analysis. Psychological Bulletin, 138, 353–387. https://doi.org/10.1037/a0026838 First citation in articleCrossrefGoogle Scholar

  • Rosário, P., Núñez, J. C., Vallejo, G., Cunha, J., Nunes, T., Mourão, R. & Pinto, R. (2015). Does homework design matter? The role of homework’s purpose in student mathematics achievement. Contemporary Educational Psychology, 43, 10–24. https://doi.org/10.1016/j.cedpsych.2015.08.001 First citation in articleCrossrefGoogle Scholar

  • Trautwein, U., Ludtke, O., Schnyder, I. & Niggli, A. (2006). Predicting homework effort: Support for a domain-specific, multilevel homework model. Journal of Educational Psychology, 98, 438–456. https://doi.org/10.1037/0022-0663.98.2.438 First citation in articleCrossrefGoogle Scholar

  • Volet, S., Vauras, M. & Salonen, P. (2009). Self- and social regulation in learning contexts: An integrative perspective. Educational Psychologist, 44, 215–226. https://doi.org/10.1080/00461520903213584 First citation in articleCrossrefGoogle Scholar

  • Wigfield, A. & Cambria, J. (2010). Expectancy-value theory: Retrospective and prospective. In T. C. UrdanS. A. KarabenickEds., The decade ahead: Theoretical perspectives on motivation and achievement (Advances in motivation and achievement) (Vol. 16 pp. 74–146). Bingley, UK: Emerald Group Publishing. First citation in articleGoogle Scholar

  • Wigfield, A., Eccles, J. S., Fredricks, J. A., Simpkins, S., Roeser, R. W. & Schiefele, U. (2015). Development of achievement motivation and engagement. In M. E. LambR. M. LernerEds., Handbook of child psychology and developmental science, Vol. 3. Socioemotional processes (7th ed., pp. 657–700). Hoboken, NJ: Wiley. First citation in articleGoogle Scholar

  • Winter, J., Cotton, D., Gavin, J. & Yorke, J. D. (2010). Effective e-learning? Multi-tasking, distractions and boundary management by graduate students in an online environment. Research in Learning Technology, 18, 71–83. https://doi.org/10.1080/09687761003657598 First citation in articleCrossrefGoogle Scholar

  • Xu, J. (2010). Homework purpose scale for high school students: A validation study. Educational and Psychological Measurement, 70, 459–476. https://doi.org/10.1177/0013164409344517 First citation in articleCrossrefGoogle Scholar

  • Xu, J. (2015). Investigating factors that influence conventional distraction and tech-related distraction in math homework. Computers and Education, 81, 304–314. https://doi.org/10.1016/j.compedu.2014.10.024 First citation in articleCrossrefGoogle Scholar

  • Xu, J., Du, J. & Fan, X. (2017). Self-regulation of math homework behavior: An empirical investigation. Journal of Educational Research, 110, 467–477. https://doi.org/10.1080/00220671.2015.1125837 First citation in articleCrossrefGoogle Scholar

  • Xu, J., Fan, X. & Du, J. (2016a). Homework Distraction Scale: Confirming the factor structure with middle school students. Journal of Psychoeducational Assessment, 34, 496–500. https://doi.org/10.1177/0734282915620900 First citation in articleCrossrefGoogle Scholar

  • Xu, J., Fan, X. & Du, J. (2016b). Homework Emotion Regulation Scale: Psychometric properties for middle school students. Journal of Psychoeducational Assessment, 34, 351–361. https://doi.org/10.1177/0734282915603542 First citation in articleCrossrefGoogle Scholar

  • Zembylas, M. (2008). Adult learners’ emotion in online learning. Distance Education, 29, 71–87. https://doi.org/10.1080/01587910802004852 First citation in articleCrossrefGoogle Scholar

  • Zumbo, B. D., Gadermann, A. M. & Zeisser, C. (2007). Ordinal versions of coefficient’s alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6. Article 4. http://digitalcommons.wayne.edu/jmasm/vol6/iss1/4 First citation in articleCrossrefGoogle Scholar