Homework Expectancy Value Scale for Undergraduates in Online Environments
Measurement Invariance and Latent Mean Differences Across Gender
Abstract
Abstract. The goal of the current study was to validate the Homework Expectancy Value Scale (HEVS) for undergraduates in online learning environments. After randomly splitting the sample in halves, we conducted exploratory factor analysis (EFA) with the first half (n = 306) and confirmatory factor analysis (CFA) with the second half (n = 306). Both EFA and CFA results indicated that HEVS consisted of two factors: Expectancy and Value. Given an adequate level of measurement invariance, we further examined the latent mean difference across gender for the entire sample (n = 612). Our findings showed no statistically significant mean differences in Expectancy and Value across gender. Finally, consistent with theoretical expectations, Expectancy and Value were negatively correlated with homework distraction and the frequency of attending online classes without homework, and positively correlated with homework emotion regulation and homework completion.
References
2014). Grade change: Tracking online education in the United States. The Sloan Consortium. Oakland, CA: Babson Survey Research Group and Quahog Research Group LLC. Retrieved from http://www.onlinelearningsurvey.com/reports/gradechange.pdf
(1993).
(Alternative ways of assessing model fit . In K. A. BollenJ. S. LongEds., Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834
(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5
(2009). Who am I and what am I going to do with my life? Personal and collective identities as motivators of action. Educational Psychologist, 44, 78–89. https://doi.org/10.1080/00461520902832368
(1995). In the mind of the actor: The structure of adolescents’ achievement task values and expectancy-related beliefs. Personality and Social Psychology Bulletin, 21, 215–225. https://doi.org/10.1177/0146167295213003
(2012). Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research and Evaluation, 17(3), 1–13. Retrieved from http://pareonline.net/pdf/v17n3.pdf
(2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177–189.
(2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66, 393–416. https://doi.org/10.1177/0013164405282485
(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118
(2017). Making connections: Replicating and extending the utility value intervention in the classroom. Journal of Educational Psychology, 109, 387–404. https://doi.org/10.1037/edu0000146
(2015). Motivation, instructional design, flow, and academic achievement at a Korean online university: A structural equation modeling study. Journal of Computing in Higher Education, 27, 28–46. https://doi.org/10.1007/s12528-015-9090-9
(2014). Estimating ordinal reliability using SAS. SAS Global Forum 2014 (Paper 2042), Available at http://www.sascommunity.org/wiki/Estimating_Ordinal_Reliability_Using_SAS%C2%AE
(2015). Does technology affect student performance? Global Perspective on Accounting Education, 12, 1–22.
(2015). Investigating the sensitivity of goodness-of-fit indices to detect measurement invariance in a bifactor model. Structural Equation Modeling, 22, 531–541. https://doi.org/10.1080/10705511.2014.937791
(2010). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press.
(2015). A practical measure of student motivation establishing validity evidence for the expectancy-value-cost scale in middle school. Journal of Early Adolescence, 35, 790–816. https://doi.org/10.1177/0272431614556890
(2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11, 320–341. https://doi.org/10.1207/s15328007sem1103_2
(2016). Breaking the double-edged sword of effort/trying hard: Developmental equilibrium and longitudinal relations among effort, achievement, and academic self-concept. Developmental Psychology, 52, 1273–1290. https://doi.org/10.1037/dev0000146
(1998). Basics of structural equation modeling. London, UK: Sage.
(1998–2012). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
(2015). Teachers’ feedback on homework, homework-related behaviors, and academic achievement. Journal of Educational Research, 108, 204–216. https://doi.org/10.1080/00220671.2013.878298
(2012). Psychological correlates of university students’ academic performance: A systematic review and meta-analysis. Psychological Bulletin, 138, 353–387. https://doi.org/10.1037/a0026838
(2015). Does homework design matter? The role of homework’s purpose in student mathematics achievement. Contemporary Educational Psychology, 43, 10–24. https://doi.org/10.1016/j.cedpsych.2015.08.001
(2006). Predicting homework effort: Support for a domain-specific, multilevel homework model. Journal of Educational Psychology, 98, 438–456. https://doi.org/10.1037/0022-0663.98.2.438
(2009). Self- and social regulation in learning contexts: An integrative perspective. Educational Psychologist, 44, 215–226. https://doi.org/10.1080/00461520903213584
(2010).
(Expectancy-value theory: Retrospective and prospective . In T. C. UrdanS. A. KarabenickEds., The decade ahead: Theoretical perspectives on motivation and achievement (Advances in motivation and achievement ) (Vol. 16 pp. 74–146). Bingley, UK: Emerald Group Publishing.2015).
(Development of achievement motivation and engagement . In M. E. LambR. M. LernerEds., Handbook of child psychology and developmental science, Vol. 3. Socioemotional processes (7th ed., pp. 657–700). Hoboken, NJ: Wiley.2010). Effective e-learning? Multi-tasking, distractions and boundary management by graduate students in an online environment. Research in Learning Technology, 18, 71–83. https://doi.org/10.1080/09687761003657598
(2010). Homework purpose scale for high school students: A validation study. Educational and Psychological Measurement, 70, 459–476. https://doi.org/10.1177/0013164409344517
(2015). Investigating factors that influence conventional distraction and tech-related distraction in math homework. Computers and Education, 81, 304–314. https://doi.org/10.1016/j.compedu.2014.10.024
(2017). Self-regulation of math homework behavior: An empirical investigation. Journal of Educational Research, 110, 467–477. https://doi.org/10.1080/00220671.2015.1125837
(2016a). Homework Distraction Scale: Confirming the factor structure with middle school students. Journal of Psychoeducational Assessment, 34, 496–500. https://doi.org/10.1177/0734282915620900
(2016b). Homework Emotion Regulation Scale: Psychometric properties for middle school students. Journal of Psychoeducational Assessment, 34, 351–361. https://doi.org/10.1177/0734282915603542
(2008). Adult learners’ emotion in online learning. Distance Education, 29, 71–87. https://doi.org/10.1080/01587910802004852
(2007). Ordinal versions of coefficient’s alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6. Article 4. http://digitalcommons.wayne.edu/jmasm/vol6/iss1/4
(