Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article

Development and Validation of the Work Orientation Questionnaire Short-Form (WOQ-SF)

Evidence From China

Published Online:December 12, 2023https://doi.org/10.1027/1015-5759/a000814

Abstract

Abstract: This research aims to develop a 15-item short form of the WOQ (WOQ-SF) and provide evidence for its reliability and validity. In Study 1 (N = 305), we simplified the WOQ into a short version in line with the scale reduction procedure and recommendations (Kruyen et al., 2013; Stanton et al., 2002). The exploratory factor analysis (EFA) reveals that the five factors of the WOQ-SF are conceptually distinct and correlated with each other. In Study 2 (N = 442), the psychometric properties of the WOQ-SF were investigated. The findings of the confirmatory factor analysis (CFA) confirm a good factor structure. In addition, the measurement invariance of this shortened scale was examined across gender, age, education level, and job tenure. Regarding validity, significant correlations between the WOQ-SF and the original WOQ were found. Furthermore, the WOQ-SF demonstrates relationships with career satisfaction, work engagement, job satisfaction, and career planning, providing evidence for its validity. In sum, the WOQ-SF shows good psychometric properties comparable to the WOQ, suggesting it is a suitable alternative.

References

  • American Psychological Association. (2017). Ethical principles of psychologists and code of conduct (2002, amended effective June 1, 2010, and January 1, 2017). https://www.apa.org/ethics/code/ First citation in articleGoogle Scholar

  • Bellah, R. N., Madsen, R., Sullivan, W. M., Swidler, A., & Tipton, S. M. (1985). Habits of the heart: Individualism and commitment in American life. University of California Press. First citation in articleGoogle Scholar

  • Blustein, D. L. (2011). A relational theory of working. Journal of Vocational Behavior, 79, 1–17. https://doi.org/10.1016/j.jvb.2010.10.004 First citation in articleCrossref, Google Scholar

  • Brislin, R.W. (1980). Translation and content analysis of oral and written material. In H. C. TriandisJ. W. BerryEds., Handbook of cross-cultural psychology: Methodology (pp. 389–444). Allyn and Bacon. First citation in articleGoogle Scholar

  • Cammann, C., Fichman, M., Jenkins, D., & Klesh, J. (1979). The Michigan Organizational Assessment Questionnaire [Unpublished manuscript]. University of Michigan. First citation in articleGoogle Scholar

  • Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5 First citation in articleCrossref, Google Scholar

  • Cho, Y., & Jiang, W. Y. (2022). How work orientation impacts objective career outcomes via managerial (mis)perceptions. Academy of Management Journal, 65(4), 1353–1382. https://doi.org/10.5465/amj.2020.0841 First citation in articleCrossref, Google Scholar

  • Cohen, P. (1981). Student ratings of instruction and student achievement: A meta-analysis of multi-section validity studies. Review of Educational Research, 51(3), 281–309. https://doi.org/10.3102/00346543051003281 First citation in articleCrossref, Google Scholar

  • Costello, A., & Osborne, J. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1–9. https://doi.org/10.7275/jyj1-4868 First citation in articleCrossref, Google Scholar

  • DeSimone, J. A., Harms, P. D., & DeSimone, A. J. (2015). Best practice recommendations for data screening. Journal of Organizational Behavior, 36(2), 171–181. https://doi.org/10.1002/job.1962 First citation in articleCrossref, Google Scholar

  • Dobrow, S. R., & Heller, D. (2015). Follow your heart or your head? A longitudinal study of the facilitating role of calling and ability in the pursuit of a challenging career. Journal of Applied Psychology, 100, 695–712. https://doi.org/0.1037/a0038011 First citation in articleCrossref, Google Scholar

  • Du, T. V., Collison, K. L., Vize, C., Miller, J. D., & Lynam, D. R. (2021). Development and validation of the super-short form of the Five Factor Machiavellianism Inventory (FFMI-SSF). Journal of Personality Assessment, 103(6), 732–739. https://doi.org/10.1080/00223891.2021.1878525 First citation in articleCrossref, Google Scholar

  • Dueber, D. M. (2019). dmacs: Measurement nonequivalence effect size calculator. R package version 0.1.0 [Computer software] https://CRAN.R-project.org/package=dmacs First citation in articleGoogle Scholar

  • Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104 First citation in articleCrossref, Google Scholar

  • Gould, S. (1979). Characteristics of career planners in upwardly mobile occupations. Academy of Management Journal, 22(3), 539–550. https://doi.org/10.5465/255743 First citation in articleCrossref, Google Scholar

  • Greenhaus, J. H., Parasuraman, S., & Wormley, W. M. (1990). Effects of race on organizational experiences, job performance evaluations, and career outcomes. Academy of Management Journal, 33(1), 64–86. https://doi.org/10.5465/256352 First citation in articleCrossref, Google Scholar

  • Guan, Y., Zhou, W., Ye, L., Jiang, P., & Zhou, Y. (2015). Perceived organizational career management and career adaptability as predictors of success and turnover intention among Chinese employees. Journal of Vocational Behavior, 88, 230–237. https://doi.org/10.1016/j.jvb.2015.04.002 First citation in articleCrossref, Google Scholar

  • Halbesleben, J. R. B. (2010). A meta‐analysis of work engagement: Relationships with burnout, demands, resources, and consequences. In A. B. BakkerM. P. LeiterEds., Work engagement: A handbook of essential theory and research (pp. 102–117). Psychology Press. First citation in articleGoogle Scholar

  • Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2), 191–205. https://doi.org/10.1177/1094428104263675 First citation in articleCrossref, Google Scholar

  • Hirschi, A. (2012). Callings and work engagement: Moderated mediation model of work meaningfulness, occupational identity, and occupational self-efficacy. Journal of Counseling Psychology, 59(3), 479–485. https://doi.org/10.1037/a0028949 First citation in articleCrossref, Google Scholar

  • Hirschi, A., & Koen, J. (2021). Contemporary career orientations and career self-management: A review and integration. Journal of Vocational Behavior, 126, Article 103505. https://doi.org/10.1016/j.jvb.2020.103505 First citation in articleCrossref, Google Scholar

  • Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179–185. https://doi.org/10.1007/BF02289447 First citation in articleCrossref, Google Scholar

  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10705519909540118 First citation in articleCrossref, Google Scholar

  • James, J. B., McKechnie, S., & Swanberg, J. (2011). Predicting employee engagement in an age‐diverse retail workforce. Journal of Organizational Behavior, 32(2), 173–196. https://doi.org/10.1002/job.681 First citation in articleCrossref, Google Scholar

  • Kruyen, P. M., Emons, W. H., & Sijtsma, K. (2013). On the shortcomings of shortened tests: A literature review. International Journal of Testing, 13(3), 223–248. https://doi.org/10.1080/15305058.2012.703734 First citation in articleCrossref, Google Scholar

  • Lan, G., Okechuku, C., Zhang, H., & Cao, J. (2013). Impact of job satisfaction and personal values on the work orientation of Chinese accounting practitioners. Journal of Business Ethics, 112(4), 627–640. https://doi.org/10.1007/s10551-012-1562-5 First citation in articleCrossref, Google Scholar

  • Levy, P. (1967). The correction for spurious correlation in the evaluation of short-form tests. Journal of Clinical Psychology, 23, 84–86. https://doi.org/10.1002/1097-4679(196701)23:1<84::aid-jclp2270230123>3.0.co;2-2 First citation in articleCrossref, Google Scholar

  • Liden, R. C., Wayne, S. J., Meuser, J. D., Hu, J., Wu, J., & Liao, C. (2015). Servant leadership: Validation of a short form of the SL-28. The Leadership Quarterly, 26(2), 254–269. https://doi.org/10.1016/j.leaqua.2014.12.002 First citation in articleCrossref, Google Scholar

  • Lipshits-Braziler, Y., Abessolo, M., Santilli, S., & Di Maggio, I. (2021). Work orientation questionnaire: Measurement invariance and criterion validity among Swiss, Israeli, and Italian workers. International Journal for Educational and Vocational Guidance, 21(1), 187–209. https://doi.org/10.1007/s10775-020-09436-1 First citation in articleCrossref, Google Scholar

  • Little, T. D., Lindenberger, U., & Nesselroade, J. R. (1999). On selecting indicators for multivariate measurement and modeling with latent variables: When “good” indicators are bad and “bad” indicators are good. Psychological Methods, 4(2), 192–211. https://doi.org/10.1037/1082-989X.4.2.192 First citation in articleCrossref, Google Scholar

  • Liu, C., Spector, P. E., & Shi, L. (2007). Cross‐national job stress: A quantitative and qualitative study. Journal of Organizational Behavior, 28(2), 209–239. https://doi.org/10.1002/job.435 First citation in articleCrossref, Google Scholar

  • Liu, D., Wang, Y., & Li, C. (2023, September 9). The Short Form of the Work Orientation Questionnaire: Development and validation. https://osf.io/34vt5 First citation in articleCrossref, Google Scholar

  • Ma, C., Ganegoda, D. B., Chen, Z. X., Jiang, X., & Dong, C. (2020). Effects of perceived overqualification on career distress and career planning: Mediating role of career identity and moderating role of leader humility. Human Resource Management, 59(6), 521–536. https://doi.org/10.1002/hrm.22009 First citation in articleCrossref, Google Scholar

  • McDonald, R. P. (1970). The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23(1), 1–21. https://doi.org/10.1111/j.2044-8317.1970.tb00432.x First citation in articleCrossref, Google Scholar

  • Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93(3), 568–592. https://doi.org/10.1037/0021-9010.93.3.568 First citation in articleCrossref, Google Scholar

  • Nye, C. D., Bradburn, J., Olenick, J., Bialko, C., & Drasgow, F. (2019). How big are my effects? Examining the magnitude of effect sizes in studies of measurement equivalence. Organizational Research Methods, 22(3), 678–709. https://doi.org/10.1177/1094428118761122 First citation in articleCrossref, Google Scholar

  • Nye, C. D., & Drasgow, F. (2011). Effect size indices for analyses of measurement equivalence: Understanding the practical importance of differences between groups. Journal of Applied Psychology, 96(5), 966–980. https://doi.org/10.1037/a0022955 First citation in articleCrossref, Google Scholar

  • R Core Team. (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/ First citation in articleGoogle Scholar

  • Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5(1), 27–48. https://doi.org/10.1146/annurev.clinpsy.032408.153553 First citation in articleCrossref, Google Scholar

  • Rosseel, Y (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. http://www.jstatsoft.org/v48/i02/ First citation in articleCrossref, Google Scholar

  • Rosso, B. D., Dekas, K. H., & Wrzesniewski, A. (2010). On the meaning of work: A theoretical integration and review. Research in Organizational Behavior, 30, 91–127. https://doi.org/10.1016/j.riob.2010.09.001 First citation in articleCrossref, Google Scholar

  • Sarti, D. (2014). Job resources as antecedents of engagement at work: Evidence from a long‐term care setting. Human Resource Development Quarterly, 25(2), 213–237. https://doi.org/10.1002/hrdq.21189 First citation in articleCrossref, Google Scholar

  • Savickas, M. L., & Porfeli, E. J. (2012). Career Adapt-Abilities Scale: Construction, reliability, and measurement equivalence across 13 countries. Journal of Vocational Behavior, 80, 661–673. https://doi.org/10.1016/j.jvb.2012.01.011 First citation in articleCrossref, Google Scholar

  • Schaufeli, W. B., Shimazu, A., Hakanen, J., Salanova, M., & De Witte, H. (2019). An ultra-short measure for work engagement: The UWES-3 validation across five countries. European Journal of Psychological Assessment, 35(4), 577–591. https://doi.org/10.1027/1015-5759/a000430 First citation in articleLink, Google Scholar

  • Somaraju, A. V., Nye, C. D., & Olenick, J. (2022). A review of measurement equivalence in organizational research: What’s old, what’s new, what’s next? Organizational Research Methods, 25(4), 741–785. https://doi.org/10.1177/10944281211056524 First citation in articleCrossref, Google Scholar

  • Stanton, J. M., Sinar, E. F., Balzer, W. K., & Smith, P. C. (2002). Issues and strategies for reducing the length of self-report scales. Personnel Psychology, 55, 167–194. https://doi.org/10.1111/j.1744-6570.2002.tb00108.x First citation in articleCrossref, Google Scholar

  • Tian, Y., Zhang, H., Jiang, Y., & Yang, Y. (2022). Understanding trust and perceived risk in sharing accommodation: An extended elaboration likelihood model and moderated by risk attitude. Journal of Hospitality Marketing & Management, 31(3), 348–368. https://doi.org/10.1080/19368623.2022.1986190 First citation in articleCrossref, Google Scholar

  • Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002 First citation in articleCrossref, Google Scholar

  • Van den Broeck, A., Vansteenkiste, M., De Witte, H., Soenens, B., & Lens, W. (2010). Capturing autonomy, competence, and relatedness at work: Construction and initial validation of the Work‐related Basic Need Satisfaction scale. Journal of Occupational and Organizational Psychology, 83(4), 981–1002. https://doi.org/10.1348/096317909X481382 First citation in articleCrossref, Google Scholar

  • West, M. P., Miller, J. D., Weiss, B., Spencer, C. C., Crowe, M. L., Campbell, W. K., & Lynam, D. R. (2021). Development and validation of the super-short form of the Five-Factor Narcissism Inventory (FFNI-SSF). Personality and Individual Differences, 177, Article 110825. https://doi.org/10.1016/j.paid.2021.110825 First citation in articleCrossref, Google Scholar

  • Willner, T., Lipshits-Braziler, Y., & Gati, I. (2020). Construction and initial validation of the Work Orientation Questionnaire. Journal of Career Assessment, 28(1), 109–127. https://doi.org/10.1177/1069072719830293 First citation in articleCrossref, Google Scholar

  • Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177/0011000006288127 First citation in articleCrossref, Google Scholar

  • Wrzesniewski, A., McCauley, C., Rozin, P., & Schwartz, B. (1997). Jobs, careers, and callings: People’s relations to their work. Journal of Research in Personality, 31(1), 21–33. https://doi.org/10.1006/jrpe.1997.2162 First citation in articleCrossref, Google Scholar

  • Xie, B., Xia, M., Xin, X., & Zhou, W. (2016). Linking calling to work engagement and subjective career success: The perspective of career construction theory. Journal of Vocational Behavior, 94, 70–78. https://doi.org/10.1016/j.jvb.2016.02.011 First citation in articleCrossref, Google Scholar

  • Xie, B., Zhou, W., Xia, D., & Guo, Y. (2019). What drives the trickle-down effect of calling orientation from supervisors to subordinates? The perspective of social learning theory. Frontiers in Psychology, 10, Article 905. https://doi.org/10.3389/fpsyg.2019.00905 First citation in articleCrossref, Google Scholar

  • Xu, Y., Li, C., Wang, J., & Lan, Y. (2022). Validation of work need satisfaction scales among Chinese working adults: A psychology of working theory perspective. Journal of Career Assessment, 30(1), 181–199. https://doi.org/10.1177/10690727211032368 First citation in articleCrossref, Google Scholar

  • Zhang, C., Dik, B. J., Wei, J., & Zhang, J. (2015). Work as a calling in China: A qualitative study of Chinese college students. Journal of Career Assessment, 23(2), 236–249. https://doi.org/10.1177/1069072714535029 First citation in articleCrossref, Google Scholar