Skip to main content
Editorial

Validly Authentic

Some Recommendations to Researchers Using Simulations in Psychological Assessment

Published Online:https://doi.org/10.1027/1015-5759/a000686
Free first page

References

  • Brehmer, B., & Dörner, D. (1993). Experiments with computer-simulated microworlds: Escaping both the narrow straits of the laboratory and the deep blue sea of the field study. Computers in Human Behavior, 9(2–3), 171–184. https://doi.org/10.1016/0747-5632(93)90005-d First citation in articleCrossrefGoogle Scholar

  • Chernikova, O., Heitzmann, N., Stadler, M., Holzberger, D., Seidel, T., & Fischer, F. (2020). Simulation-based learning in higher education: A meta-analysis. Review of Educational Research, 90(4), 499–541. https://doi.org/10.3102/0034654320933544 First citation in articleCrossrefGoogle Scholar

  • Cipresso, P., Pedroli, E., Serino, S., Semonella, M., Tuena, C., Colombo, D., Pallavicini, F., & Riva, G. (2018). Assessment of unilateral spatial neglect using a free mobile application for Italian clinicians. Frontiers in Psychology, 9, Article 2241. https://doi.org/10.3389/fpsyg.2018.02241 First citation in articleCrossrefGoogle Scholar

  • Codreanu, E., Sommerhoff, D., Huber, S., Ufer, S., & Seidel, T. (2020). Between authenticity and cognitive demand: Finding a balance in designing a video-based simulation in the context of mathematics teacher education. Teaching and Teacher Education, 95, Article 103146. https://doi.org/10.1016/j.tate.2020.103146 First citation in articleCrossrefGoogle Scholar

  • Cronabch, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957 First citation in articleCrossrefGoogle Scholar

  • de-Juan-Ripoll, C., Soler-Domínguez, J. L., Guixeres, J., Contero, M., Álvarez Gutiérrez, N., & Alcañiz, M. (2018). Virtual reality as a new approach for risk taking assessment. Frontiers in Psychology, 9, Article 2532. https://doi.org/10.3389/fpsyg.2018.02532 First citation in articleCrossrefGoogle Scholar

  • Doerner, D. (1980). On the difficulties people have in dealing with complexity. Simulation & Games, 11(1), 87–106. https://doi.org/10.1177/104687818001100108 First citation in articleCrossrefGoogle Scholar

  • Drews, F. A., Syroid, N., Agutter, J., Strayer, D. L., & Westenskow, D. R. (2006). Drug delivery as control task: Improving performance in a common anesthetic task. Human Factors, 48(1), 85–94. https://doi.org/10.1518/001872006776412216 First citation in articleCrossrefGoogle Scholar

  • Elshout, J. J. (1987). Problem solving and education. In E. de CorteH. LodewijksR. ParmentierEds., Learning and instruction (pp. 259–273). Pergamon. First citation in articleGoogle Scholar

  • Gierl, M. J., & Haladyna, T. M. (2012). Automatic item generation. Routledge. https://doi.org/10.4324/9780203803912 First citation in articleCrossrefGoogle Scholar

  • Goldhammer, F., Scherer, R., & Greiff, S. (2019). Editorial: Advancements in technology-based assessment: Emerging item formats, test designs, and data sources. Frontiers in Psychology, 10, Article 3047. https://doi.org/10.3389/fpsyg.2019.03047 First citation in articleCrossrefGoogle Scholar

  • Greiff, S. (2017). The field of psychological assessment: Where it stands and where it’s going – A personal analysis of foci, gaps, and implications for EJPA. European Journal of Psychological Assessment, 33(1), 1–4. https://doi.org/10.1027/1015-5759/a000412 First citation in articleLinkGoogle Scholar

  • Greiff, S., Fischer, A., Stadler, M., & Wüstenberg, S. (2015). Assessing complex problem-solving skills with multiple complex systems. Thinking & Reasoning, 21(3), 356–382. https://doi.org/10.1080/13546783.2014.989263 First citation in articleCrossrefGoogle Scholar

  • Han, Z., He, Q., & von Davier, M. (2019). Predictive feature generation and selection using process data from PISA interactive problem-solving items: An application of random forests. Frontiers in Psychology, 10, Article 2461. https://doi.org/10.3389/fpsyg.2019.02461 First citation in articleCrossrefGoogle Scholar

  • Holland, P. W., & Wainer, H. (2012). Differential item functioning. Routledge. https://doi.org/10.4324/9780203357811 First citation in articleCrossrefGoogle Scholar

  • Kubinger, K. D. (2009). Applications of the linear logistic test model in psychometric research. Educational and Psychological Measurement, 69(2), 232–244. https://doi.org/10.1177/0013164408322021 First citation in articleCrossrefGoogle Scholar

  • Leutner, D. (2002). The fuzzy relationship of intelligence and problem solving in computer simulations. Computers in Human Behavior, 18(6), 685–697. https://doi.org/10.1016/s0747-5632(02)00024-9 First citation in articleCrossrefGoogle Scholar

  • Norman, G., Bordage, G., Page, G., & Keane, D. (2006). How specific is case specificity? Medical Education, 40(7), 618–623. https://doi.org/10.1111/j.1365-2929.2006.02511.x First citation in articleCrossrefGoogle Scholar

  • Raaheim, K. (1988). Intelligence and task novelty. In R. J. SternbergEd., Advances in the psychology of human intelligence (Vol. 4, pp. 73–97). Erlbaum. First citation in articleGoogle Scholar

  • Schuwirth, L. W. T., & van der Vleuten, C. P. M. (2003). The use of clinical simulations in assessment. Medical Education, 37(Suppl 1), 65–71. https://doi.org/10.1046/j.1365-2923.37.s1.8.x First citation in articleCrossrefGoogle Scholar

  • Stadler, M., Becker, N., Gödker, M., Leutner, D., & Greiff, S. (2015). Complex problem solving and intelligence: A meta-analysis. Intelligence, 53, 92–101. https://doi.org/10.1016/j.intell.2015.09.005 First citation in articleCrossrefGoogle Scholar

  • Stadler, M., Niepel, C., & Greiff, S. (2016). Easily too difficult: Estimating item difficulty in computer simulated microworlds. Computers in Human Behavior, 65, 100–106. https://doi.org/10.1016/j.chb.2016.08.025 First citation in articleCrossrefGoogle Scholar

  • Süß, H.-M., Kersting, M., & Oberauer, K. (1993). Zur Vorhersage von Steuerungsleistungen an Computersimulierten Systemen durch Wissen und Intelligenz [On the predictability of control performance on computer-simulated systems by knowledge and intelligence]. Zeitschrift für Differentielle und Diagnostische Psychologie, 14(3), 189–203. First citation in articleGoogle Scholar

  • von Davier, A. A., Zhu, M., & Kyllonen, P. C. (2017). Innovative assessment of collaboration: Methodology of educational measurement and assessment. Springer. First citation in articleCrossrefGoogle Scholar

  • Weise, J. J., Greiff, S., & Sparfeldt, J. R. (2020). The moderating effect of prior knowledge on the relationship between intelligence and complex problem solving – testing the Elshout-Raaheim hypothesis. Intelligence, 83, Article 101502. https://doi.org/10.1016/j.intell.2020.101502 First citation in articleCrossrefGoogle Scholar

  • Ziegler, M. (2014). Stop and state your intentions. European Journal of Psychological Assessment, 30(4), 239–242. https://doi.org/10.1027/1015-5759/a000228 First citation in articleLinkGoogle Scholar