Skip to main content
Original Article

Measuring Presence and Situational Awareness in a Virtual Reality Flight Simulator

Published Online:https://doi.org/10.1027/2192-0923/a000250

Abstract: A sense of presence plays a significant role in virtual reality (VR) usability, yet there is limited research of its existence in a virtual reality flight simulator (VRFS). Similarly, there is scarce investigation of situational awareness (SA) in a VRFS. Consequently, this paper discusses an experiment that explored presence and SA in a VRFS. Physiological responses are also captured. The results reveal that participants felt a high degree of presence in a VRFS, and felt immersed and involved. The sense of presence contributed to good SA, and physiological data identified increased stress levels. These results are an important step in the exploration of VR in the field of aviation training. However, more research is required to identify how and where VR could be applied.

References

  • Aggarwal, R., Ward, J., Balasundaram, I., Sains, P., Athanasiou, T., & Darzi, A. (2007). Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Annals of Surgery, 246(5), 771–779. https://doi.org/10.1097/SLA.0b013e3180f61b09 First citation in articleCrossrefGoogle Scholar

  • Airbus. (2019). Airbus brings cockpit to you with new virtual reality flight trainer. https://aircraft.airbus.com/en/airbus-brings-cockpit-to-you-with-new-virtual-reality-flight-trainer First citation in articleGoogle Scholar

  • Boag, C. C., Neale, M. C., & Neal, A. F. (1999). Measuring situation awareness: A comparison of alternative measurement tools. In R. JensenJ. CallisterEds., Proceedings of the 10th International Symposium on Aviation Psychology (pp. 1240–1246). The Ohio State University. First citation in articleGoogle Scholar

  • Boeing. (2017). Flying virtually solo. http://www.boeing.com/features/2017/07/virtual-copilot-07-17.page First citation in articleGoogle Scholar

  • Bowman, D. A., & McMahan, R. P. (2007). Virtual reality: How much immersion is enough? Computer, 40(7), 36–43. https://doi.org/10.1109/MC.2007.257 First citation in articleCrossrefGoogle Scholar

  • Brookhuis, K. A., & De Waard, D. (2011). Measuring physiology in simulators. In D. FisherJ. D. LeeJ. K. CairdM. RizzoEds., Handbook of driving simulation for engineering, medicine and psychology (pp. 17-1–17-10). CRC Press. First citation in articleCrossrefGoogle Scholar

  • Cross, J. I., Boag-Hodgson, C., Ryley, T., Mavin, T., & Potter, L. E. (2022). Using extended reality in flight simulators: A literature review. IEEE Transactions on Visualization and Computer Graphics, https://doi.org/10.1109/TVCG.2022.3173921 First citation in articleCrossrefGoogle Scholar

  • Dahlström, N., Dekker, S., van Winsen, R., & Nyce, J. (2009). Fidelity and validity of simulator training. Theoretical Issues in Ergonomics Science, 10(4), 305–314. https://doi.org/10.1080/14639220802368864 First citation in articleCrossrefGoogle Scholar

  • Dijcker, P. D., Hornickel, A., & Luijten, C. (2005). The question of “where are you?”: Immersion and presence. Interactive Virtual Environments (2IV50). Department of Mathematics and Computer Science. Technische Universiteit Eindhoven. First citation in articleGoogle Scholar

  • Durso, F. T., Truitt, T. R., Hackworth, C. A., Crutchfield, J. M., Nikolic, D., Moertl, P. M., Ohrt, D., & Manning, C. A. (1995). Expertise and chess: A pilot study comparing situation awareness methodologies. In D. J. GarlandM. EndsleyEds., Experimental analysis and measurement of situation awareness (pp. 11–111). Embry-Riddle Aeronautical University Press. First citation in articleGoogle Scholar

  • Endsley, M. R. (1995). Toward a theory of situation awareness in dynamic systems. Human Factors, 37(1), 32–64. https://doi.org/10.1518/001872095779049543 First citation in articleCrossrefGoogle Scholar

  • Endsley, M. R. (2015). Final reflections: Situation awareness models and measures. Journal of Cognitive Engineering and Decision Making, 9(1), 101–111. https://doi.org/10.1177/1555343415573911 First citation in articleCrossrefGoogle Scholar

  • FlightGlobal. (2021). EASA approves virtual-reality simulation for R22 training. https://www.flightglobal.com/helicopters/easa-approves-virtual-reality-simulation-for-r22-training/143459.article First citation in articleGoogle Scholar

  • Foster, P. P. (2015). Role of physical and mental training in brain network configuration. Frontiers in Aging Neuroscience, 7. https://doi.org/10.3389/fnagi.2015.00117 First citation in articleCrossrefGoogle Scholar

  • Jahedi, S., & Méndez, F. (2014). On the advantages and disadvantages of subjective measures. Journal of Economic Behavior & Organization, 98, 97–114. https://doi.org/10.1016/j.jebo.2013.12.016 First citation in articleCrossrefGoogle Scholar

  • Kim, H. G., Cheon, E. J., Bai, D. S., Lee, Y. H., & Koo, B. H. (2018). Stress and heart rate variability: A meta-analysis and review of the literature. Psychiatry Investigation, 15(3), 235–245. https://doi.org/10.30773/pi.2017.08.17 First citation in articleCrossrefGoogle Scholar

  • Kubios. (2022). HRV in evaluating ANS function. https://www.kubios.com First citation in articleGoogle Scholar

  • Lombard, M., & Ditton, T. (1997). At the heart of it all: The concept of presence. Journal of Computer-Mediated Communication, 3(2). https://doi.org/10.1111/j.1083-6101.1997.tb00072.x First citation in articleCrossrefGoogle Scholar

  • Lombard, M., & Jones, M. T. (2015). Defining presence. In M. LombardF. BioccaJ. FreemanW. IJsselsteijnR. J. SchaevitzEds., Immersed in media: Telepresence theory, measurement and technology (pp. 13–34). Springer International Publishing. https://doi.org/10.1007/978–3-319–10190-3_2 First citation in articleCrossrefGoogle Scholar

  • Loup, G., Serna, A., Iksal, S., & George, S. (2016). Immersion and persistence: Improving learners’ engagement in authentic learning situations. In K. VerbertM. SharplesT. KlobučarEds., Adaptive and adaptable learning (pp. 410–415). Springer International Publishing. https://doi.org/10.1007/978–3-319–45153-4_35 First citation in articleCrossrefGoogle Scholar

  • Mavin, T. J., & Murray, P. S. (2010). The development of airline pilot skills through simulated practice. In S. BillettEd., Learning through practice: Models, traditions, orientations, and approaches (pp. 268–286). Springer. First citation in articleGoogle Scholar

  • Mulder, L. J. M. (1992). Measurement and analysis methods of heart rate and respiration for use in applied environments. Biological Psychology, 34(2), 205–236. https://doi.org/10.1016/0301-0511(92)90016-N First citation in articleCrossrefGoogle Scholar

  • Müller, J., Radle, R., & Reiterer, H. (2016, May 7–12). Virtual objects as spatial cues in collaborative mixed reality environments: How they shape communication behavior and user task load [Conference presentation]. In J. KayeEd., The 2016 CHI Conference on Human Factors in Computing Systems (CHI’ 16), New York, NY, United States (pp. 1245–1249). ACM. First citation in articleGoogle Scholar

  • Nilsson, N. C., Nordahl, R., & Serafin, S. (2016). Immersion revisited: A review of existing definitions of immersion and their relation to different theories of presence. Human Technology, 12(2), 108–134. https://doi.org/10.17011/ht/urn.201611174652 First citation in articleCrossrefGoogle Scholar

  • Nunan, D., Sandercock, G. R. H., & Brodie, D. A. (2010). A quantitative systematic review of normal values for short-term heart rate variability in healthy adults. Pacing and Clinical Electrophysiology, 33(11), 1407–1417. https://doi.org/10.1111/j.1540-8159.2010.02841.x First citation in articleCrossrefGoogle Scholar

  • Oberhauser, M., & Dreyer, D. (2017). A virtual reality flight simulator for human factors engineering. Springer. https://doi.org/10.1007/s10111–017-0421–7 First citation in articleCrossrefGoogle Scholar

  • Oberhauser, M., Dreyer, D., Braunstingl, R., & Koglbauer, I. (2017a). Pilots’ flight performance in a virtual reality flight simulator. In M. SchwarzJ. HarfmannEds., Proceedings of the 32nd Conference of the European Association of Aviation Psychology (pp. 322–335). European Association for Aviation Psychology. First citation in articleGoogle Scholar

  • Oberhauser, M., Dreyer, D., Braunstingl, R., & Koglbauer, I. (2017b). Pilots’ interaction with hardware controls in a virtual reality flight simulator. In M. SchwarzJ. Harfmann (Eds.). Proceedings of the 32nd Conference of the European Association of Aviation Psychology (565–575). European Association for Aviation Psychology. First citation in articleGoogle Scholar

  • Oberhauser, M., Dreyer, D., Braunstingl, R., & Koglbauer, L. (2018). What’s real about virtual reality flight simulation? Aviation Psychology and Applied Human Factors, 8(1), 22–34. https://doi.org/10.1027/2192-0923/a000134 First citation in articleLinkGoogle Scholar

  • Salmon, P., Stanton, N., Walker, G., & Green, D. (2006). Situation awareness measurement: A review of applicability for C4i environments. Applied Ergonomics, 37(2), 225–238. https://doi.org/10.1016/j.apergo.2005.02.001 First citation in articleCrossrefGoogle Scholar

  • Schaffernak, H., Moesl, B., Vorraber, W., Holy, M., Herzog, E.-M., Novak, R., & Koglbauer, I. V. (2022). Novel mixed reality use cases for pilot training. Education Sciences, 12(5), Article 345. MDPI AG. https://doi.org/10.3390/educsci12050345 First citation in articleCrossrefGoogle Scholar

  • Schaper, M., Santos, M., Malinverni, L., Zerbini Berro, J., & Pares, N. (2018). Learning about the past through situatedness, embodied exploration and digital augmentation of cultural heritage sites. International Journal of Human-Computer Studies, 114, 36–50. https://doi.org/10.1016/j.ijhcs.2018.01.003 First citation in articleCrossrefGoogle Scholar

  • Schubert, T., Friedmann, F., & Regenbrecht, H. (2001). The experience of presence: Factor analytic insights. Presence: Teleoperators & Virtual Environment, 10(3), 266–281. https://doi.org/10.1162/105474601300343603 First citation in articleCrossrefGoogle Scholar

  • Sheridan, T. B. (1992). Musings on telepresence and virtual Presence. Presence: Teleoperators and Virtual Environments, 1(1), 120–125. First citation in articleCrossrefGoogle Scholar

  • Slater, M. (2003). A note on presence terminology. Presence Connect, 3(3), 1–5. First citation in articleGoogle Scholar

  • Slater, M., & Steed, A. (2000). A virtual presence counter. Presence: Teleoperators & Virtual Environments, 9(5), 413–434. https://doi.org/10.1162/105474600566925 First citation in articleCrossrefGoogle Scholar

  • Smith, K., & Hancock, P. A. (1995). Situation awareness is adaptive, externally directed consciousness. Human Factors, 37(1), 137–148. https://doi.org/10.1518/001872095779049444 First citation in articleCrossrefGoogle Scholar

  • Stanton, N. A., Chambers, P. R. G., & Piggott, J. (2001). Situational awareness and safety. Safety Science, 39(3), 189–204. https://doi.org/10.1016/S0925-7535(01)00010-8 First citation in articleCrossrefGoogle Scholar

  • Taylor, R. M. (2017). Situational awareness rating technique (SART): The development of a tool for aircrew systems design. In R. M. TaylorEd., Situational awareness (pp. 111–128). Routledge. https://doi.org/10.4324/9781315087924-8 First citation in articleCrossrefGoogle Scholar

  • Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators & Virtual Environments, 7(3), 225–240. https://doi.org/10.1162/105474698565686 First citation in articleCrossrefGoogle Scholar