An Evaluation of Ohio Agricultural Education Students’ Performance and User Experience in a Virtual Reality Machinery Safety Experience
DOI:
https://doi.org/10.5032/jae.v66i1.2856Keywords:
Agricultural Education, instructional technology, Virtual RealityAbstract
Agriculture is one of the most hazardous industries in the United States for all workers, and even more so for young workers. In the U.S., legislation prescribes training for youth under the age of 16 working in hazardous situations in production agriculture. Virtual Reality (VR) technology has become an increasingly popular means of deploying training for various disciplines. The purpose of this study was to determine the feasibility of a VR curriculum to provide a realistic and positive user experience for students in tractor and machinery safety operation lessons. The VR curriculum developed for the study was based on the National Safe Tractor and Machinery Operation Program. Ohio Agricultural Education students’ (n = 132) user experience data were analyzed, and found students had a positive experience in the virtual reality training. Results indicated that students had a positive user experience from the VR experience. Performance data from agricultural education students resulted in poor scores during the precheck and driving course. Finally, two groups of students comparing traditional training versus training using the VR experience resulted in a non-significant difference between the pass/fail rates. The implications of these findings suggest VR can provide a supplemental training method for tractor and machinery programs. It is recommended that this study be replicated with a larger sample of students as well as the evaluation of other VR-based educational experiences.
Downloads
References
American Association for Agricultural Education (AAAE). (2023). AAAE research values.
Aggarwal, R., Black, S. A., Hance, J. R., Darzi, A., & Cheshire, N. W. (2006). Virtual reality simulation training can improve inexperienced surgeons’ endovascular skills. European Journal of Vascular Endovascular Surgery, 588–593. http://dx.doi.org/10.1016/j.ejvs.2006.11.009
Brooke, J. (1996). SUS-A quick and dirty usability scale. Usability evaluation in industry, 189(194), 4–7. http://www.tbistafftraining.info/smartphones/documents/b5_during_the_trial_usability_scale_v1_09aug11.pdf
Buchanan, J. A. (2004). Experience with virtual reality‐based technology in teaching restorative dental procedures. Journal of Dental Education, 68(12), 1258–1265. http://dx.doi.org/10.1002/j.0022-0337.2004.68.12.tb03875.x
DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications. Sage Publications.
Dirin, A. (2020). User experience of mobile virtual reality: experiment on changes in students' attitudes. Turkish Online Journal of Educational Technology TOJET, 19(3), 80–93. https://eric.ed.gov/?id=EJ1261316
Domingo, J. R., & Bradley, E. G. (2018). Education Students Perceptions of Virtual Reality as a Learning Tool. Journal of Educational Technology, 329–342. http://dx.doi.org/10.1177/0047239517736873
Donham, K. J., & Thelin, A. (2016). Agricultural medicine: Rural occupational and environmental health, safety, and prevention. John Wiley & Sons.
Hassenzahl, M., Burmester, M., & Koller, F. (2003). AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In Mensch & computer 2003 (pp. 187–196). Vieweg + Teubner Verlag. http://dx.doi.org/10.1007/978-3-322-80058-9_19
Heibel, B., Anderson, R., Swafford, M., & Borges, B. (2024). Integrating virtual reality technology into beginning welder training sequences. Journal of Agricultural Education, 65(1), 210–225. https://doi.org/10.5032/jae.v65i1.2468
Heutte, J., & Fenouillet, F. (2010). Propositions pour une mesure de l’expérience optimale (état de Flow) en contexte éducatif. Actes du 26e congrès international d’actualité de la recherche en éducation et en formation (AREF) 2010. http://jean.heutte.free.fr/IMG/pdf/Heutte-Fenouillet-AREF-2010.pdf
Jepsen, S. D. (2011). National Perceptions and Management Styles of Extension Educators and Secondary Agricultural Education Instructors on the U.S. Department of Labor’s Tractor Certification Program. Journal of National Association of County Agricultural Agents, 4(2), 1–6. https://www.nacaa.com/journal/027f2292-cbc2-45a1-b209-e6a249382d03
Johnson, L., Levine, A., Smith, R., & Stone, S. (2010). Simple Augmented Reality. The 2010 Horizon Report, 21–24. https://eric.ed.gov/?id=ED510220
Kennedy, R. S., Lane, N. E., Berbaum, K. S., & Lilienthal, M. G. (1993). Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology, 3(3), 203–220. http://dx.doi.org/10.1207/s15327108ijap0303_3
Lamb, R., & Etopio, E. (2019, March). Preservice science teacher preparation using virtual reality. In Society for Information Technology & Teacher Education International Conference (pp. 162–167). Association for the Advancement of Computing in Education (AACE). https://www.learntechlib.org/p/208478/
Lee, E. A. L., Wong, K. W., & Fung, C. C. (2010). How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach. Computers & Education, 55(4), 1424–1442. https://doi.org/10.1016/j.compedu.2010.06.006
Liarokapis, F., Mourkoussis, N., White , M., Darcy, J., Sifniotis, M., & Petridis, P. (2004). Web3D and Augmented Reality to Support Engineering Education. World Transactions on Engineering and Technology Education. https://www.researchgate.net/publication/38174320_Web3D_and_augmented_reality_to_support_engineering_education
Liou, W. K., & Chang, C. Y. (2018, February). Virtual reality classroom applied to science education. In 2018 23rd International Scientific-Professional Conference on Information Technology (IT) (pp. 1–4). IEEE. https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8350861
Lundmark, T. (2023). Exploring User Experience and Risks of VR in Museum Exhibits: A Case Study of 1238: The Battle of Iceland. https://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1775504&dswid=-8036
May, J. J., & Scofield, S. (2005). “Safety for Agricultural Educators” Evaluation of an Intervention to Enhance Awareness of Agricultural Hazards. Journal of Agromedicine, 10(4), 65–70. DOI: 10.1300/J096v10n04_09
McGill, T. J., & Klobas, J. E. (2009). A task–technology fit view of learning management system impact. Computers & Education, 52(2), 496–508. https://doi.org/10.1016/j.compedu.2008.10.002
McGovern, E., Moreira, G., & Luna-Nevarez, C. (2020). An application of virtual reality in education: Can this technology enhance the quality of students’ learning experience?. Journal of Education for Business, 95(7), 490–496. http://dx.doi.org/10.1080/08832323.2019.1703096
Murphy, D. (2020, August 10). National Safe Tractor and Machinery Operation Program. https://extension.psu.edu/national-safe-tractor-and-machinery-operation-program
Nakayama, G. J. (2014). Virtual reality game for safety education. 2014 International Conference on Audio, Language, and Image Processing, (pp. 95–100). Shanghai. DOI 10.1109/ICALIP.2014.7009764
National Children’s Center for Rural and Agricultural Health and Safety. (2019). Marshfield Clinic Research Institute. Retrieved from National Children's Center for Rural and Agricultural Health and Safety: https://marshfieldresearch.org/nccrahs
National Children’s Center for Rural and Agricultural Health and Safety. (2020). Marshfield Clinic Research Institute. Retrieved from National Children's Center for Rural and Agricultural Health and Safety: https://marshfieldresearch.org/nccrahs
Pallot, M., Eynard, R., Poussard, B., Christmann, O., & Richir, S. (2013, March). Augmented sport: exploring collective user experience. In Proceedings of the Virtual Reality International Conference: Laval Virtual (pp. 1–8). http://dx.doi.org/10.1145/2466816.246682
Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011). Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36–48. http://dx.doi.org/10.1016/j.cedpsych.2010.10.002
Pulley, J., Jepsen, D., Bowling, A., & Kitchel, T. (2024). School-based agricultural education teachers’ lived experience of integrating virtual reality into their classroom . Journal of Agricultural Education, 65(1), 151–175. https://doi.org/10.5032/jae.v65i1.165
Rudolphi, J., & Retallick, M. S. (2015). Agricultural safety and health education: practices, attitudes, and needs of Iowa agricultural educators. North American Colleges and Teachers of Agriculture Journal, 174–179. https://www.jstor.org/stable/pdf/nactajournal.59.3.174.pdf
Sacks, R., Perlman, A., & Barak, R. (2013). Construction Safety Training Using Immersive Virtual Reality. Construction Management and Economics, 1005–1017. http://dx.doi.org/10.1080/01446193.2013.828844
Stone, R. T., McLaurin, E., Zhong, P., & Watts, K. (2013). Full virtual reality vs. integrated virtual reality training in welding. Welding Journal, 92(6), 167–174. http://files.aws.org/wj/supplement/WJ_2013_06_s167.pdf
Syed, Z. A., Trabookis, Z., Bertrand, J., Chalil Madathil, K., Hartley, R. S., Frady, K. K., & Gramopadhye, A. K. (2019). Evaluation of virtual reality-based learning materials as a supplement to the undergraduate mechanical engineering laboratory experience. International Journal of Engineering Education, 35(3). https://par.nsf.gov/biblio/10096489
Tcha-Tokey, K., Christmann, O., Loup-Escande, E., & Richir, S. (2016). Proposition and validation of a questionnaire to measure the user experience in immersive virtual environments. International Journal of Virtual Reality, 16(1), 33–48. http://dx.doi.org/10.20870/IJVR.2016.16.1.2880
Tcha-Tokey, K., Loup-Escande, E., Christmann, O., & Richir, S. (2017, September). Effects on user experience in an edutainment virtual environment: comparison between CAVE and HMD. In Proceedings of the European Conference on Cognitive Ergonomics 2017 (pp. 1–8). http://dx.doi.org/10.1145/3121283.3121284
Tichon, J., & Burgess-Limerick, R. (2009). A review of virtual reality as a medium for safety related training in the minerals industry. https://eprints.qut.edu.au/123479/
U.S. Department of Labor, Bureau of Labor Statistics. (2020). Census of Fatal Occupational Injuries. https://www.bls.gov/iif/oshwc/cfoi/cftb0331.htm
U.S. Department of Labor Wage and Hour Division. (2016). Child Labor Bulletin 102: Child Labor Requirements in Agricultural Occupations Under the Fair Labor Standards Act. https://www.dol.gov/sites/dolgov/files/WHD/legacy/files/childlabor102.pdf
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 425–478. http://dx.doi.org/10.2307/30036540
Vincent, S. K., Mazur, J. M., Summey, T. E., & Bryd, A. P. (2019). An Evaluation of Behavioral Intent in Appalachian Youth Participating in a CROPS Curriculum. Journal of Agricultural Safety and Health, 25(1), 25–36. http://dx.doi.org/10.13031/jash.12810
Virtual Reality Society. (2017). What is virtual reality? Retrieved from https://www.vrs.org.uk/virtual-reality/what-is-virtual-reality.html
Wells, T., & Miller, G. (2020). The Effect of Virtual Reality Technology on Welding Skill Performance. Journal of Agricultural Education, 61(1), 152–171. https://doi.org/10.5032/jae.2020.01152
Whipp, A. R. (2018). Youth Farm Safety: Identification of Common Tasks and Availability of Safety and Health Teaching Resources [Master's thesis, Ohio State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=osu152414759731944
Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments. 7(3), 225–240. https://doi.org/10.1162/105474698565686
Yang, G., Chen, Y. T., Zheng, X. L., & Hwang, G. J. (2021). From experiencing to expressing: A virtual reality approach to facilitating pupils’ descriptive paper writing performance and learning behavior engagement. British Journal of Educational Technology, 52(2), 807–823. http://dx.doi.org/10.1111/bjet.13056
Yu, Q., Che, X., Ma, S., Pan, S., Yang, Y., Xing, W., & Wang, X. (2018). A hybrid user experience evaluation method for mobile games. IEEE Access, 6, 49067–49079. DOI: 10.1109/ACCESS.2018.2859440
Yusof, N., Hashim, N. L., & Hussain, A. (2022). A conceptual user experience evaluation model on online systems. International Journal of Advanced Computer Science and Applications, 13(1). Chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://thesai.org/Downloads/Volume13No1/Paper_53-A_Conceptual_User_Experience_Evaluation_Model.pdf
Downloads
Published
How to Cite
Issue
Section
