Systematic Literature Review on Augmented Reality with Persuasive System Design: Application and Design in Education and Learning

Mohd Asrul Nasirudin - Universiti Tun Hussein Onn, Johor, 86400, Malaysia
Mohd Farhan Md Fudzee - Universiti Tun Hussein Onn, Johor, 86400, Malaysia
Norhalina Senan - Universiti Tun Hussein Onn, Johor, 86400, Malaysia
Che Samihah Che Dalim - Universiti Tun Hussein Onn, Johor, 86400, Malaysia
Deden Witarsyah - Telkom University, Bandung, Indonesia
Aldo Erianda - Politeknik Negeri Padang, Padang, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.62527/joiv.8.2.2702

Abstract


Augmented Reality (AR) is an innovative technology that has gained significant scholarly attention. It uses computer-generated sensory inputs like visuals, sounds, and touch to enhance how we perceive the real world, providing a transformative impact on human sensory experiences. Motivated by the possibilities of augmented reality (AR) in the realm of the educational learning environment, this research aims to document the evolving landscape of augmented reality (AR) applications in education and training, with a specific emphasis on the incorporation of persuasive system design (PSD) elements. The study also explores the diverse technologies and methodologies for developing these applications. A systematic literature review was conducted, analyzing 44 articles following the protocol for PRISMA assessments. Four research questions were formulated to investigate trends in AR applications. Between 2016 and 2023, publications on AR applications doubled, with a significant focus on the educational field. Marker-based AR methods dominated (68.49%), while markerless methods constituted 31.51%. Unity and Vuforia were the most used platforms, accounting for 77.27% of applications. Most research papers assessed application effectiveness subjectively through custom-made questionnaires. University students were identified as the primary target users of AR applications. Only a few applications integrated persuasive elements, even for adult users. This highlights the need for further studies to fully grasp the possibilities of combining persuasive system design with augmented reality applications in education

Keywords


Augmented reality; AR; education; persuasive system design; PSD.

References


Rauschnabel, PA. Virtually enhancing the real world with holograms: An exploration of expected gratifications of using augmented reality smart glasses. Psychol Mark. 2018; 35: 557–572. https://doi.org/10.1002/mar.21106

Javornik, A. (2016). ‘It's an illusion, but it looks real!’ Consumer affective, cognitive and behavioural responses to augmented reality applications. Journal of Marketing Management, 32(9–10), 987–1011.

Boas, Y. A. G. V. "Overview of virtual reality technologies." Interactive Multimedia Conference. Vol. 2013. sn, 2013.

Oppermann, Leif and Prinz, Wolfgang. "Introduction to this Special Issue on Smart Glasses" i-com, vol. 15, no. 2, 2016, pp. 123-132. https://doi.org/10.1515/icom-2016-0028

Gabriel Evans, Jack Miller, Mariangely Iglesias Pena, Anastacia MacAllister, and Eliot Winer "Evaluating the Microsoft HoloLens through an augmented reality assembly application", Proc. SPIE 10197, Degraded Environments: Sensing, Processing, and Display 2017, 101970V (5 May 2017); https://doi.org/10.1117/12.2262626

Cīrulis, Arnis, Kristaps Brigmanis-Briģis, and Gatis Zvejnieks. "Analysis of suitable natural feature computer vision algorithms for augmented reality services." Baltic Journal of Modern Computing 8.1 (2020): 174-181.

Chong, T. J., et al. "Sensor technologies and simultaneous localization and mapping (SLAM)." Procedia Computer Science 76 (2015): 174-179.

Pan, Weihua, and Shuyue Luo. "Overview of Augmented Reality Technology.

Chang, Hsin-Yi, et al. "Ten years of augmented reality in education: A meta-analysis of (quasi-) experimental studies to investigate the impact." Computers & Education 191 (2022): 104641.

Velazco‐Garcia, Jose D., et al. "Evaluation of how users interface with holographic augmented reality surgical scenes: interactive planning MR‐Guided prostate biopsies." The International Journal of Medical Robotics and Computer Assisted Surgery 17.5 (2021): e2290.

Parekh, P., Patel, S., Patel, N. et al. Systematic review and meta-analysis of augmented reality in medicine, retail, and games. Vis. Comput. Ind. Biomed. Art 3, 21 (2020). https://doi.org/10.1186/s42492-020-00057-7

Moher, D., Liberati, A., Tetzlaff, J. and Altman, D.G. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine 151 (4) (2009) 264-269.

Wiafe, I. and Nakata, K., 2012. Trends in persuasive systems design: Techniques, methods and application domain. International Journal of Societal Applications of Computer Science, 2, pp.84-92.

Wang, Y., Fadhil, A., Lange, J.P. and Reiterer, H., 2017. Towards a holistic approach to designing theory-based mobile health interventions. arXiv preprint arXiv:1712.02548.

Benner, D., Schöbel, S.M., Janson, A. and Leimeister, J.M., 2022. How to achieve ethical persuasive design: A review and theoretical propositions for information systems. AIS Transactions on Human-Computer Interaction, 14(4), pp.548-577.

Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J. and Shneiderman, B., 2004. Determining causes and severity of end-user frustration. International journal of human-computer interaction, 17(3), pp.333-356.

Marcucci, Daniela. "Louis Cohen, Lawrence Manion, & Keith Morrison (2011). Research methods in education . New York: Routledge." Journal of Educational, Cultural and Psychological Studies (ECPS Journal) 2.4 (2011): 201-206.

Suzuki, R., Kazi, R.H., Wei, L.Y., DiVerdi, S., Li, W. and Leithinger, D., 2020, October. Realitysketch: Embedding responsive graphics and visualizations in AR through dynamic sketching. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (pp. 166-181).

Ashour, Z., Shaghaghian, Z. and Yan, W., 2023, March. An Augmented Reality Application and User Study for Understanding and Learning Architectural Representations. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 797-798). IEEE.

Arjun, P.R. and Srivastava, A., 2020, November. EDUCO: An Augmented Reality Application to Enrich Learning Experience of Students for History and Civics Subjects. In Companion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces (pp. 81-84).

Hu, X., Goh, Y.M. and Lin, A., 2021. Educational impact of an Augmented Reality (AR) application for teaching structural systems to non-engineering students. Advanced Engineering Informatics, 50, p.101436.

Gupta, N. ., Bansal, A. ., Khan, I. R. . and Vani, N. S. . (2023) “Utilization of Augmented Reality for Human Organ Analysis”, International Journal on Recent and Innovation Trends in Computing and Communication, 11(8s), pp. 438–444. doi: 10.17762/ijritcc.v11i8s.7224.

Abdullah, N.A.S. and Rokmain, N.S.S., 2023, July. Learning Human Anatomy Using Augmented Reality Mobile Application. In 2023 International Conference on Digital Applications, Transformation & Economy (ICDATE) (pp. 1-5). IEEE.

Hemme, C.L., Carley, R., Norton, A., Ghumman, M., Nguyen, H., Ivone, R., Menon, J.U., Shen, J., Bertin, M., King, R. and Leibovitz, E., 2023. Develo** virtual and augmented reality applications for science, technology, engineering and math education. BioTechniques, (0).

S. Cai, Y. Zhou, J. Shen, J. Guo, X. Xiong and X. Jiang, "Augmented Reality Based Surgical Training and Education System for Neurosurgery," 2022 International Conference on Advanced Robotics and Mechatronics (ICARM), Guilin, China, 2022, pp. 678-681, doi: 10.1109/ICARM54641.2022.9959349.

Villanueva, A., Zhu, Z., Liu, Z., Wang, F., Chidambaram, S. and Ramani, K., 2022. Colabar: A toolkit for remote collaboration in tangible augmented reality laboratories. Proceedings of the ACM on Human-Computer Interaction, 6(CSCW1), pp.1-22.

Martin-Gomez, A., Hill, C., Lin, H.Y., Fotouhi, J., Han-Oh, S., Wang, K.H., Navab, N. and Narang, A.K., 2021. Towards exploring the benefits of augmented reality for patient support during radiation oncology interventions. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 9(3), pp.322-329.

Dind, C. and Schnürer, R., 2020. Augmenting Printed School Atlases with Thematic 3D Maps.

Hertel, J., Gabel, J., Kruse, L., Wollborn, M. and Steinicke, F., 2022, October. Co-Design of an Augmented Reality Maintenance Tool for Gas Pressure Regulation Stations. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 720-724). IEEE.

Ishihara, M. and Rattanachinalai, P., 2022. Learning basic concept of computer programming with path-finding task in ar and its properties. Education and Information Technologies, pp.1-24.

Im, H. and Rogers, C., 2021, June. Draw2Code: Low-Cost Tangible Programming for Creating AR Animations. In Interaction Design and Children (pp. 427-432).

Song, E., Suaib, N.M., Sihes, A.J., Alwee, R. and Yunos, Z.M., 2020, November. Design and development of learning mathematics game for primary school using handheld augmented reality. In IOP Conference Series: Materials Science and Engineering (Vol. 979, No. 1, p. 012014). IOP Publishing.

Syahidi, A.A. and Mohamed, A., 2020, October. Mobile Augmented Reality Application with Multi-Interaction for Learning Solutions on the Topic of Computer Network Devices (Effectiveness, Interface, and Experience Design). In 2020 Third International Conference on Vocational Education and Electrical Engineering (ICVEE) (pp. 1-6). IEEE.

Nguyen, P., Ha, H.D., Vu, T.H., Nguyen, Q.H., Truong, H.P. and Le, H.S., 2021, November. Applying VR/AR Technology in Product Advertising to Improve User Experience. In 2021 15th International Conference on Advanced Computing and Applications (ACOMP) (pp. 201-205). IEEE.

Sholikhah, B.U. and Cahyono, A.N., 2021, June. Augmented reality student worksheets for learning mathematics during the COVID-19 pandemic. In Journal of Physics: Conference Series (Vol. 1918, No. 4, p. 042063). IOP Publishing.

Ariffin, N.H.M., Mazlin, I., Zakaria, M.Z., Yusoff, F.H. and Nasrudin, Z.A., 2022. Edutourism Augmented Reality Mobile Application for Forest Conservation. In Proceedings of International Conference on Research in Education and Science (p. 207).

Kumar, A., Mantri, A. and Dutta, R., 2021. Development of an augmented reality‐based scaffold to improve the learning experience of engineering students in embedded system course. Computer Applications in Engineering Education, 29(1), pp.244-257.

Reisinho, P., Silva, C., Vairinhos, M., Oliveira, A.P. and Zagalo, N., 2021, August. Tangible Interfaces and Augmented Reality in a Nutrition Serious Game for Kids. In 2021 IEEE 9th International Conference on Serious Games and Applications for Health (SeGAH) (pp. 1-8). IEEE.

Nabila, N.I. and Junaini, S.N., 2021. A mobile augmented reality mathematics card game for learning prism. International Journal of Computing and Digital System.

Sundari, A.A., Bhatt, D. and Bhagya, R., 2022, December. Development of 3D Building Model Using Augmented Reality. In 2022 6th International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS) (pp. 1-4). IEEE.

Chiam, B.S.W., Leung, I.M.W., Devilly, O.Z., Da Ow, C.Y., Guan, F.Y. and Tan, B.L., 2021, October. Novel augmented reality enhanced solution towards vocational training for people with mental disabilities. In 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 195-200). IEEE.

Oberdörfer, S., Elsässer, A., Schraudt, D., Grafe, S. and Latoschik, M.E., 2020. Horst-The teaching frog: learning the anatomy of a frog using tangible AR. In Proceedings of Mensch und Computer 2020 (pp. 303-307).

Huang, H.M., Huang, T.C. and Cheng, C.Y., 2022. Reality matters? exploring a tangible user interface for augmented-reality-based fire education. Universal Access in the Information Society, 21(4), pp.927-939.

Velaora, M., van Roy, R. and Guéna, F., 2020, July. ARtect, an augmented reality educational prototype for architectural design. In 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4) (pp. 110-115). IEEE.

Avila-Pesantez, D., Rivera, L.A., Vaca-Cardenas, L., Aguayo, S. and Zuñiga, L., 2018, April. Towards the improvement of ADHD children through augmented reality serious games: Preliminary results. In 2018 IEEE Global Engineering Education Conference (EDUCON) (pp. 843-848). IEEE.

Thongchum, K. and Charoenpit, S., 2018, May. A conceptual design of Kanji mobile application with augmented reality technology for beginner. In 2018 5th International Conference on Business and Industrial Research (ICBIR) (pp. 149-154). IEEE.

Tang, J.K., Duong, T.Y.A., Ng, Y.W. and Luk, H.K., 2015, December. Learning to create 3D models via an augmented reality smartphone interface. In 2015 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE) (pp. 236-241). IEEE.

Deng, X., Wang, D., **, Q. and Sun, F., 2019, June. Arcat: A tangible programming tool for dfs algorithm teaching. In Proceedings of the 18th ACM International Conference on Interaction Design and Children (pp. 533-537).

Rodríguez-Vizzuett, L., Guerrero-García, J., Olmos-Pineda, I. and Lozano, M.D., 2019, October. Model-driven development of an augmented reality-based application for English language teaching to children between 9 and 12 years old. In 2019 international conference on inclusive technologies and education (CONTIE) (pp. 1-17). IEEE.

Pittman, C. and LaViola, J.J., 2019, March. Determining design requirements for ar physics education applications. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (pp. 1126-1127). IEEE.

Daineko, Y., Ipalakova, M., Tsoy, D., Shaipiten, A., Bolatov, Z. and Chinibayeva, T., 2018. Development of practical tasks in physics with elements of augmented reality for secondary educational institutions. In Augmented Reality, Virtual Reality, and Computer Graphics: 5th International Conference, AVR 2018, Otranto, Italy, June 24–27, 2018, Proceedings, Part I 5 (pp. 404-412). Springer International Publishing.

Dube, T.J. and İnce, G., 2019. A novel interface for generating choreography based on augmented reality. International Journal of Human-Computer Studies, 132, pp.12-24.

Karambakhsh, A., Kamel, A., Sheng, B., Li, P., Yang, P. and Feng, D.D., 2019. Deep gesture interaction for augmented anatomy learning. International Journal of Information Management, 45, pp.328-336.

Černý, F., Triantafyllidis, G. and Palamas, G., 2019. A Tangible Constructivist AR Learning Method for Children with Mild to Moderate Intellectual Disability. In Interactivity, Game Creation, Design, Learning, and Innovation: 7th EAI International Conference, ArtsIT 2018, and 3rd EAI International Conference, DLI 2018, ICTCC 2018, Braga, Portugal, October 24–26, 2018, Proceedings 7 (pp. 514-519). Springer International Publishing.

Murrell, S., Wang, F., Aldrich, E. and Xu, X., 2020, March. MeteorologyAR: A Mobile AR App to Increase Student Engagement and Promote Active Learning in a Large Lecture Class. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 848-849). IEEE.

El Kouzi, M., Mao, A. and Zambrano, D., 2019, March. An educational augmented reality application for elementary school students focusing on the human skeletal system. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (pp. 1594-1599). IEEE.

Rongting, Z., Yiran, S., Tongliang, H. and Asmi, F., 2016, November. Applying Augmented Reality Technology to E-Learning: Science Educational AR Products as an Example. In 2016 IEEE 13th International Conference on e-Business Engineering (ICEBE) (pp. 129-133). IEEE.

Cook, M., Ackley, A., Gonzalez, K.C., Payne, A., Seo, J.H., Kicklighter, C., Pine, M. and McLaughlin, T., 2019. InNervate immersion: case study of dynamic simulations in AR/VR environments for learning muscular innervation. In ACM SIGGRAPH 2019 Posters (pp. 1-2).

Schiavi, B., Gechter, F., Gechter, C. and Rizzo, A., 2018, March. Teach me a story: an augmented reality application for teaching history in middle school. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (pp. 679-680). IEEE.

Jacob, S., Warde, M. and Dumane, P., 2020, February. Impact of augmented reality as an ICT tool to deliver engineering education content. In 2020 International Conference on Convergence to Digital World-Quo Vadis (ICCDW) (pp. 1-5). IEEE.

Protopsaltis, A., Mentzelopoulos, M., Ferguson, J. and Kaloyan, K., 2016, October. Quiz Cube: An AR mobile learning application. In 2016 11th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP) (pp. 151-155). IEEE.

Keat, O.Y.B., Wahid, N., Murli, N. and Hamid, R.A., 2018. Augmented reality to induce enjoyment in edutainment mobile game. JOIV: International Journal on Informatics Visualization, 2(3-2), pp.188-193.

Muryanti, E., Pransiska, R., Ummayah, Y.A. and Azman, M.N.A., 2023. Teachers’ Acceptance and Readiness to Use Augmented Reality Book to Teach English Vocabulary in Kindergartens. JOIV: International Journal on Informatics Visualization, 7(4), pp.2351-2357.

Zamakhsyari, F. and Fatwanto, A., 2023. A Systematic Literature Review of Design Thinking Approach for User Interface Design. JOIV: International Journal on Informatics Visualization, 7(4), pp.2313-2320.

Zhang, C., 2020. The why, what, and how of immersive experience. Ieee Access, 8, pp.90878-90888.

Agushinta, R.D., Medyawati, H. and Jatnika, I., 2017, August. A method of cloud and image-based tracking for Indonesia fruit recognition. In 2017 IEEE 3rd International Conference on Engineering Technologies and Social Sciences (ICETSS) (pp. 1-5). IEEE.