AI Educational Mobile App using Deep Learning Approach
DOI: http://dx.doi.org/10.30630/joiv.7.3.1247
Abstract
Moving to Industrial Revolution (IR 4.0), the early education sector is not left behind. More of the teaching method is being digitized into a mobile application to assist and enhance the children’s understanding. On the other hand, most of the applications offer passive learning, in which the children complete the activity without interacting with the environment. This study presents an educational mobile application that uses a deep learning approach for interactive learning to enhance English and Arabic vocabulary. Android Studio software and Tensorflow tool were used for this application development. The convolution neural network (CNN) approach was used to classify the item of each category of vocab through image recognition. More than thousands of images each time were pre-trained for image classification. The application will pronounce the requested item. Then, the children will need to move around looking for the item. Once the item’s found, the children must capture the image through the camera’s phone for image detection. This approach can be integrated with teaching and learning techniques for fun learning through interactive smartphone applications. This study attained high accuracy of more than 90% for image classification. In addition, it helps to attract the children's interest during the teaching using the current technology but with the concept of ‘Play’ and ‘Learn’. In the future, this paper recommended the involvement of IoT platforms to provide widen applications.
Keywords
Full Text:
PDFReferences
D. K. Dickinson, T. R. Flushman and J. B. Freiberg, Vocabulary, Reading and Classroom Supports for Language In B. Richards, M. H. Daller, D. D. Malvern, P. Meara, J. Milton and J. Treffers-Daller, Vocabulary Studies in First and Second Language Acquisition, eds, Palgrave Macmillan, London, 2009.
K. Mehmet, â€Vocabulary Knowledge as a Predictor of Performance in Writing and Speaking: A Case of Turkish EFL Learnersâ€, PASAA, vol. 57, pp. 133-164, 2019.
N. Yang, J. Shi, J. Lu and Y. Huang, “Language Development in Early Childhood: Quality of Teacher-Child Interaction and Children’s Receptive Vocabulaty Competencyâ€, Frontiers in Psycology, vol. 26, pp. 649680, 2021.
A. Langeloo, M. M. Lara, M. I. Deunk, N. F. Klitzing and J. -W. Strijbos, “A Systematic Review of Teacher-Child Interactions with Multilingual Young Childrenâ€, Review of Educational Research, vol. 89, no. 4, pp. 536-568, 2019.
S. J. Papadakis and M. Kalogiannakis, “Mobile educational application for children. What educators and parents need to knowâ€, International Journal of Mobile Learning and Organisation, vol. 11, no. 3, pp. 256-277, 2017.
Y. Song, and Q. Ma, “Affordance of a mobile learner-generated tool for pupil’s English as a second language vocabulary learning: An ecological perspectiveâ€, vol. 52, no. 2, pp. 858-878, 2020.
M. Mpine and P. S. Thulile, “Developing a Mobile App for Learning English in an Open Distance Learning Contextâ€, International Review of Research in Open and Distributed Learning, vol. 19, no. 4, pp. 208-221, 2018.
A. S. Rami, A. S. Talha and Y. Maha, “Smartphones as a Tool for Expediting English Vocabulary Learning: Teachers; Perceptions of Benefits and Drawbacksâ€, International Journal of Linguistics, Literature and Translation, vol. 4, no. 4, pp. 123-132, 2021.
L. Harger, “The Impact of the Use of Mobile Computing of Vocabulary Learning in the Language Classroomâ€, Master thesis, University of Northern Iowa, 2020.
X. Ma and B. Yodkamlue, “The Effects of Using a Self-Developed Mobile App on Vocabulary Learning and Retention among EFL Learnersâ€, PASAA, vol. 56, pp. 166-205, 2019.
K. Demir, and E. Akpinar, “The effect of mobile learning applications of students’ academic achievement and attitudes toward mobile learningâ€, Malaysian Online Journal of Educational Technology, vol. 6, no. 2, pp. 48-59, 2018.
F. H. Zawaideh, “The Effect of Mobile Learning on the Development of the Students’ Learning Behaviors and Performances at Jordanian Universityâ€, International Journal of Business and Management Invention, vol. 6, no. 3, pp. 01-07, 2017.
Q. Wu, “Learning ESL Vocabulary with Smartphonesâ€, Procedia – Social and Behavioral Sciences, vol. 143, pp. 302-307, 2014.
A. –T. Dena, O. Achraf and M. Al-Dana, “A Learn App: Mobile Augmented Reality Vocabulary Learning Applicationâ€, Nafath, vol. 18, pp. 28-31, 2021.
G. M. Santi, A. Ceruti, A. Liverani and F. Osti, “Augmented Reality in Industry 4.0 and Future Innovation Programsâ€, Technologies, vol. 9, no. 2, pp. 33-50.
N. M. A. Brahin, H. M. Nasir, A. Z. Jidin, M. F. Zulkifli and T. Sutikno, “Development of Vocabulary Learning Application by Using Machine Learning Techniquesâ€, Bulletin of Electrical Engineering and Informatics. Vol. 9, no. 1, pp. 362-369, 2020.
M. N. I. O. Islam, M. R. Kabir, M. A. M. S. Hossain and M. M. Islam, “Learn2Write: Augmented Reality and Machine Learning Based Mobile App to Learn Writingâ€, Computers; Basel, vol. 11, no. 1, pp. 1-4, 2022.
G. Veeramani, “Machine Learning in Mobile Applicationsâ€, International Journal of Computer Science and Mobile Computing, vol. 11, no. 2, pp. 110-118, 2022.
M. Xu, J. Liu, Y. Liu, F. X. Lon, Y. Liu and X. Liu, “A First Look at Deep Learning Apps on Smartphonesâ€, in Proceedings of the 2019 World Wide Web Conference (WWW ’19), San Francisco, CA, USA, May 2019, p. 2125-2136.
Y. Wang, J. Wang, W. Zhang, Y. Zhan, S. Guo, Q. Zheng and X. Wang, “A Survey on Deploying Mobile Deep Learning Applications: A Systemic and Technical Perspectiveâ€, Digital Communications and Networks, vol. 8, no. 1, pp. 1-17, 2022.
SAS Insight, “Machine Learning What it is and why it mattersâ€, 2022. [Online]. Available: https://www.sas.com/en_us/insights/analytics/ machine-learning.html
Y. Wang, J. Wang, W. Zhang, Y. Zhan, S. Guo, Q. Zheng, and X. Wang, “A survey on deploying mobile deep learning applications: A systemic and technical perspectiveâ€, Digital Communications and Networks, vol. 8. No. 1, pp. 1-17, 2022.
H. Steck, L. Baltrunas, E. Elahi, D. Liang, Y. Raimond, and J. Basilico, “Deep Learning for Recommender Systems: A Netflix Case Studyâ€, AI Magazines, vol. 42, no. 3. Pp. 7-18, 2021.
V. M. Putri and D. Eliza, “The Impact of Negative Gadgets on Children’s Language Development during the Covid-19 Pandemicâ€, International Journal of Emerging Issues in Early Childhood Educations (IJEIECE), vol. 3 no. 1, pp. 1-7, 2021.
H. F. El-Sofany, S. A. El-Seoud, H. M. Alwadani and A. E. Alwadani, “Development of Mobile Educational Services Application to Improve Educational Outcomes using Android Technologyâ€, International Journal of Interactive Mobile Technologies (iJIM), vol. 8, no. 2, pp. 4-9, 2014.
C. J. Ejiyi, J. Deng, T. U. Ejiyi, A. A. Salako, M. B. Ejiyi and C. G. Anomihe, “Design and Development of Android Application for Educational Institutesâ€, Journal of Physics: Conference Series, vol. 1769, pp. 102066, 2021.
M. Xin, Y. Wang, “Research on Image Classification Model Based on Deep Convolution Neural Networkâ€, Journal on Image and Video Processing, vol. 40, pp. 1-11, 2019.
H. P. Van and J. R. Eun, “A High-Accuracy Model Average Ensemble of Convolution Neural Network for Classification of Cloud Image Patches on Small Datasetsâ€, Applied Sciences, vol. 9, no. 21, pp. 4500, 2019.
R. Yamashita, M. Nishio, R. K. G. Do, and K. Togashi, “Convolutional neural networks: an overview and application in radiologyâ€, Insights into Imaging, vol. 9, pp. 611-629, 2018. [
X. Ying, “An Overview of Overfitting and its Solutionsâ€, Journal of Physics: Conf. Series, vol. 1168, no.2, pp. 1-6, 2019.