Web and Android-based Test Application Development and its Implementation on Final Semester Examination

- Ambiyar - Universitas Negeri Padang, Prof Dr Hamka Street, Padang, 25131, Indonesia
- Panyahuti - Universitas Ibnu Sina, Batam, 29444, Indonesia
Army Devega - Universitas Ibnu Sina, Batam, 29444, Indonesia
Syaiful Islami - Universitas Negeri Padang, Prof Dr Hamka Street, Padang, 25131, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.62527/joiv.8.2.2120

Abstract


This research aims to revolutionize the examination process in vocational schools by developing the FlyExam application, an Android-based test platform derived from improvements to the TCExam interface. The core goal was to create a powerful, easy-to-use, and effective tool for semester assessment. Following a Research and Development (R&D) approach, this research uses a 4D model: Define, Design, Develop, and Disseminate. Validation procedures require expert evaluation of the technical aspects and usability of the application. At the same time, practicality is assessed through engagement with students and teachers, and effectiveness is measured by student performance. Expert reviews and user feedback confirm the validity and practicality of the application. During implementation, the LAN network topology proved to be a conducive environment for conducting semester exams, increasing the efficiency and reliability of the testing process. The integration of TCExam and FlyExam on mobile devices shows the potential of transitioning from traditional paper-based exams to digital platforms, offering greater flexibility and accessibility. Future research efforts could explore FlyExam's scalability and adaptability in various educational contexts and its long-term impact on assessment practices and academic outcomes. Additionally, ongoing improvements based on user feedback can lead to further improvements and the incorporation of new features, ensuring FlyExam remains relevant and effective in meeting evolving vocational education needs. In summary, the development of FlyExam represents significant progress in the modernization of assessment methodology, with the potential to simplify the process and improve the learning experience in vocational schools.

Keywords


Computer Based Testing (CBT); Computer Based Assessment; Test by Using Phones; Android

Full Text:

PDF

References


Samad and A. L. Setyabudhi, “Application of Video-Based Learning Media with Applications to Improve Learning Activities of Vocational High School Students,” Tech. Vacat. Educ. Int. J., vol. 3, no. 1, pp. 22–27, 2023, [Online]. Available: https://mand-ycmm.org/index.php/taveij/article/view/211/453.

S. J. Choi, J. C. Jeong, and S. N. Kim, “Impact of vocational education and training on adult skills and employment: An applied multilevel analysis,” Int. J. Educ. Dev., vol. 66, no. March, pp. 129–138, 2019, doi: 10.1016/j.ijedudev.2018.09.007.

O. Candra, A. Putra, S. Islami, D. T. P. Yanto, R. Revina, and R. Yolanda, “Work Willingness of VHS Students at Post-Industrial Placement,” TEM J., vol. 12, no. 1, pp. 265–274, 2023, doi: 10.18421/TEM121-33.

Ambiyar, S. Yondri, D. Irfan, M. U. Putri, M. A. Zaus, and S. Islami, “Evaluation of packet tracer application effectiveness in Computer Design Networking subject,” Int. J. Adv. Sci. Eng. Inf. Technol., vol. 9, no. 1, 2019, doi: 10.18517/ijaseit.9.1.5931.

S. Suzana et al., “Gadget and the Internet for Early Childhood Distance Learning,” Gadget Internet Early Child. Distance Learn., vol. 17, no. 7, pp. 1–10, 2020, [Online]. Available: https://archives.palarch.nl/index.php/jae/article/view/3518.

S. Islami, M. A. Zaus, and A. A. Zaus, “Development of an Online Project-Based Learning Assessment Instrument for Vocational Education Students,” JKIP J. Kaji. Ilmu Pendidik., vol. 4, no. 2, pp. 291–299, 2024.

F. A. Ghozali, F. Tentama, B. Sudarsono, A. Syamsuddin, B. N. Setyanto, and W. P. Bhakti, “Development of a Conveyor-Based Practice Performance Assessment Tool with Android Control to Improve Vocational High School Students’ Work Readiness,” Elinvo (Electronics, Informatics, Vocat. Educ., vol. 8, no. 1, pp. 38–43, 2023, doi: 10.21831/elinvo.v8i1.57868.

Z. Zafrullah, S. Suyanto, A. Wahyuni, R. T. Ayuni, and F. R. E. Novilanti, “Development of Android-based Learning to Improve Computational Thinking Skills in Junior High School,” J. Cendekia J. Pendidik. Mat., vol. 7, no. 2, pp. 1309–1320, 2023, doi: 10.31004/cendekia.v7i2.2239.

F. Drasgow, “The work ahead: A psychometric infrastructure for computerized adaptive tests,” Comput. tests Build. Found. Futur. Assess., no. c, p. 2016, 2002.

A. Mojarrad, Hamid & Hemmati, Fatemeh & Jafari Gohar, Manuchehr & Sadeghi, “Computer-based Assessment Vs. PaperPencil-based Assessment: An Investigation into the Performance and Attitude of Iranian EFL Learners’ Reading Comprehension,” Int. J. Lang. Learn. Appl. Linguist. World, vol. 4, no. June 2015, pp. 2289–2737, 2014.

D.-H. Kim and H. Huynh, “Comparability of computer and paper-and-pencil versions of algebra and biology assessments,” J. Technol. Learn. Assess., vol. 6, no. 4, pp. 1–31, 2007.

D. Charman and A. Elmes, Computer Based Assessment (Volume 1): A guide to good practice, vol. 1, no. January 1998. 1998.

L. Sly, “Assessment & Evaluation in Higher Education Practice Tests as Formative Assessment Improve Student Performance on Computer ‐ managed Learning Assessments,” vol. 24, no. July 2012, pp. 37–41, 2006.

L. Sly and L. J. Rennie, “Computer managed learning : Its use in formative as well as summative assessment .,” Psychology, 1987.

R. Clariana and P. Wallace, “Paper-based versus computer-based assessment: Key factors associated with the test mode effect,” Br. J. Educ. Technol., vol. 33, no. 5, pp. 593–602, 2002, doi: 10.1111/1467-8535.00294.

D. Pernanda, M. A. Zaus, R. E. Wulansari, and S. Islami, “Effectiveness of instructional media based on interactive cd learning on basic network at vocational high school: improving student cognitive ability,” in International Conferences on Education,Social Sciences and Technology, 2018, pp. 440–444.

S. P. Odusanya and A. Oni, “Civic Education and Pupils’ Civic Dispositions in Ghana and Nigeria: A Comparative Analysis,” J. Educ. Res., vol. 9, no. 1, pp. 13–27, Mar. 2019, doi: 10.3126/jer.v9i1.28790.

U. Maier, N. Wolf, and C. Randler, “Effects of a computer-assisted formative assessment intervention based on multiple-tier diagnostic items and different feedback types,” Comput. Educ., vol. 95, pp. 85–98, 2016, doi: 10.1016/j.compedu.2015.12.002.

H. Akçay, A. Durmaz, C. Tüysüz, and B. Feyzioğlu, “Effects of Computer Based Learning on Students’ Attitudes and Achievements Towards Analytical Chemistry,” Turkish Online J. Educ. Technol., vol. 5, no. 1, pp. 1303–6521, 2006, doi: 10.1111/j.1467-8535.2006.00603.x.

I. Yurdabakan and C. Uzunkavak, “Primary school students’ attitudes towards computer based testing and assessment in Turkey,” Turkish Online J. Distance Educ., vol. 13, no. 3, pp. 177–188, 2012.

M. Jawaid, F. A. Moosa, F. Jaleel, and J. Ashraf, “D-Computer Based Assessment (CBA): Perception of residents at Dow University of Health Sciences.,” Pakistan J. Med. Sci., vol. 30, no. 4, pp. 688–91, 2014, doi: 10.12669/pjms.304.5444.

A. A. Asril, Yustini, R. Dewi, S. Rifka, and R. Vitria, “Fiber to The Home (FTTH) Network Design with Addition of Optical Distribution Point (ODP) Using the Branching Method,” Int. J. Adv. Sci. Comput. Eng., vol. 5, no. 3, pp. 298–304, 2023, doi: 10.62527/ijasce.5.3.183.

A. P. Hutagalung, I. Akhmad, and M. Irfan, “Development of Test and Measurement Tools Standing Stork Test Android Based,” Kinestetik J. Ilm. Pendidik. Jasm., vol. 7, no. 2, pp. 293–304, 2023, doi: 10.33369/jk.v7i2.27333.

H. S. R. A. Weerasinghe, D. C. D. Alwis, R. Ginorajh, and G. D. S. Harischandra, “A Study on Optimizing an Effective Online Platform to Address Plastic Waste Management in Sri Lanka,” Int. J. Adv. Sci. Comput. Eng., vol. 5, no. 1, pp. 54–65, 2023, [Online]. Available: http://ijasce.org/index.php/IJASCE/article/view/126.

F. Sukma, A. K. Febrian, R. Afyeni, and N. Azizah, “Academic Advisory Guidance Application Website-Based,” Int. J. Adv. Sci. Comput. Eng., vol. 4, no. 3, pp. 233–250, 2022.

A. S. Nyamawe and N. Mtonyole, “The Use of Mobile Phones in University Exams Cheating : Proposed Solution,” Int. J. Eng. Trends Technol., vol. 17, no. 1, pp. 14–17, 2014, doi: 10.14445/22315381/IJETT-V17P203.

M. Jamil, R. H. Tariq, and P. A. Shami, “Computer-based vs paper-based examinations: Perceptions of university teachers.,” Turkish Online J. Educ. Technol., vol. 11, no. 4, pp. 371–381, 2012.

A. Sanmorino and F. Karimah, “A Review for the Mechanism of Research Productivity Enhancement in the Higher Education Institution,” Int. J. Eval. Res. Educ., vol. 3, no. 1, pp. 28–39, 2021, doi: 10.11591/ijere.v10i2.21694.

N. H., H. A. Gani, M. P. Pratama, and H. Wijaya, “Development of an Android-based Computer Based Test (CBT) In Middle School,” J. Educ. Technol., vol. 5, no. 2, pp. 272–281, 2021, doi: 10.23887/jet.v5i2.33527.

M. Mohzana, I. Israwaty, C. S. Lumingkewas, A. Tahir, and I. Arief, “The Effectiveness Analysis of Android Based E-Diagnostic Test Development Program to Identify Level of Student’s Misconception,” J. Educ., vol. 6, no. 1, pp. 1363–1368, 2023.

S. Thiagarajan, Instructional development for training teachers of exceptional children: A sourcebook. 1974.

L. R. Aiken, “Content Validity and Reliability of Single,” no. V, pp. 955–959, 1980.

O. Candra et al., “Validity of development on authentic assessment tool of curriculum 2013 based in information technology,” Int. J. Sci. Technol. Res., vol. 8, no. 12, 2019.

S. Messick, “Test validity and the ethics of assessment.,” Am. Psychol., vol. 35, no. 11, p. 1012, 1980.

S. Zaim and L. S. Negara, “Apakah wpa/wpa2 benar-benar aman? dekripsi paket data terenkripsi pada wpa/wpa2,” vol. 2015, no. November, pp. 268–276, 2015.

M. Khadilkar, N. Feamster, M. Sanders, and R. Clark, “Usage-based dhcp lease time optimization,” Proc. 7th ACM SIGCOMM Conf. Internet Meas. - IMC ’07, no. May, p. 71, 2007, doi: 10.1145/1298306.1298315.

K. Tsaktsiras and C. Katsanos, “ESALP 2.0: Educational System to Support Learning of Web Content Accessibility Guidelines by Greek Web Practitioners,” ACM Int. Conf. Proceeding Ser., 2023, doi: 10.1145/3609987.3610000.