Design and Development of Sound and Rhythm Perception Assessment Application for Students with Hearing Impairment

- Damri - Universitas Negeri Padang, Padang, Indonesia
- Safaruddin - Universitas Negeri Padang, Padang, Indonesia
- Marlina - Universitas Negeri Padang, Padang, Indonesia
Jon Efendi - Universitas Negeri Padang, Padang, Indonesia
Elsa Efrina - Universitas Negeri Padang, Padang, Indonesia

Citation Format:



Technology use is becoming increasingly popular in life, including in educational aspects. Some widely used applications in education include metaverse, blended learning, game learning, cloud-based learning, mobile applications, and social media learning. Apps are generally in the form of software applications or programs designed to run on smartphones. In this study, we propose using applications in assessing children with hearing impairments at school. Design and Development of the Sound and Rhythm Perception Assessment Application uses the ADDIE development model of Analysis, Design, Development, Implementation, and Evaluation. The test subjects in this study were validation test subjects consisting of 3 experts to test the feasibility of the application. Data was collected through a questionnaire in the form of a tool tested for validity and reliability with a score of 90.1% for learning design, 88.9% for layout, and 94.7% for software. Validation was carried out through focus group discussions. The application was tested on four teachers who teach students with hearing impairments. The results of the main field experiment show that teachers can use the application to help them assess students with hearing loss. With availability, the accuracy of the Design and Development of the Sound and Rhythm Perception Assessment Application can be further improved by conducting training with more teachers who teach children with hearing impairments at school.


Sound; rhythm; assessment; hearing impairments; application

Full Text:



W. S. Yue and N. A. M. Zin, “Voice Recognition and Visualization Mobile Apps Game for Training and Teaching Hearing Handicaps Children,” Procedia Technology, vol. 11, pp. 479–486, 2013, doi:10.1016/j.protcy.2013.12.218.

V. Romei, J. Gross, and G. Thut, “Sounds Reset Rhythms of Visual Cortex and Corresponding Human Visual Perception,” Current Biology, vol. 22, no. 9, pp. 807–813, May 2012, doi:10.1016/j.cub.2012.03.025.

A. A. Alshawabkeh, M. L. Woolsey, and F. F. Kharbat, “Using online information technology for deaf students during COVID-19: A closer look from experience,” Heliyon, vol. 7, no. 5, p. e06915, May 2021, doi: 10.1016/j.heliyon.2021.e06915.

A. Mahr, M. Cichon, S. Mateo, C. Grajeda, and I. Baggili, “Zooming into the pandemic! A forensic analysis of the Zoom Application,” Forensic Science International: Digital Investigation, vol. 36, p. 301107, Mar. 2021, doi: 10.1016/j.fsidi.2021.301107.

D. DeWitt, N. Alias, Z. Ibrahim, N. K. Shing, and S. M. Mohd. Rashid, “Design of a Learning Module for the Deaf in a Higher Education Institution Using Padlet,” Procedia - Social and Behavioral Sciences, vol. 176, pp. 220–226, Feb. 2015, doi: 10.1016/j.sbspro.2015.01.464.

I. C. PutrI, D. Damri, E. Engkizar, Z. Asril, and E. Efendi, “The Use of Android Game to Improve Impaired Hearing Student Vocabulary Mastery,” Journal of Educational Research and Evaluation, vol. 9, no. 2, pp. 85–93, Aug. 2020, doi: 10.15294/jere.v9i2.44744.

Y. Lay, C. Tsai, H. Yang, C. Lin, and C. Lai, “The application of extension neuro-network on computer-assisted lip-reading recognition for hearing impaired,” Expert Systems with Applications, vol. 34, no. 2, pp. 1465–1473, Feb. 2008, doi:10.1016/j.eswa.2007.01.042.

K. Gabova, Z. Meier, and P. Tavel, “Why do many children who are hard of hearing not use remote microphones to compensate for their hearing loss?,” Heliyon, vol. 8, no. 9, p. e10590, Sep. 2022, doi:10.1016/j.heliyon.2022.e10590.

B. Wollesen et al., “Multitask training to improve walking performance in older adults with hearing impairment: A feasibility study,” Aging and Health Research, vol. 1, no. 3, p. 100028, Sep. 2021, doi: 10.1016/j.ahr.2021.100028.

A. Kasapbaşi, A. E. A. Elbushra, O. Al-Hardanee, and A. Yilmaz, “DeepASLR: A CNN based human computer interface for American Sign Language recognition for hearing-impaired individuals,” Computer Methods and Programs in Biomedicine Update, vol. 2, p. 100048, 2022, doi: 10.1016/j.cmpbup.2021.100048.

M. Mohandes, Junzhao Liu, and M. Deriche, “A survey of image-based Arabic sign language recognition,” 2014 IEEE 11th International Multi-Conference on Systems, Signals & Devices (SSD14), Feb. 2014, doi: 10.1109/ssd.2014.6808906.

B. Gopinath, C. M. McMahon, G. Burlutsky, and P. Mitchell, “Hearing and vision impairment and the 5-year incidence of falls in older adults,” Age and Ageing, vol. 45, no. 3, pp. 409–414, Mar. 2016, doi: 10.1093/ageing/afw022.

F. E. Gispen, D. S. Chen, D. J. Genther, and F. R. Lin, “Association Between Hearing Impairment and Lower Levels of Physical Activity in Older Adults,” Journal of the American Geriatrics Society, vol. 62, no. 8, pp. 1427–1433, Jul. 2014, doi: 10.1111/jgs.12938.

M. K. Pichora-Fuller, Age-related hearing loss. INC, 2020.

A. Shearer, M. Hildebrand, A. Schaefer, Smith, and RJH, Genetic Hearing Loss Overview. University of Washington: Seattle, 2017.

L. Hamie et al., “Genodermatoses with hearing impairment,” Journal of the American Academy of Dermatology, vol. 85, no. 4, pp. 931–944, Oct. 2021, doi: 10.1016/j.jaad.2021.06.850.

T. H. Brown, “Childhood hearing impairment,” Paediatrics and Child Health, vol. 30, no. 1, pp. 6–13, Jan. 2020, doi:10.1016/j.paed.2019.10.002.

M. Marlina, G. Kusumastuti, and E. Ediyanto, “Differentiated Learning Assessment Model to Improve Involvement of Special Needs Students in Inclusive Schools,” International Journal of Instruction, vol. 16, no. 4, pp. 423–440, Oct. 2023, doi: 10.29333/iji.2023.16425a.

J. Dibbell, Serious games, vol. 114, no. 1. 2011.

S. Wischmann, J. L. Josvassen, C. Schiøth, and L. Percy-Smith, “History re-written for children with hearing impairment,” International Journal of Pediatric Otorhinolaryngology, vol. 152, p. 110991, Jan. 2022, doi: 10.1016/j.ijporl.2021.110991.

Y. Rahajeng Anindyajati and A. Salim Choiri, “The Effectiveness of Using Word Wall Media to Increase Science-Based Vocabulary of Students with Hearing Impairment,” Eur. J. Spec. Educ. Res., vol. 2, no. 2, pp. 1–13, 2017, doi: 10.5281/zenodo.236877.

T. Liu, C.-C. Wu, K.-C. Huang, and J.-J. Liao, “Effects of frequency and signal-to-noise ratio on accuracy of target sound detection with varied inferences among Taiwanese hearing-impaired individuals,” Applied Acoustics, vol. 161, p. 107176, Apr. 2020, doi:10.1016/j.apacoust.2019.107176.

M. Karkhaneh, G. Movallali, Mehdi, A. Mohammadi, and Z. Salehy, “Effectiveness of Encouragement Training in Alleviating Depression among Mothers of Children with Hearing Impairment,” Asian J. Soc. Sci. Manag. Stud., vol. 2, no. 2, pp. 53–57, 2015, [Online]. Available:

C. R. Benítez-Barrera, E. C. Thompson, G. P. Angley, T. Woynaroski, and A. M. Tharpe, “Remote Microphone System Use at Home: Impact on Child-Directed Speech,” Journal of Speech, Language, and Hearing Research, vol. 62, no. 6, pp. 2002–2008, Jun. 2019, doi:10.1044/2019_jslhr-h-18-0325.

S. Hammami, F. Saeed, H. Mathkour, and M. A. Arafah, “Continuous improvement of deaf student learning outcomes based on an adaptive learning system and an Academic Advisor Agent,” Computers in Human Behavior, vol. 92, pp. 536–546, Mar. 2019, doi:10.1016/j.chb.2017.07.006.

R. Ranjan and A. Banik, “Development and Validation of the Objectives for Language Stimulation Home Training Activity Manual in Hindi for Parents of the Children with Hearing Impairment,” Lang. India, vol. 13, no. 4, pp. 260–282, 2013.

J. Morais, “The phoneme: A conceptual heritage from alphabetic literacy,” Cognition, vol. 213, p. 104740, Aug. 2021, doi: 10.1016/j.cognition.2021.104740.

S. Iselin Ertzgaard et al., “Prevalence of hearing impairment among primary school children in the Kilimanjaro region within Tanzania,” International Journal of Pediatric Otorhinolaryngology, vol. 130, p. 109797, Mar. 2020, doi: 10.1016/j.ijporl.2019.109797.

L. van Maastricht, T. Zee, E. Krahmer, and M. Swerts, “The interplay of prosodic cues in the L2: How intonation, rhythm, and speech rate in speech by Spanish learners of Dutch contribute to L1 Dutch perceptions of accentedness and comprehensibility,” Speech Communication, vol. 133, pp. 81–90, Oct. 2021, doi:10.1016/j.specom.2020.04.003.

L.-A. Leow, T. Parrott, and J. A. Grahn, “Individual Differences in Beat Perception Affect Gait Responses to Low- and High-Groove Music,” Frontiers in Human Neuroscience, vol. 8, Oct. 2014, doi:10.3389/fnhum.2014.00811.

C. Bang, “A World of Sound and Music: Music Therapy for Deaf, Hearing Impaired and Multi-Handicapped Children and Adolescents,” vol. 1, no. 2, pp. 93–103, 2009, [Online]. Available:

J. Zhao et al., “Self-powered speech recognition system for deaf users,” Cell Reports Physical Science, vol. 3, no. 12, p. 101168, Dec. 2022, doi: 10.1016/j.xcrp.2022.101168.

M. J. Maulana and A. Suntoda, “the Effort To Improve the Movement of Rhythms of Student With Hearing Impairment Through Bkpbi Learning,” Proc. Int. Conf. Spec. Educ., vol. 3, no. July, pp. 13–16, 2019.

H.-F. Wang et al., “Hearing impairment is associated with cognitive decline, brain atrophy and tau pathology,” eBioMedicine, vol. 86, p. 104336, Dec. 2022, doi: 10.1016/j.ebiom.2022.104336.

R. Kolinsky et al., “The impact of alphabetic literacy on the perception of speech sounds,” Cognition, vol. 213, p. 104687, Aug. 2021, doi:10.1016/j.cognition.2021.104687.

J. Martin-Gutierrez and M. S. Del Rio Guerra, “Analysing Touchscreen Gestures: A Study Based on Individuals with Down Syndrome Centred on Design for All,” Sensors, vol. 21, no. 4, p. 1328, Feb. 2021, doi: 10.3390/s21041328.

R. L. Wright, J. W. Bevins, D. Pratt, C. M. Sackley, and A. M. Wing, “Metronome Cueing of Walking Reduces Gait Variability after a Cerebellar Stroke,” Frontiers in Neurology, vol. 7, Jun. 2016, doi:10.3389/fneur.2016.00084.

M. Schweizer, S. Eylon, and M. Katz-Leurer, “The correlation between rhythm perception and gait characteristics at different rhythms among children with cerebral palsy and typically developing children,” Gait & Posture, vol. 82, pp. 83–89, Oct. 2020, doi:10.1016/j.gaitpost.2020.08.120.

R. Torppa and M. Huotilainen, “Why and how music can be used to rehabilitate and develop speech and language skills in hearing-impaired children,” Hearing Research, vol. 380, pp. 108–122, Sep. 2019, doi: 10.1016/j.heares.2019.06.003.

F. Zhang, G. Underwood, K. McGuire, C. Liang, D. R. Moore, and Q.-J. Fu, “Frequency change detection and speech perception in cochlear implant users,” Hearing Research, vol. 379, pp. 12–20, Aug. 2019, doi:10.1016/j.heares.2019.04.007.

B. M. D. Vonck, M. J. W. Lammers, W. A. A. Schaake, G. A. van Zanten, R. J. Stokroos, and H. Versnel, “Cortical potentials evoked by tone frequency changes compared to frequency discrimination and speech perception: Thresholds in normal-hearing and hearing-impaired subjects,” Hearing Research, vol. 401, p. 108154, Mar. 2021, doi: 10.1016/j.heares.2020.108154.

J. M. Thomson and U. Goswami, “Rhythmic processing in children with developmental dyslexia: Auditory and motor rhythms link to reading and spelling,” Journal of Physiology-Paris, vol. 102, no. 1–3, pp. 120–129, Jan. 2008, doi: 10.1016/j.jphysparis.2008.03.007.

A. E. Ramirez, E. Donati, and C. Chousidis, “A siren identification system using deep learning to aid hearing-impaired people,” Engineering Applications of Artificial Intelligence, vol. 114, p. 105000, Sep. 2022, doi: 10.1016/j.engappai.2022.105000.

R. S. Aisami, “Learning Styles and Visual Literacy for Learning and Performance,” Procedia - Social and Behavioral Sciences, vol. 176, pp. 538–545, Feb. 2015, doi: 10.1016/j.sbspro.2015.01.508.

C.-S. Chan, “Phenomenology of rhythm in design,” Frontiers of Architectural Research, vol. 1, no. 3, pp. 253–258, Sep. 2012, doi:10.1016/j.foar.2012.06.003.

G. Spöttl and L. Windelband, “The 4thindustrial revolution – its impact on vocational skills,” Journal of Education and Work, vol. 34, no. 1, pp. 29–52, Dec. 2020, doi: 10.1080/13639080.2020.1858230.