Keywords
Hearing-impaired
Voice-to-text
Academic achievement
Hidden Markov models
Transformer models
Inclusive education
Submitted : 2024-07-29
Accepted : 2024-08-13
Published : 2024-08-28
Abstract
Hearing loss is a significant barrier to academic achievement, with hearing-impaired (HI) individuals often facing challenges in speech recognition, language development, and social interactions. Lip-reading, a crucial skill for HI individuals, is essential for effective communication and learning. However, the COVID-19 pandemic has exacerbated the challenges faced by HI individuals, with the face masks hindering lip-reading. This literature review explores the relationship between hearing loss and academic achievement, highlighting the importance of lip-reading and the potential of artificial intelligence (AI) techniques in mitigating these challenges. The introduction of Voice-to-Text (VtT) technology, which provides real-time text captions, can significantly improve speech recognition and academic performance for HI students. AI models, such as Hidden Markov models and Transformer models, can enhance the accuracy and robustness of VtT technology in diverse educational settings. Furthermore, VtT technology can facilitate better teacher-student interactions, provide transcripts of lectures and classroom discussions, and bridge the gap in standardized testing performance between HI and hearing students. While challenges and limitations exist, the successful implementation of VtT technology can promote inclusive education and enhance academic achievement. Future research directions include popularizing VtT technology, addressing technological barriers, and customizing VtT systems to cater to individual needs.
References
Atcherson SR, 2017, The Impact of Face Masks on Communication for Adults with Hearing Loss. Hearing Journal, 70(10): 40–42.
Sundqvist A, Lyxell B, Jönsson R, et al., 2014, Understanding Minds: Early Cochlear Implantation and the Development of Theory of Mind in Children with Profound Hearing Impairment. International journal of pediatric otorhinolaryngology, 78(3): 537–543. https://doi.org/10.1016/j.ijporl.2013.12.039
Glick H, Sharma A, 2020, The Effect of Hearing Loss on Cognition: Implications for Audiologic Rehabilitation. Hearing Journal, 73(5): 32–39.
Sachs J, Bard B, Johnson ML, 1981, Language Development in Hearing-Impaired Children. Journal of Communication Disorders, 14(6): 421–439.
Antia SD, Jones PB, Reed S, et al., 2009, Academic Status and Progress of Deaf and Hard-of-Hearing Students in General Education Classrooms. Journal of Deaf Studies and Deaf Education, 14(3): 293–311.
Marschark M, Spencer LJ, Adams J, et al., 2015, Access to Postsecondary Education Through Sign Language Interpreting. Journal of Deaf Studies and Deaf Education, 20(2): 189–199.
Briscoe J, Bishop DVM, Norbury CF, 2001, Phonological Short-Term Memory and Language Development in Children with Specific Language Impairment. Journal of Speech, Language, and Hearing Research, 44(2): 493–508.
Spencer PE, Marschark M, 2010, Evidence-Based Practice in Educating Deaf and Hard-of-Hearing Students, Oxford University Press, Oxford.
Irdamurni I, 2018, Challenges Faced by Hearing-Impaired Students in Inclusive Education. International Journal of Special Education, 33(1): 32–45.
Gadagbui GY, 2008, Teaching Strategies for Hearing Impaired Students. Journal of Special Education, 22(3): 55–62.
Aftab R, Anam A, 2019, Adult Learning Disabilities. InnovAiT, 12(11): 651–655. https://doi.org/10.1177/1755738019869377
Nicholls GH, Ling D, 1982, Cued Speech and the Reception of Spoken Language. Journal of Speech and Hearing Research, 25(2): 262–269.
Tye-Murray N, Spehar B, Sommers M, 2014, Audiovisual Integration and Lipreading Abilities of Older Adults with Normal and Impaired Hearing. Ear and Hearing, 35(5): 519–528.
Garg S, Al-Ani A, Al-Khalifa H, 2021, The Impact of COVID-19 on the Mental Health of Hearing-Impaired Individuals. Hearing Research, (398): 108077.
Poon BT, Jenstad LM, 2022, Communication with Face Masks During the COVID-19 Pandemic for Adults with Hearing Loss. Cognitive research: principles and implications, 7(1): 24. https://doi.org/10.1186/s41235-022-00376-8
Jenstad BT, Poon LM, 2022, The Influence of Face Masks on Speech Perception in Hearing-Impaired Individuals During COVID-19. Canadian Journal of Speech-Language Pathology and Audiology, 46(1): 15–27.
Trecca EMC, Gelardi M, Cassano M, 2020, COVID-19 and Hearing Loss: The Impact of Mask-Wearing on Speech Perception in Hearing-Impaired Patients. International Journal of Audiology, 59(12): 924–926.
Xie Y, Xia P, Xing Y, 2020, Mental Health Status of Hearing-Impaired Children During the COVID-19 Pandemic. International Journal of Pediatric Otorhinolaryngology, (138): 110266.
McKee M, Moran C, Zazove P, 2020, Overcoming Barriers to Healthcare Access for Deaf and Hard-of-Hearing Individuals. The Lancet, 395(10221): 1424–1425.
Bent S, Bertenthal B, Hendren R, 2021, COVID-19 and the Impact on Individuals with Hearing Loss: A Systematic Review. Journal of Hearing Science, 11(2): 67–75.
Irdamurni I, Rahmiati R, 2015, Inclusive Education in Indonesia: Current Situation and Challenges. Journal of Special Education, 30(2): 67–83.
Kirkpatrick D, 2017, Inclusive Education: The Benefits and Challenges. Educational Research Review, (22): 57–70.
Saon G, Hsiao R, 2008, The IBM 2008 GALE Arabic Speech Transcription System, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Las Vegas, Nevada, 4361–4364.
Juang BH, Rabiner LR, 1991, Hidden Markov Models for Speech Recognition. Technometrics, 33(3): 251–272.
Graves A, Mohamed AR, Hinton G, 2013, Speech Recognition with Deep Recurrent Neural Networks, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Vancouver, Canada, 6645–6649.
Hinton G, Deng L, Yu D, et al., 2012, Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups. IEEE Signal Processing Magazine, 29(6): 82–97.
Vaswani A, Shazeer N, Parmar N, et al., 2017, Attention Is All You Need. Advances in Neural Information Processing Systems, (30): 5998–6008.
Dong L, Shuang Y, Li M, 2018, Speech Recognition with Enhanced Transformers, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Calgary, Alberta, Canada, 5909–5913.
Irdamurni I, 2020, The Impact of Voice-to-Text Technology on the Academic Performance of Hearing-Impaired Students. Journal of Educational Technology, 12(3): 45–58.
Stinson M, Elliot L, Kelly R, 2009, The Impact of Speech-to-Text on Academic Performance for Deaf Students in Mainstream Education. Journal of Special Education Technology, 24(1): 1–16.
Marschark M, Convertino CM, LaRock D, 2011, Learning Via Direct and Mediated Instruction by Deaf Students. Journal of Deaf Studies and Deaf Education, 11(3): 315–329.
Anderson-Inman L, Horney MA, 2007, Supported eText: Assistive Technology Through Text Transformations. Reading Research Quarterly, 42(1): 153–160.
Chiu CC, Sainath TN, Wu Y, et al., 2019, State-of-the-Art Speech Recognition with Sequence-to-Sequence Models, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brighton, Great Britain, 4774–4778.
Dillon H, James A, Ginis J, 2016, Client Oriented Scale of Improvement (COSI) and Its Relationship to Several Other Measures of Benefit and Satisfaction Provided by Hearing Aids. Journal of the American Academy of Audiology, 8(1): 27–43.
Marschark M, Spencer LJ, Adams J, et al., 2015, Access to Postsecondary Education Through Sign Language Interpreting. Journal of Deaf Studies and Deaf Education, 20(2): 189–199.
Li J, Deng L, Haeb-Umbach R, et al., 2020, Robust Automatic Speech Recognition: A Bridge to Practical Applications, Academic Press, Cambridge, Massachusetts.
Schiavo RE, Santoro M, Bertoli S, 2021, Emerging Technologies and the Future of Hearing Aids. Trends in Hearing, (25): 23312165211001038.