Abstract
This paper presents Google speech API based aid for deaf and blind people. The live streaming speech on the microphone is sent to Google API server which converts the speech signal into text and displaying onto a LCD screen and amplifies the speech via speaker. The aid will use Request procedure protocol to send the encoded Mp3 audio to Google API server where the speech signal is converted into suitable text and sent back to the Raspberry pi using repeated request protocol. This aid is designed to address issue with mild deafness and blind person. This will enable the deaf and blind persons to work effectively at home, office and any public places with ease. The aid works at low latency at good internet connectivity.








Similar content being viewed by others
References
Yao Chen, Yangjie Wei, Nan Guan, Yi Wang (2014) An Intelligent Hearing Aid System Based on Real-Time Signal Processing. Proceedings of the 2014 IEEE International Conference on Cyber-Physical Systems, Networks, and Applications, pp 55–58.
Lotfi Bendaoui, Si Mahmoud Karabernou, Lounis Kessal, (2014) “FPGA-Implementation of a Bio-Inspired Medical Hearing Aid Based DWT-OLA”, International Conference on Audio, Language and Image Processing, pp 1–5.
Mathews, J., Low-delay signal processing for digital hearing aids. IEEE transactions on audio, speech, and language processing 19(4):699–710, 2010.
an, S. k., Park, S.-I., jun, s. b., and lee, c. h., Design for simplifies cochlear implant system. IEEE Transactions on Biomedical Engineering 54(6):973–982, 2007.
Kilo P. B Chaudari, Ashwini, Malkar Sanam, (2015) “Image Processing Based Language Converter for Deaf and Dumb People”, A Conference on Wireless Communication and Android Apps, PP 25–30.
oziokio, O., and hersh, m., Development of a portable two-way communication and information device for deaf blind people. studies in health technology and informatics 217:518–525, 2015.
Pathi, M. R., and Sivakumar, A. A. M., Use of braille database for design and implementation of braille hand glove for deaf blind people. International journal of innovative technology & creative engineering 1(6):7–12, 2011.
Mrim alfiai, srini sampan, (2017) “Social and communication apps for the deaf and hearing impaired”, International Conference on Computer and Applications, pp 1–5.
Girija Shankar Dash, Omprakash Singh, Swetalima, (2016) “wiBeD2: A communication aid for deaf-dump people”, International Conference on Information Communication and Embedded Systems, pp 1–5
Subbulakshmi, N., and Manimegalai, R., MACGDI: Low power MAC based filter Bank using GDI logic for hearing aid applications. International Journal of Electronics and Electrical Engineering 5(3):235–238, 2017.
Ben Shirley, James Thomas, Poulroche, (2012) “VoIP text: voice chat for deaf & hard of hearing people”, IEEE Second International Conference on Consumer Electronics, pp 1–7.
Kumar, M. V. N. R. P., and Ashtosh Kumar, M., AVR Based Gesture Vocalizer Using Speech Synthesizer IC. International journal of research in advent technology 3(5):25–29, 2015.
Priya Darsini, R., Naga Lakshmi, C. V., and Madhulika, G., Digital filtering in hearing aid system. International Journal Of Advanced Research in Engineering & Management (IJAREM) 03(04):60–65, 2017.
Atiqua, N., and Hossain, S., Speech to text conversion in real-time. International Journal of Innovation and Scientific Research 17(2):271–277, 2015.
Matthias Mielke and Rainer Bruck, (2016)“AUDIS Wear: a Smart watch based Assistive Device for Ubiquitous Awareness of Environmental Sounds”, 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society , pp 10–15.
Radu Arsinte, Eugen Lupul, Teodor Sumalan, (2017),“A Rapid Prototyping Model Concept for a DSP Based Hearing Aid”, E-Health and Bioengineering Conference , pp 20–27.
Parul Saxena, Ashish Mehta, (2016) “Refinement of Input Speech by Suppressing the Unwanted Amplitudes for Blue Hearing System”, 2nd International Conference on Advances in Computing, Communication, & Automation, pp 21–29.
Sethuraman, Abhinav Rajan and K.P. Sai Saran,(2015), “Beta Real Time Interface for Deaf and Global Entity (Bridge)”, International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials, pp 67–75.
Maath S. Abdulghafoor , Azlina Ahmad, Jiung-Yao Huang,(2015), “Survey on the Use of Applications for Deaf and Hard Hearing Literacy”, International Conference on Computer, Communications, and Control Technology, pp 56–64.
Hari Krishna Garg, Tang Bin, Zhang Liang, , Ram Singh, (2005) “ Wireless hearing aids system simulation”, IEEE Conference on Signals, Systems and Computers, pp 45–51.
Sacristan and Victoria Rodella, Louiza Sellami, and Robert W. Newcomb, (2000), “A Digitally Implementable Ear-Type Lattice”, Proceedings of the 43rd IEEE Midwest Symposium on Circuits and Systems, pp 72-76.
Rautl Vicen-Bueno, Roberto Gil-Pita, Manuel Utrilla-Manso, Lorena Alvarez-Perez,(2007) “A hearing aid simulator to test adaptive signal processing algorithms”, IEEE International Symposium on Intelligent Signal Processing pp 74–81.
Prachi Khilari, Bhope V. P., (2015) “ A Review on speech to text conversion methods”, International Journal of Advanced Research in Computer Engineering & Technology Volume 4 (7), pp 3067–3072.
Jose, D. V., Mustafa, A., and Sharan, A novel model for speech to text conversion. International Refereed Journal of Engineering and Science 3(1):39–41, 2014.
Kevin J. Lippert, Amanda M. Lippert, (2015), “Hearing Protection- The Electrical Hazard you Don't Hear About !”, Electrical Safety Workshop, pp 7–15.
Funding
The work is not part of any funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
No conflict exists: Vasanth Kishorebabu declares that he/she has no conflict of interest, Macharla Mounika declares she has no conflict of interest, Varatharajan declares that he has no conflict of interest. Ethical Approval: Articles do not contain studies with human participants or animals by any of the authors. The author has used augmented reality based hearing aid.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Patient Facing Systems
Rights and permissions
About this article
Cite this article
Vasanth K, Macharla, M. & Varatharajan R A Self Assistive Device for Deaf & Blind People Using IOT. J Med Syst 43, 88 (2019). https://doi.org/10.1007/s10916-019-1201-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-019-1201-0