Sign Language Detection and Translation in Speech

  • S N Shelke1 university of pune
  • Ashutosh Porwal
  • Ashish Oswal
  • Nihal Mehta
  • Probal Das
Keywords: ASL, flex sensor, Atmega328, Tactile sensor, Accelerometer, Gesture recognition module, Text-tospeech synthesis module

Abstract

Communication is a fundamental form of human interaction, but sometimes it becomes inconvenient, problematic and expensive for deaf-mute people to communicate with nonASL speakers. This paper aims to bridge the communication gap between people with inability to speak and Non-ASL speakers to communicate conveniently. In the current work, we developed a smart glove which detects gestures using flex sensors and accelerometer/gyro-meter to detect the motion of hand in space. The experimental results implies that system is accurate and cost effective. The gestures are then mapped to a database of supervised data using KNN algorithm to recognize English alphabets, numbers and basic sentences.

References

[1] Prototyping a Portable, Affordable Sign Language Glove by Princesa Cloutier ,Alex Helderman and Rigen Mehilli. [2] Aarthi M, Vijayalakshmi P, “SIGN LANGUAGE TO SPEECH CONVERSION” , 2016 FIFTH INTERNATIONAL CONFERENCE ON RECENT TRENDS IN INFORMATION TECHNOLOGY [3] Mr. Jenyfal Sampson, Keerthiga V. , Mona P. , Rajha Laxmi A. , “Hetero Motive Glove For Hearing And Speaking Impaired Using Hand Gesture Recognition. ” International Journal Of Engineering Research in Electronics And Telecommunication Engineering (IJERECE). [4] Finger Spelling Digital Image. http://www.lifeprint.com/asl101/fingerspelling/images/abc1280x960.png
www.asianssr.org ID: 436
[5] https://itp.nyu.edu/archive/physcompspring2014/sensors/Reports/Flex.html [6] Roman Akozak www.romanakozak.com/signlanguagetranslator [7] D. Quick. (2012, July 12). “Sign language-to-speech translating gloves take out Microsoft Imagine Cup 2012” [Online]. Available: http://www.gizmag.com/enabletalk-sign-language-gloves/23268/ [8] Ravikiran, J., Kavi, M., Suhas, M., Sudheender, and S., Nitin, V. “Finger Detection for Sign Language Recognition”, Proceedings of the International multi conference of engineers and computer scientists, Vol. 2, No. 1, pp. 234-520,2009. [9] Vinod J Thomas, Diljo Thomas, “A Motion based Sign Language Recognition Method”, International Journal of Engineering Technology vol 3 Issue 4, ISSN 2349-4476, Apr 2015.
[10] Zhengmao, Z., Prashan, R., Monaragala, N., Malin, P. “Dynamic hand gesture recognition system using moment invariants”, IEEE Transactions on neural networking and computing, Vol. 21, No. 1, pp. 1034-1320, 2010
Published
2018-03-20
How to Cite
Shelke1S., Porwal, A., Oswal, A., Mehta, N., & Das, P. (2018). Sign Language Detection and Translation in Speech. Asian Journal For Convergence In Technology (AJCT) ISSN -2350-1146, 3(3). Retrieved from http://www.asianssr.org/index.php/ajct/article/view/229
Section
Article

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.