Robotic Writing Arm Based on Voice and Gesture Command for Physically Challenged

Authors

  • J. Jijin Godwin Assistant Professor, Department Of Electronics and Communication Engineering, Velammal Institute of Technology Department of ECE, India Author
  • G. Shanmugaraj Assistant Professor, Department Of Electronics and Communication Engineering, Velammal Institute of Technology Department of ECE, India Author
  • M. Harshithaa Assistant Professor, Department Of Electronics and Communication Engineering, Velammal Institute of Technology Department of ECE, India Author
  • K. Sandhiya Assistant Professor, Department Of Electronics and Communication Engineering, Velammal Institute of Technology Department of ECE, India Author
  • S.Arivu Suder Assistant Professor, Department Of Electronics and Communication Engineering, Velammal Institute of Technology Department of ECE, India Author

DOI:

https://doi.org/10.61841/js36x333

Keywords:

Mems, Physically challenged,, Robot, Zigbee

Abstract

Robots will be a powerful replacement of humans in the world future decades. Physically challenged people are facing difficulties to express their views to the world through alphabets. To overcome these hindrances many works have been proposed. In existence robots are trained to assist the physically challenged in writing by voice command or gesture command. The objective is to aid the physically challenged people to write virtually. Amputee and visually challenged are benefitted. Deep neural network algorithm is put forward. SIFT and classification model are the key ingredients of this algorithm. Three different inputs like voice command, camera-based input and MEMS hardware interface using ZigBee are given. In the proposed work, voice command is processed on an android application, image input is given through camera and gesture is given as input using MEMS. A robotic arm is designed, such that it writes alphabets on command. This approach aids the physically challenged people to translate the gestures and speech to written format.

 

Downloads

Download data is not yet available.

References

1. AnkurBhargava, Anjali Kumar,‖ Arduino controlled robotic arm‖, International Conference on Electronics, Communication and Aerospace technology,IEEE 2017,pp:376-380..

2. Fei Chao , Yuxuan Huang, Chih-Min Lin , Fellow, Longzhi Yang , Huosheng Hu ,ChangleZhou,‖Use of Automatic Chinese Character Decomposition and Human Gestures for Chinese Calligraphy Robots”,IEEE transactions on Human-machine systems, Vol. 49, No. 1, February 2019,pp:2168-2291.

3. TanatchaChaikhumpha,PhattanaphongChomphuwiset,‖Real – time Two Hand Gesture Recognition with Condensation and Hidden Markov Models”,IEEE 2018

4. M.Balaganesh,E.Logashanmugam,‖Robotic Arm Showing Writing Skills by Speech Recognition‖,IEEE 2010,pp:12-15.

5. Jean Jiang, Alex McCoy, Eric Lee, and Li Tan,‖ Development of a Motion Controlled Robotic Arm‖,IEEE 2017.

6. FreekStulp, Evangelos A. Theodorou ,Stefan Schaal, —Reinforcement Learning With Sequences of Motion Primitives for Robust Manipulation‖, IEEE transactions on Robotics, Vol. 28, No. 6, December 2012.

7. HoomanLee,JoongbaeKirn,TaewooKim,‖A Robot Teaching Framework for a Redundant Dual Arm Manipulator with Teleoperation from Exoskeleton Motion Data‖,IEEE-RAS International Conference on Humanoid Robots,November 2014.

8. XingenGao, Changle Zhou, FeiChao ,Longzhi Yang, Chih-Min Lin, Changjing Shang ,‖A Robotic Writing Framework Learning Human Aesthetic Preferences via Human Machine Interactions‖,IEEE,October 2019.

9. Fei Chao, Yuxuan Huang, Chih-Min Lin , Longzhi Yang, Huosheng Hu, ChangleZhou,‖Use of Automatic Chinese Character Decomposition and Human Gestures for Chinese Calligraphy Robots‖,IEEE Transactions On Human-Machine Systems, Vol. 49, No. 1, February 2019.

10. Libin M George, Annu Mariam Abraham, Ananthapadmanabhan J, Vineetha Anna Saji, Anil A R,‖ Implementation of IoT In Smart Robotics‖,International Journal Of Engineering And Computer Science ,Volume 6 ,Issue 3, March 2017.

11. Pankaj Kumar Gautam, SudhasnhuPandey, Vishwajeet Kumar Nanda,‖Robot Control by Accelerometer Based Hand Gesture using Arduino Microcontroller‖, International Journal of Recent Technology and Engineering (IJRTE),Volume-7 ,Issue-4, November 2018.

12. Benjamin Arnold, Daniel Wohlrab, ChristophMeinecke, Danny Reuter, Jan Mehner,‖Design, Manufacturing and Test of a High-Precision MEMS Inclination Sensor for Navigation Systems in Robot-Assisted Surgery‖, International Journal of Biomedical Science and Engineering,2018.

13. Zhangguo Yu, Qiang Huang, XuechaoChen,Wen Zhang, JunyaoGao,‖ Design of a Redundant Manipulator for Playing Table Tennis towards Human-Like Stroke Patterns‖,Hindawi Publishing Corporation Advances in Mechanical Engineering,Volume 2014.

14. RuoyinZheng, Jiting Li,‖ Kinematics and Workspace Analysis of an Exoskeleton for Thumb and Index Finger Rehabilitation‖,IEEE 2014.

15. Gaolin Fang, Wen Gao, Debin Zhao,‖ Large-Vocabulary Continuous SignLanguage Recognition Based on Transition-Movement Models, IEEE Transactions On Systems, Man, And Cybernetics—Part A: Systems And Humans, Vol. 37, No. 1, January 2007.

16. Abu Ubaidah bin Shamsudin,ShahrulNa’imSidek,EllianaIsmail,MozasserRahman,‖A High-Level Controller for Robot-Assisted Rehabilitation Based On Chedoke-McMaster Stroke Assessment‖, International Conference on Computer and Communication Engineering (ICCCE 2012), 3-5 July 2012.

17. Rajesh Kannan, Megalingam, DeepanshMenon,NitinAjithkumar , NihilSaboo,‖ Implementation of Gesture Control in Robotic Arm using Kinect Module‖,Applied Mechanics and Materials, Vol. 786, 2015.

18. Patrick M. Aubin, Hani Sallum, Conor , Walsh,LeiaStirling,AnnetteCorreia,‖A Pediatric Robotic Thumb Exoskeleton for at-Home Rehabilitation -The Isolated Orthosis for Thumb Actuation (IOTA)‖, IEEE International Conference on Rehabilitation Robotics,June 2013.

19. Ping Zhang, Bei Li, Guanglong Du, Xin Liu,‖ A Wearable-based and Markerless Human-manipulator Interface with Feedback Mechanism and Kalman Filters‖, International Journal of Advanced Robotic Systems,September 2015.

20. Pei Xu,‖A real-time hand gesture recognition and human-computer interaction system‖.

21. Marius-Florin CRAINIC, Stefan PREITL,LucianAlexandru ŞANDRU, ValerDOLGA,‖Secure handwriting using a robot arm for educational purpose‖,IEEE 2014.

22. AdlinaTaufikSyamlan ,HendroNurhadi, BambangPramujati,‖Character Recognition for Writing Robot Control Using ANFIS

—,Conference on Advanced Mechatronics, Intelligent Manufacture, and Industrial Automation,2015.

23. TomàsPallejàCabré,MercèTeixidóCairol,DaviniaFontCalafell,MarcelTresanchezRibes, andJordiPalacínRoca, —Project-BasedLearningExample:Controlling anEducationalRoboticArmWith ComputerVision‖, IEEERevistaIberoamericanaDeTecnologias DelAprendizaje,Vol.8,No.3,August2013.

24. SherminShamsudheen ,Azathmubarakali " SMART AGRICULTURE USING IOT " International Journal of MC Square Scientific Research Vol.11, No.4,2019.

25. Waleed Ali Badawi " UNDERGROUND PIPELINE WATER LEAKAGE MONITORING BASED ON IOT " International Journal of MC Square Scientific Research Vol.11, No.3,2019.

26. Vijayabaskar V. and Rajendran V. (2011), —Analysis and modeling of wind dependence of ambient noise in shallow water of Arabian sea‖, European Journal of Scientific Research, Vol.50, pp.28-34(SJR IF: 0.21).(Nov.2010).

27. Vijayabaskar V., Rajendran V. and Mathews M Philip (2013), —Frequency Domain based approach for Denoising of Underwater Acoustic Signal using EMD‖, Journal of Intelligent Systems, Vol. 22 (2013), 67–80 (SJR IF: 0.189,SNIP :0.593).(March-2013).

28. Vijayabaskar V. and Rajendran V. (2010), —Wind Dependence of Ambient Noise in Shallow Water of Arabian Sea During Pre-Monsoon‖, Proceeding of IEEE International Conference on Recent Advances In Space Technology Services & Climate Change – 2010 (RSTSCC-2010)‖,Sathyabama University, pp. 413-416.(Nov. 2010).

Downloads

Published

31.10.2020

Issue

Vol. 24 No. 8 (2020): 24 (8) 2020

Section

Articles

License

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

You are free to:

  1. Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
  2. Adapt — remix, transform, and build upon the material for any purpose, even commercially.
  3. The licensor cannot revoke these freedoms as long as you follow the license terms.

Under the following terms:

  1. Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  2. No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

Notices:

You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .

No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.

How to Cite

Godwin, J. J., Shanmugaraj, G., Harshithaa, M., Sandhiya, K., & Suder, S. (2020). Robotic Writing Arm Based on Voice and Gesture Command for Physically Challenged. International Journal of Psychosocial Rehabilitation, 24(8), 10627-10634. https://doi.org/10.61841/js36x333