Eyeball Movement based Cursor and Keyboard Control for Physically Challenged
DOI:
https://doi.org/10.61841/baxzay37Keywords:
On-Screen Keyboard, Face Recognition, Eye Detection, Web Camera, MAT Lab, Computer, Java, Viola Jones AlgorithmAbstract
An individual human-computer interface system using eye movement is introduced. Traditionally, human-computer interfaces use a mouse or keyboard as an input device. The proposed system presents a hands-free interface between the computer and the user for the physically challenged. The main objective is to control the mouse & keypad using the eyeball. It also verifies the user’s authentication using face recognition. For face recognition, the Viola-Jones algorithm is used. The camera is connected with the system & MATLAB is used for user authentication. After successful authentication, the camera continues to scan the user’s eyeball movement. During this state of action, our physical keypad & mouse are frozen in order to stop the user’s key inputs. On-screen keyboard & mouse control is initiated so as to control those through eyeball movements. MATLAB software plays a vital role in controlling the on-screen keyboard and mouse. We will be using Java for freezing the physical keypad & mouse functionalities. The camera scans the eyeball of the authenticated user, and control of the mouse is achieved through the eyeball movement. Alphabets are selected by eye-ball clicking for effective communication. The physical keyboard control is released by the Control, Alt & Delete keys. MATLAB is used for face recognition & eyeball control. The on-screen keyboard is initiated& freezing of the physical mouse & keypad is achieved by Java software.
Downloads
References
[1] Craig Hennessey, Jacob Fiset “Long Range Eye Tracking: Bringing Eye Tracking into the Living Room,”
IEEE Transactions on Consumer Electronics, vol. 50, no. 5, pp. 77-85, Sept. 2016.
[2] Shyam Narayan Patel, V. Prakash, Autonomous Camera based Eye Controlled Wheelchair system using
Raspberry-Pi,” in proc. of 2nd IEEE International Conference on Innovations in Information Embedded
and Communication Systems, vol.33, no.4, no.4,pp.111-118, Aug 2015.
[3] M. Mangaiyarkarasi and A. A.Geetha, "Cursor Control System Using Facial Expressions for Human-Computer Interaction," IEEE transactions on computer development technology, vol. 8, no. 1, April 2014.
[4] Ziho Kang and Steven J. Landry, "An Eye Movement Analysis Algorithm for a Multielement Target
Tracking Task: Maximum Transition-Based Agglomerative Hierarchical Clustering," IEEE transactions on
Human-Machine Systems, vol. 45, no. 1, pp. 192-199, Feb. 2015.
[5] Youlian Zhu, Cheng Huang, "An Improved Filtering Algorithm for Image Noise Reduction,"
SciVerse ScienceDirect, Elsevier, Physics Procedia 25, vol. 22, no. 3, pp. 609-616, Aug. 2015.
[6] Moe Win, A. R. Bushroa, M. A. Hassan, N. Hilman, AriIde-Ektessabi, "A Contrast Adjustment
Thresholding Method for Surface Defect Detection Based on Mesoscopy," IEEE transactions on industrial
Informatics, vol. 11, no. 3, pp. 329-337, June 2015.
[7] Muhammad Usman Ghani, Sarah Chaudhry, Maryam Sohail and Muhammad Nafees Geelani,
"GazePointer: ATime Mouse Pointer Control Implementation Based On Eye Gaze Tracking," IEEE
transactions on consumer electronics, vol. 4, no. 1, pp. 424-431, Jan. 2013.
[8] Shrunkhala Satish Wankhede, Mrs. Chhabria, Dr.R.V. Dharaska “ Controlling Mouse Cursor Using
Eye Movement,” Special Issue for National Conference On Recent Advances in Technology and
Management for Integrated Growth 2013.
[9] Akhil Gupta, Akash Rathi, Dr. Y. Radhika, “Hands-free pc control” controlling of mouse cursor using eye
movement, International Journal of Scientific and Research Publications, vol. 9, no. 4, pp. 92-99, April
2012.
[10] Sidra Naveed, Bushra Sikander, and Malik Sikander Hayat Khiyal, “Eye Tracking System with Blink
Detection,” International Journal of Engineering and Technology (UAE), vol. 32, no. 11, pp. 121–129, Aug. 2012.
[11] Jixu Chen, Yan Tong, Wayne Grayy, QiangJiz, “A Robust 3D Eye Gaze Tracking System,” IEEE Transactions on Scientific and Research Development, vol. 21, pp. 189-196, March 2008.
[12] Ioana Bacivarov, Mircea Ionita, Peter Corcoran, “Statistical models of appearance for eye tracking and eye blink detection and measurement,” IEEE transactions on consumer electronics, vol.54 , no.3, pp.1312‐1320, Aug 2009.
[13] S.S. Deepika and G. Murugesan, "A Novel Approach for forHuman Computer Interface Based on Eye Movements for Disabled People," International Journal of Innovation in Engineering Research & Management, vol. 6, no. 9, pp. 1001-1009, March 2015.
[14] Ryo Shimata, Yoshihiro Mitani, and Tsumoru Ochiai, "A Study of Pupil Detection and Tracking by Image Processing Techniques for a Human Eye–Computer Interaction System," IEEE transactions on research and development, vol. 15, no. 2, pp. 200-208, June 2015.
Downloads
Published
Issue
Section
License
Copyright (c) 2020 AUTHOR
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
