Low cost eye based human computer interface system (Eye controlled mouse)

• Main Authors: Hegde, Veena N., Ullagaddimath, Ramya S., Kumuda, S.
• Format: Conference Proceeding
• Language: English
• Subjects: Computers; Gaze determination; Human computer interaction; Image color analysis; Iris; Iris detection; MATLAB; Mice; Open CV Java; Threshold setting; Tracking; Types of eye movements; Visualization; Web camera
• ISSN: 2325-9418
• DOI: 10.1109/INDICON.2016.7838906

This paper presents a low cost eye based Human Computer Interface (HCI) developed for amputees and paralyzed persons. The system is a computer interface that provides the functionality of an input device like mouse based on eye actions such as eye blink, eye-gaze and gaze control. For initialization, the subject just holds his/her head still for a few seconds: using involuntary blinks that would naturally occur during this time, the system both locates the user's eye pair as well as forms online templates of the open and shut eyes of the specific user, valid for the rest of that session. The located eyes are tracked in real time using template matching and histogram back projection. Reasonable amount of head motion, carried out at reasonable speeds, are automatically detected and compensated. Automatic re-initialization of the system occurs if the user goes out of frame or during excessive rapid head movement. When the eyes are detected as more than 70% open, the iris tracker module is triggered. In order to detect the iris, the eye image is subjected to image conditioning to eliminate the eyelashes and eyebrow. The iris is detected on the basis of colour and shape, and the Hough transform is used on the region to determine its centre and radius. Iris detection is continuously repeated whenever the eye is open, so that it is continuously tracked. Later on, continuous gaze does the mouse clicking action replacing the mouse of the computer with this HCI.