Optical Mouse Sensor for Eye Blink Detection and Pupil Tracking: Application in a Low-Cost Eye-Controlled Pointing Device

In this paper, a new application of the optical mouse sensor is presented. The optical mouse is used as a main low-cost infrared vision system of a new proposal of a head-mounted human-computer interaction (HCI) device controlled by eye movements. The default optical mouse sensor lens and illuminati...

Full description

Saved in:
Bibliographic Details
Published in:Journal of sensors 2019, Vol.2019 (2019), p.1-19
Main Authors: Tresanchez, Marcel, Palacín, Jordi, Pallejà, Tomàs
Format: Article
Language:English
Subjects:
Algorithms
Cameras
Cursor control devices
Data buses
Digital signal processors
Error detection
Eye movements
Field of view
Human-computer interface
Image acquisition
Image detection
Low cost
Microcontrollers
Mouse devices
Open access
Open source software
Performance tests
Plug & play
Sensors
Tracking
Universal Serial Bus
Vision systems
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, a new application of the optical mouse sensor is presented. The optical mouse is used as a main low-cost infrared vision system of a new proposal of a head-mounted human-computer interaction (HCI) device controlled by eye movements. The default optical mouse sensor lens and illumination source are replaced in order to improve its field of view and capture entire eye images. A complementary 8-bit microcontroller is used to acquire and process these images with two optimized algorithms to detect forced eye blinks and pupil displacements which are translated to computer pointer actions. This proposal introduces an inexpensive and approachable plug and play (PnP) device for people with severe disability in the upper extremities, neck, and head. The presented pointing device performs standard computer mouse actions with no extra software required. It uses the human interface device (HID) standard class of the universal serial bus (USB) increasing its compatibility for most computer platforms. This new device approach is aimed at improving comfortability and portability of the current commercial devices with simple installation and calibration. Several performance tests were done with different volunteer users obtaining an average pupil detection error of 0.34 pixels with a successful detection in 82.6% of all mouse events requested by means of pupil tracking.
ISSN:1687-725X
1687-7268
DOI:10.1155/2019/3931713