Real-time driver monitoring system with facial landmark-based eye closure detection and head pose recognition

This paper introduces a real-time Driver Monitoring System (DMS) designed to monitor driver behavior while driving, employing facial landmark estimation-based behavior recognition. The system utilizes an infrared (IR) camera to capture and analyze video data. Through facial landmark estimation, cruc...

Full description

Saved in:
Bibliographic Details
Published in:Scientific reports 2023-10, Vol.13 (1), p.18264-18264, Article 18264
Main Authors: Kim, Dohun, Park, Hyukjin, Kim, Tonghyun, Kim, Wonjong, Paik, Joonki
Format: Article
Language:English
Subjects:
639/166/987
639/705/117
639/705/258
639/705/794
Cameras
Drowsiness
Humanities and Social Sciences
Monitoring systems
multidisciplinary
Pattern recognition
Science
Science (multidisciplinary)
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper introduces a real-time Driver Monitoring System (DMS) designed to monitor driver behavior while driving, employing facial landmark estimation-based behavior recognition. The system utilizes an infrared (IR) camera to capture and analyze video data. Through facial landmark estimation, crucial information about the driver’s head posture and eye area is extracted from the detected facial region, obtained via face detection. The proposed method consists of two distinct modules, each focused on recognizing specific behaviors. The first module employs head pose analysis to detect instances of inattention. By monitoring the driver’s head movements along the horizontal and vertical axes, this module assesses the driver’s attention level. The second module implements an eye-closure recognition filter to identify instances of drowsiness. Depending on the continuity of eye closures, the system categorizes them as either occasional drowsiness or sustained drowsiness. The advantages of the proposed method lie in its efficiency and real-time capabilities, as it solely relies on IR camera video for computation and analysis. To assess its performance, the system underwent evaluation using IR-Datasets, demonstrating its effectiveness in monitoring and recognizing driver behavior accurately. The presented real-time Driver Monitoring System with facial landmark-based behavior recognition offers a practical and robust approach to enhance driver safety and alertness during their journeys.
ISSN:2045-2322
2045-2322
DOI:10.1038/s41598-023-44955-1