Integrating OpenFace 2.0 Toolkit for Driver Attention Estimation in Challenging Accidental Scenarios

  • Javier Araluce*
  • , Luis M. Bergasa
  • , Carlos Gómez-Huélamo
  • , Rafael Barea
  • , Elena López-Guillén
  • , Felipe Arango
  • , Óscar Pérez-Gil
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Gaze estimation is a typical approach to monitor the driver attention on the road scene. This indicator is of great importance in safe driving and in the design of the takeover control strategy for a Level 3 and Level 4 automation system. Nowadays, most of eye gaze tracking techniques are intrusive and costly, which limits their applicability over real vehicles. On the other hand, current databases used for gaze validation face the driver attention task focused on critical situations in simulation but they do not encounter actual accidents. This paper presents a low-cost and non-intrusive camera-based gaze mapping system integrating the open-source state-of-the art OpenFace 2.0 Toolkit[3] to visualise the driver attention simulation on prerecorded real traffic scenes through a heat map. The proposal has been validated by using the recent and challenging public dataset DADA2000[9] which has 2000 video sequences with annotated driving scenarios based on real accidents. We compare our system with an expensive desktop-mounted eye-tracker, obtaining on par results and showing it is a good tool for driver attention monitoring able to be used in the design of take over systems and driving scenarios awareness systems for automated vehicles.

Original languageEnglish
Title of host publicationAdvances in Physical Agents II - Proceedings of the 21st International Workshop of Physical Agents WAF 2020
EditorsLuis M. Bergasa, Manuel Ocaña, Rafael Barea, Elena López-Guillén, Pedro Revenga
PublisherSpringer Science and Business Media Deutschland GmbH
Pages274-288
Number of pages15
ISBN (Print)9783030625788
DOIs
Publication statusPublished - 2021
Externally publishedYes
Event21st International Workshop of Physical Agents, WAF 2020 - Alcalá de Henares, Madrid, Spain
Duration: 19 Nov 202020 Nov 2020

Publication series

NameAdvances in Intelligent Systems and Computing
Volume1285
ISSN (Print)2194-5357
ISSN (Electronic)2194-5365

Conference

Conference21st International Workshop of Physical Agents, WAF 2020
Country/TerritorySpain
CityAlcalá de Henares, Madrid
Period19/11/2020/11/20

Keywords

  • Accidental scenarios
  • Computer vision
  • Driver attention
  • Gaze estimation
  • Heat map

Fingerprint

Dive into the research topics of 'Integrating OpenFace 2.0 Toolkit for Driver Attention Estimation in Challenging Accidental Scenarios'. Together they form a unique fingerprint.

Cite this