A Novel EEG-Based Assessment of Distraction in Simulated Driving under Different Road and Traffic Conditions
Abstract
:1. Introduction
1.1. Human Distraction in Automotive
1.2. Psychological Definition of Distraction
- -
- Selectivity: attention may be focused, e.g., it may be centered on the color of a road sign, or divided, i.e., simultaneously directed at several eventsIntensity: attention may be considered alertness, e.g., put in operation when stopped at a red light; and sustained (vigilance), which allows one to continue to respond in a reasonable manner during the period in which a series of events may appear in an unforeseen manner.
- -
- Structural interference: if two tasks share the use of the same processing mechanism or require the same processing stage, attention will scarcely be divided due to physical and cognitive structural constraints, and one of the tasks will be identified as a distraction.
- -
- Resource interference: non-automatic mental operations require a certain number of attentional resources, and the task that receives the residual resources is identified as the secondary task. For instance, even if the secondary task does not require looking away from the road, it is possible that it will reduce driving performance given the modulation of attention and cognitive resources between two or more tasks.
1.3. Neurophysiological Characterization of Distraction: State of the Art
1.4. Objective of the Presented Study
- (i)
- developing an EEG-based “Distraction index” obtained by the combination of the driver’s mental workload and attention neurometrics on the basis of EEG data coming from an experimental study in simulated driving settings under different road and traffic conditions;
- (ii)
- investigating and validating its reliability by analyzing together subjective (i.e., self-assessment) and behavioral (driving parameters and ocular movements) measures coming from the participants themselves.
2. Materials and Methods
2.1. Participants
2.2. Experimental Design and Protocol
- City baseline: represented the focused driving task in an urban environment without any secondary tasks.
- Highway baseline: represented the focused driving task in a highway environment without any secondary tasks.
- Focused: the participants were explicitly required to be focused while driving, without any secondary tasks.
- ACPT: represented the Auditory Continuous Performance Task. This secondary task was specifically designed to elicit light cognitive distraction. Here participants were instructed to perform an auditory working memory task by listening to a series of auditory stimuli (i.e., randomized sequence of letters) and responding to a specific sequence of letters by answering orally while ignoring the other letters.
- Matrix: represented the task in which the participants were asked to perform cognitively demanding pattern recognition and completion. This secondary task was designed specifically for eliciting cognitive and visual distraction. Participants were asked to identify the correct geometrical shape (i.e., circles) among a set of different shapes (i.e., circles, triangles, and squares) presented on the infotainment by providing oral feedback. Since participants did give their answers orally, the task did not induce manual distraction.
- SURT: consisted of a visual search task in which participants must search for a slightly unique cue in a large set of similar cues. Participants were in fact asked to identify the slightly larger circle among a set of circles. Such a secondary task was designed for eliciting visual, and manual distraction because the participants had to indicate the unique cue by pressing their finger on the infotainment touch screen [33].
2.3. Subjective and Behavioral Data Collection and Analysis
2.4. Neurophysiological Data Collection and Analysis
- -
- Theta = [IAF − 8 ÷ IAF − 4] Hz;
- -
- Alpha = [IAF − 2 ÷ IAF + 2] Hz;
- -
- Beta = [IAF + 2 ÷ IAF + 20] Hz;
2.5. Statistical Analyses
3. Results
3.1. Subjective Results
3.2. Behavioral Results
3.3. Neurophysiological Results: EEG-Based Distraction Index
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- World Health Organization. Road Traffic Injuries. Available online: https://www.who.int/news-room/fact-sheets/detail/road-traffic-injuries (accessed on 19 January 2022).
- Tavakkoli, M.; Karim, A.; Fischer, F.B.; Llamas, L.M.; Raoofi, A.; Zafar, S.; Fruchtman, C.S.; de Savigny, D.; Takian, A.; Antillon, M.; et al. From Public Health Policy to Impact for COVID-19: A Multi-Country Case Study in Switzerland, Spain, Iran and Pakistan. Int. J. Public Health 2022, 67, 1604969. [Google Scholar] [CrossRef] [PubMed]
- Kaye, S.A.; Demmel, S.; Oviedo-Trespalacios, O.; Griffin, W.; Lewis, I. Young drivers’ takeover time in a conditional automated vehicle: The effects of hand-held mobile phone use and future intentions to use automated vehicles. Transp. Res. Part F Traffic Psychol. Behav. 2021, 78, 16–29. [Google Scholar] [CrossRef]
- Oviedo-Trespalacios, O.; Haque, M.M.; King, M.; Washington, S. Effects of road infrastructure and traffic complexity in speed adaptation behaviour of distracted drivers. Accid. Anal. Prev. 2017, 101, 67–77. [Google Scholar] [CrossRef] [PubMed]
- Oviedo-Trespalacios, O.; Truelove, V.; Watson, B.; Hinton, J.A. The impact of road advertising signs on driver behaviour and implications for road safety: A critical systematic review. Transp. Res. Part A Policy Pract. 2019, 122, 85–98. [Google Scholar] [CrossRef]
- Naumann, R.B.; Dellinger, A.M. Mobile Device Use While Driving—United States and Seven European Countries, 2011. Morb. Mortal. Wkly. Rep. 2013, 62, 177–182. [Google Scholar]
- Kashevnik, A.; Shchedrin, R.; Kaiser, C.; Stocker, A. Driver Distraction Detection Methods: A Literature Review and Framework. IEEE Access 2021, 9, 60063–60076. [Google Scholar] [CrossRef]
- Ortiz, C.; Ortiz-Peregrina, S.; Castro, J.J.; Casares-López, M.; Salas, C. Driver distraction by smartphone use (WhatsApp) in different age groups. Accid. Anal. Prev. 2018, 117, 239–249. [Google Scholar] [CrossRef]
- Kass, S.J.; Cole, K.S.; Stanny, C.J. Effects of distraction and experience on situation awareness and simulated driving. Transp. Res. Part. F Traffic Psychol. Behav. 2007, 10, 321–329. [Google Scholar] [CrossRef]
- Gazder, U.; Assi, K.J. Determining driver perceptions about distractions and modeling their effects on driving behavior at different age groups. J. Traffic Transp. Eng. Engl. Ed. 2022, 9, 33–43. [Google Scholar] [CrossRef]
- Moslemi, N.; Soryani, M.; Azmi, R. Computer vision-based recognition of driver distraction: A review. Concurr. Comput. 2021, 33, e6475. [Google Scholar] [CrossRef]
- Iio, K.; Guo, X.; Lord, D. Examining driver distraction in the context of driving speed: An observational study using disruptive technology and naturalistic data. Accid. Anal. Prev. 2021, 153, 105983. [Google Scholar] [CrossRef]
- Kountouriotis, G.K.; Merat, N. Leading to distraction: Driver distraction, lead car, and road environment. Accid. Anal. Prev. 2016, 89, 22–30. [Google Scholar] [CrossRef] [PubMed]
- McEvoy, S.P.; Stevenson, M.R.; Woodward, M. The impact of driver distraction on road safety: Results from a representative survey in two Australian states. Inj. Prev. 2006, 12, 242. [Google Scholar] [CrossRef]
- Robbins, C.J.; Fotios, S. Road lighting and distraction whilst driving: Establishing the significant types of distraction. Light. Res. Technol. 2021, 53, 30–40. [Google Scholar] [CrossRef]
- Cohen, R.A. Attention. In Encyclopedia of Clinical Neuropsychology; Springer: Berlin/Heidelberg, Germany, 2011; pp. 282–292. [Google Scholar] [CrossRef]
- van Zomeren, A.H.; Brouwer, W.H. Clinical Neuropsychology of Attention; Oxford University Press: Oxford, UK, 1994; Available online: https://psycnet.apa.org/record/1994-98150-000 (accessed on 12 January 2024).
- Sebastiani, M.; Di Flumeri, G.; Aricò, P.; Sciaraffa, N.; Babiloni, F.; Borghini, G. Neurophysiological Vigilance Characterisation and Assessment: Laboratory and Realistic Validations Involving Professional Air Traffic Controllers. Brain Sci. 2020, 10, 48. [Google Scholar] [CrossRef] [PubMed]
- Taatgen, N.A.; van Vugt, M.K.; Daamen, J.; Katidioti, I.; Huijser, S.; Borst, J.P. The resource-availability model of distraction and mind-wandering. Cogn. Syst. Res. 2021, 68, 84–104. [Google Scholar] [CrossRef]
- Nijboer, M.; Borst, J.P.; van Rijn, H.; Taatgen, N.A. Driving and multitasking: The good, the bad, and the dangerous. Front. Psychol. 2016, 7, 198026. [Google Scholar] [CrossRef]
- Lavie, N. Distracted and confused? Selective attention under load. Trends Cogn. Sci. 2005, 9, 75–82. [Google Scholar] [CrossRef]
- Smallwood, J.; Schooler, J.W. The Science of Mind Wandering: Empirically Navigating the Stream of Consciousness. Annu. Rev. Psychol. 2015, 66, 487–518. [Google Scholar] [CrossRef]
- Giambra, L.M. Task-unrelated-thought frequency as a function of age: A laboratory study. Psychol. Aging 1989, 4, 136–143. [Google Scholar] [CrossRef]
- Li, G.; Wu, X.; Eichberger, A.; Green, P.; Olaverri-Monreal, C.; Yan, W.; Qin, Y.; Li, Y. Drivers’ EEG Responses to Different Distraction Tasks. Automot. Innov. 2023, 6, 20–31. [Google Scholar] [CrossRef]
- Kumar, S.P.; Selvaraj, J.; Krishnakumar, R.; Sahayadhas, A. Detecting Distraction in Drivers using Electroencephalogram (EEG) Signals. In Proceedings of the 4th International Conference on Computing Methodologies and Communication, ICCMC 2020, Erode, India, 11–13 March 2020; pp. 635–639. [Google Scholar] [CrossRef]
- Li, G.; Yuan, Y.; Ouyang, D.; Zhang, L.; Yuan, B.; Chang, X.; Guo, Z.; Guo, G. Driver Distraction from the EEG Perspective: A Review. IEEE Sens. J. 2023, 24, 2329–2349. [Google Scholar] [CrossRef]
- Perera, D.; Wang, Y.-K.; Lin, C.-T.; Nguyen, H.; Chai, R. Improving EEG-Based Driver Distraction Classification Using Brain Connectivity Estimators. Sensors 2022, 22, 6230. [Google Scholar] [CrossRef]
- Martínez Beltrán, E.T.; Quiles Pérez, M.; López Bernal, S.; Martínez Pérez, G.; Huertas Celdrán, A. SAFECAR: A Brain-Computer Interface and intelligent framework to detect drivers’ distractions. Expert. Syst. Appl. 2022, 203, 117402. [Google Scholar] [CrossRef]
- Ke, J.; Zhang, M.; Luo, X.; Chen, J. Monitoring distraction of construction workers caused by noise using a wearable Electroencephalography (EEG) device. Autom. Constr. 2021, 125, 103598. [Google Scholar] [CrossRef]
- Gjoreski, M.; Gams, M.Z.; Luštrek, M.; Genc, P.; Garbas, J.U.; Hassan, T. Machine Learning and End-to-End Deep Learning for Monitoring Driver Distractions from Physiological and Visual Signals. IEEE Access 2020, 8, 70590–70603. [Google Scholar] [CrossRef]
- Fan, C.; Peng, Y.; Peng, S.; Zhang, H.; Wu, Y.; Kwong, S. Detection of Train Driver Fatigue and Distraction Based on Forehead EEG: A Time-Series Ensemble Learning Method. IEEE Trans. Intell. Transp. Syst. 2022, 23, 13559–13569. [Google Scholar] [CrossRef]
- Zuo, X.; Zhang, C.; Cong, F.; Zhao, J.; Hamalainen, T. Driver Distraction Detection Using Bidirectional Long Short-Term Network Based on Multiscale Entropy of EEG. IEEE Trans. Intell. Transp. Syst. 2022, 23, 19309–19322. [Google Scholar] [CrossRef]
- Huemer, A.K.; Vollrath, M. Learning the Lane Change Task: Comparing different training regimes in semi-paced and continuous secondary tasks. Appl. Ergon. 2012, 43, 940–947. [Google Scholar] [CrossRef] [PubMed]
- Harms, I.M. Distracted by familiarity: Implications of ‘autopilot’ as a default cognitive mode. Transp. Res. Part F Traffic Psychol. Behav. 2023, 99, 274–288. [Google Scholar] [CrossRef]
- Sciaraffa, N.; Di Flumeri, G.; Germano, D.; Giorgi, A.; Di Florio, A.; Borghini, G.; Vozzi, A.; Ronca, V.; Babiloni, F.; Aricò, P. Evaluation of a New Lightweight EEG Technology for Translational Applications of Passive Brain-Computer Interfaces. Front. Hum. Neurosci. 2022, 16, 458. [Google Scholar] [CrossRef]
- Cartocci, G.; Inguscio, B.M.S.; Giliberto, G.; Vozzi, A.; Giorgi, A.; Greco, A.; Babiloni, F.; Attanasio, G. Listening Effort in Tinnitus: A Pilot Study Employing a Light EEG Headset and Skin Conductance Assessment during the Listening to a Continuous Speech Stimulus under Different SNR Conditions. Brain Sci. 2023, 13, 1084. [Google Scholar] [CrossRef]
- Ronca, V.; Di Flumeri, G.; Vozzi, A.; Giorgi, A.; Arico, P.; Sciaraffa, N.; Babiloni, F.; Borghini, G. Validation of an EEG-based Neurometric for online monitoring and detection of mental drowsiness while driving. In Proceedings of the 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Glasgow, UK, 11–15 July 2022; pp. 3714–3717. [Google Scholar] [CrossRef]
- Di Flumeri, G.; Borghini, G.; Aricò, P.; Sciaraffa, N.; Lanzi, P.; Pozzi, S.; Vignali, V.; Lantieri, C.; Bichicchi, A.; Simone, A.; et al. EEG-based mental workload assessment during real driving: A taxonomic tool for neuroergonomics in highly automated environments. In Neuroergonomics: The Brain at Work and in Everyday Life; Elsevier: Amsterdam, The Netherlands, 2018; pp. 121–126. [Google Scholar] [CrossRef]
- Somers, B.; Francart, T.; Bertrand, A. A generic EEG artifact removal algorithm based on the multi-channel Wiener filter. J. Neural Eng. 2018, 15, 036007. [Google Scholar] [CrossRef]
- Di Flumeri, G.; Arico, P.; Borghini, G.; Colosimo, A.; Babiloni, F. A new regression-based method for the eye blinks artifacts correction in the EEG signal, without using any EOG channel. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; Institute of Electrical and Electronics Engineers Inc.: New York, NY, USA, 2016; pp. 3187–3190. [Google Scholar] [CrossRef]
- Delorme, A.; Makeig, S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 2004, 134, 9–21. [Google Scholar] [CrossRef] [PubMed]
- Ronca, V.; Uflaz, E.; Turan, O.; Bantan, H.; MacKinnon, S.N.; Lommi, A.; Pozzi, S.; Kurt, R.E.; Arslan, O.; Kurt, Y.B.; et al. Neurophysiological Assessment of An Innovative Maritime Safety System in Terms of Ship Operators’ Mental Workload, Stress, and Attention in the Full Mission Bridge Simulator. Brain Sci. 2023, 13, 1319. [Google Scholar] [CrossRef]
- Di Flumeri, G.; Ronca, V.; Giorgi, A.; Vozzi, A.; Aricò, P.; Sciaraffa, N.; Zeng, H.; Dai, G.; Kong, W.; Babiloni, F.; et al. EEG-Based Index for Timely Detecting User’s Drowsiness Occurrence in Automotive Applications. Front. Hum. Neurosci. 2022, 16, 866118. [Google Scholar] [CrossRef]
- Skrandies, W. Global field power and topographic similarity. Brain Topogr. 1990, 3, 137–141. [Google Scholar] [CrossRef] [PubMed]
- Di Flumeri, G.; Herrero, M.T.; Trettel, A.; Cherubino, P.; Maglione, A.G.; Colosimo, A.; Moneta, E.; Peparaio, M.; Babiloni, F. EEG Frontal Asymmetry Related to Pleasantness of Olfactory Stimuli in Young Subjects; Springer: Berlin/Heidelberg, Germany, 2016; pp. 373–381. [Google Scholar] [CrossRef]
- Klimesch, W. EEG alpha and theta oscillations reflect cognitive and memory performance: A review and analysis. Brain Res. Rev. 1999, 29, 169–195. [Google Scholar] [CrossRef]
- Babiloni, F. Mental Workload Monitoring: New Perspectives from Neuroscience. In Communications in Computer and Information Science; Springer: Berlin/Heidelberg, Germany, 2019; pp. 3–19. [Google Scholar] [CrossRef]
- Di Flumeri, G.; Borghini, G.; Aricò, P.; Sciaraffa, N.; Lanzi, P.; Pozzi, S.; Vignali, V.; Lantieri, C.; Bichicchi, A.; Simone, A.; et al. EEG-based mental workload neurometric to evaluate the impact of different traffic and road conditions in real driving settings. Front. Hum. Neurosci. 2018, 12, 509. [Google Scholar] [CrossRef] [PubMed]
- Borghini, G.; Ronca, V.; Vozzi, A.; Aricò, P.; Di Flumeri, G.; Babiloni, F. Monitoring performance of professional and occupational operators. In Handbook of Clinical Neurology; Elsevier: Amsterdam, The Netherlands, 2020; Volume 168, pp. 199–205. [Google Scholar] [CrossRef]
- Young, M.S.; Brookhuis, K.A.; Wickens, C.D.; Hancock, P.A. State of science: Mental workload in ergonomics. Ergonomics 2015, 58, 1–17. [Google Scholar] [CrossRef]
- Cartocci, G.; Modica, E.; Rossi, D.; Maglione, A.G.; Venuti, I.; Rossi, G.; Corsi, E.; Babiloni, F. A pilot study on the neurometric evaluation of ‘effective’ and ‘ineffective’ antismoking public service announcements. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 4597–4600. [Google Scholar] [CrossRef]
- Inguscio, B.M.S.; Cartocci, G.; Modica, E.; Rossi, D.; Martinez-Levy, A.C.; Cherubino, P.; Tamborra, L.; Babiloni, F. Smoke signals: A study of the neurophysiological reaction of smokers and non-smokers to smoking cues inserted into antismoking public service announcements. Int. J. Psychophysiol. 2021, 167, 22–29. [Google Scholar] [CrossRef]
- Arns, M.; Conners, C.K.; Kraemer, H.C. A Decade of EEG Theta/Beta Ratio Research in ADHD: A Meta-Analysis. J. Atten. Disord. 2013, 17, 374–383. [Google Scholar] [CrossRef]
- Heinrich, H.; Busch, K.; Studer, P.; Erbe, K.; Moll, G.H.; Kratz, O. EEG spectral analysis of attention in ADHD: Implications for neurofeedback training? Front. Hum. Neurosci. 2014, 8, 99913. [Google Scholar] [CrossRef]
- Ma, X.; Qiu, S.; He, H. Time-Distributed Attention Network for EEG-Based Motor Imagery Decoding from the Same Limb. IEEE Trans. Neural Syst. Rehabil. Eng. 2022, 30, 496–508. [Google Scholar] [CrossRef]
- Morillas-Romero, A.; Tortella-Feliu, M.; Bornas, X.; Putman, P. Spontaneous EEG theta/beta ratio and delta-beta coupling in relation to attentional network functioning and self-reported attentional control. Cogn. Affect. Behav. Neurosci. 2015, 15, 598–606. [Google Scholar] [CrossRef]
- Inguscio, B.M.S.; Cartocci, G.; Sciaraffa, N.; Nicastri, M.; Giallini, I.; Greco, A.; Babiloni, F.; Mancini, P. Gamma-Band Modulation in Parietal Area as the Electroencephalographic Signature for Performance in Auditory-Verbal Working Memory: An Exploratory Pilot Study in Hearing and Unilateral Cochlear Implant Children. Brain Sci 2022, 12, 1291. [Google Scholar] [CrossRef]
- Ronca, V.; Martinez-Levy, A.C.; Vozzi, A.; Giorgi, A.; Aricò, P.; Capotorto, R.; Borghini, G.; Babiloni, F.; Di Flumeri, G. Wearable Technologies for Electrodermal and Cardiac Activity Measurements: A Comparison between Fitbit Sense, Empatica E4 and Shimmer GSR3+. Sensors 2023, 23, 5847. [Google Scholar] [CrossRef] [PubMed]
- Bakdash, J.Z.; Marusich, L.R. Repeated measures correlation. Front. Psychol. 2017, 8, 456. [Google Scholar] [CrossRef]
- Kircher, K.; Ahlstrom, C. The impact of tunnel design and lighting on the performance of attentive and visually distracted drivers. Accid. Anal. Prev. 2012, 47, 153–161. [Google Scholar] [CrossRef]
- Ziv, G. Gaze Behavior and Visual Attention: A Review of Eye Tracking Studies in Aviation. Int. J. Aviat. Psychol. 2016, 26, 75–104. [Google Scholar] [CrossRef]
- Ji, Q.; Yang, X. Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-Time Imaging 2002, 8, 357–377. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Ronca, V.; Brambati, F.; Napoletano, L.; Marx, C.; Trösterer, S.; Vozzi, A.; Aricò, P.; Giorgi, A.; Capotorto, R.; Borghini, G.; et al. A Novel EEG-Based Assessment of Distraction in Simulated Driving under Different Road and Traffic Conditions. Brain Sci. 2024, 14, 193. https://doi.org/10.3390/brainsci14030193
Ronca V, Brambati F, Napoletano L, Marx C, Trösterer S, Vozzi A, Aricò P, Giorgi A, Capotorto R, Borghini G, et al. A Novel EEG-Based Assessment of Distraction in Simulated Driving under Different Road and Traffic Conditions. Brain Sciences. 2024; 14(3):193. https://doi.org/10.3390/brainsci14030193
Chicago/Turabian StyleRonca, Vincenzo, Francois Brambati, Linda Napoletano, Cyril Marx, Sandra Trösterer, Alessia Vozzi, Pietro Aricò, Andrea Giorgi, Rossella Capotorto, Gianluca Borghini, and et al. 2024. "A Novel EEG-Based Assessment of Distraction in Simulated Driving under Different Road and Traffic Conditions" Brain Sciences 14, no. 3: 193. https://doi.org/10.3390/brainsci14030193
APA StyleRonca, V., Brambati, F., Napoletano, L., Marx, C., Trösterer, S., Vozzi, A., Aricò, P., Giorgi, A., Capotorto, R., Borghini, G., Babiloni, F., & Di Flumeri, G. (2024). A Novel EEG-Based Assessment of Distraction in Simulated Driving under Different Road and Traffic Conditions. Brain Sciences, 14(3), 193. https://doi.org/10.3390/brainsci14030193