External Human–Machine Interfaces: The Effect of Display Location on Crossing Intentions and Eye Movements
Abstract
:1. Introduction
2. Methods
2.1. Participants
2.2. Apparatus
2.3. Independent Variable
2.4. Design of the Animated Video Clips
2.5. Procedure and Task
2.6. Dependent Variables
- We calculated the following dependent variables:
- Self-reported clarity on a scale from 0 (completely disagree) to 10 (completely agree).
- Percentage of time that the participant had the spacebar pressed since the moment the eHMI switched to ‘Waiting’ until 3 s after. A higher percentage indicated a better performance (i.e., indicating when it is safe to cross when it is indeed safe to cross).
- Percentage of time that the participant had the spacebar released since the moment the eHMI switched off before driving away until 3 s after. Again, a higher percentage indicates better performance (i.e., indicating that it is not safe to cross when it is indeed unsafe to cross).
- Gaze spread in pixels. We calculated, for each time sample, the distance between the participant’s x and y gaze coordinates and the mean x and y gaze coordinates of all participants. The gaze spread is the average distance from the moment the eHMI switched to ‘Waiting’ until 3 s later.
2.7. Statistical Analyses
3. Results
3.1. Self-Reported Clarity
3.2. Performance for Approaching Cars
3.3. Eye-Movements for Approaching Cars
3.4. Performance for Cars Driving off
4. Discussion
4.1. Performance
4.2. Eye-Tracking
4.3. Self-Reports
4.4. Limitations and Recommendations
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Conflicts of Interest
References
- De Clercq, G.K.; Dietrich, A.; Núñez Velasco, P.; De Winter, J.C.F.; Happee, R. External human-machine interfaces on automated vehicles: Effects on pedestrian crossing decisions. Hum. Factors 2019. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Bazilinskyy, P.; Dodou, D.; De Winter, J.C.F. Survey on eHMI concepts: The effect of text, color, and perspective. Transp. Res. F Traffic Psychol. Behav. 2019, 67, 175–194. [Google Scholar] [CrossRef]
- Rasouli, A.; Tsotsos, J.K. Autonomous vehicles that interact with pedestrians: A survey of theory and practice. IEEE Trans. Intell. Transp. Syst 2019, in press. [Google Scholar] [CrossRef] [Green Version]
- Schieben, A.; Wilbrink, M.; Kettwich, C.; Madigan, R.; Louw, T.; Merat, N. Designing the interaction of automated vehicles with other traffic participants: Design considerations based on human needs and expectations. Cognit. Technol. Work 2019, 21, 69–85. [Google Scholar] [CrossRef] [Green Version]
- Benderius, O.; Berger, C.; Lundgren, V.M. The best rated human-machine interface design for autonomous vehicles in the 2016 Grand Cooperative Driving Challenge. IEEE Trans. Intell. Transp. Syst. 2018, 19, 1302–1307. [Google Scholar] [CrossRef]
- Zhang, J.; Vinkhuyzen, E.; Cefkin, M. Evaluation of an autonomous vehicle external communication system concept: A survey study. In Advances in Human Aspects of Transportation. AHFE 2017. Advances in Intelligent Systems and Computing; Stanton, N., Ed.; Springer: Cham, Swizerland, 2017; Volume 597, pp. 650–661. [Google Scholar] [CrossRef]
- Werner, A. New colours for autonomous driving: An evaluation of chromaticities for the external lighting equipment of autonomous vehicles. Colour Turn 2018, 1. [Google Scholar] [CrossRef]
- Fridman, L.; Mehler, B.; Xia, L.; Yang, Y.; Facusse, L.Y.; Reimer, B. To walk or not to walk: Crowdsourced assessment of external vehicle-to-pedestrian displays. arXiv 2017, arXiv:1707.02698. [Google Scholar]
- Ackermann, C.; Beggiato, M.; Schubert, S.; Krems, J.F. An experimental study to investigate design and assessment criteria: What is important for communication between pedestrians and automated vehicles? Appl. Ergon. 2019, 75, 272–282. [Google Scholar] [CrossRef] [PubMed]
- Nissan. IDS Concept. Available online: https://www.nissan.co.uk/experience-nissan/concept-cars/ids-concept.html (accessed on 2 December 2019).
- Sweeney, M.; Pilarski, T.; Ross, W.P.; Liu, C. Light Output System for a Self-Driving Vehicle. U.S. Patent No. US9902311B2, 25 December 2018. [Google Scholar]
- Weber, F.; Chadowitz, R.; Schmidt, K.; Messerschmidt, J.; Fuest, T. Crossing the street across the globe: A study on the effects of eHMI on pedestrians in the US, Germany and China. In HCI in Mobility, Transport, and Automotive Systems. HCII 2019. Lecture Notes in Computer Science; Krömker, H., Ed.; Springer: Cham, Switzerland, 2019; Volume 11596, pp. 515–530. [Google Scholar] [CrossRef]
- Chang, C.M.; Toda, K.; Igarashi, T.; Miyata, M.; Kobayashi, Y. A video-based study comparing communication modalities between an autonomous car and a pedestrian. In Proceedings of the Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Toronto, ON, Canada, 23–25 September 2018; pp. 104–109. [Google Scholar] [CrossRef]
- Clamann, M.; Aubert, M.; Cummings, M.L. Evaluation of vehicle-to-pedestrian communication displays for autonomous vehicles. In Proceedings of the Transportation Research Board 96th Annual Meeting, Washington, DC, USA, 8–12 January 2017. [Google Scholar]
- Daimler. Autonomous Concept Car Smart Vision EQ Fortwo: Welcome to the Future of Car Sharing. Available online: https://media.daimler.com/marsMediaSite/en/instance/ko.xhtml?oid=29042725 (accessed on 2 December 2019).
- Joisten, P.; Alexandi, E.; Drews, R.; Klassen, L.; Petersohn, P.; Pick, A.; Abendroth, B. Displaying vehicle driving mode—Effects on pedestrian behavior and perceived safety. In International Conference on Human Systems Engineering and Design: Future Trends and Applications; Ahram, T., Karwowski, W., Pickl, S., Taiar, R., Eds.; Springer: Cham, Switzerland, 2019; pp. 250–256. [Google Scholar] [CrossRef]
- Otherson, I.; Conti-Kufner, A.S.; Dietrich, A.; Maruhn, P.; Bengler, K. Designing for automated vehicle and pedestrian communication: Perspectives on eHMIs from older and younger persons. Proceedings of the Human Factors and Ergonomics Society Europe Chapter 2018 Annual Conference, De Waard, D., Brookhuis, K., Coelho, D., Fairclough, S., Manzey, D., Naumann, A., Onnasch, L., Röttger, S., Toffetti, A., Wiczorek, R., Eds.; 2018; 135–148. [Google Scholar]
- Semcon. Who Sees You When the Car Drives Itself? Available online: https://semcon.com/smilingcar (accessed on 2 December 2019).
- Song, Y.E.; Lehsing, C.; Fuest, T.; Bengler, K. External HMIs and their effect on the interaction between pedestrians and automated vehicles. In International Conference on Intelligent Human Systems Integration; Karwowski, W., Ahram, T., Eds.; Springer: Cham, Switzerland, 2018; pp. 13–18. [Google Scholar] [CrossRef]
- Nuñez Velasco, J.P.; Farah, H.; Van Arem, B.; Hagenzieker, M.P. Studying pedestrians’ crossing behavior when interacting with automated vehicles using virtual reality. Transp. Res. F Traffic Psychol. Behav. 2019, 66, 1–14. [Google Scholar] [CrossRef] [Green Version]
- Stadler, S.; Cornet, H.; Theoto, T.N.; Frenkler, F. A tool, not a toy: Using virtual reality to evaluate the communication between autonomous vehicles and pedestrians. In Augmented Reality and Virtual Reality; Tom Dieck, M.C., Jung, T., Eds.; Springer: Cham, Switzerland, 2019; pp. 203–216. [Google Scholar] [CrossRef]
- Toyota. Concept-i. Available online: https://newsroom.toyota.eu/2018-toyota-concept-i (accessed on 2 December 2019).
- Deb, S.; Strawderman, L.J.; Carruth, D.W. Should I cross? Evaluating interface options for autonomous vehicle and pedestrian interaction. In Proceedings of the Road, Safety, and Simulation Conference, Iowa City, IA, USA, 14–17 October 2019. [Google Scholar]
- Hensch, A.C.; Neumann, I.; Beggiato, M.; Halama, J.; Krems, J.F. How should automated vehicles communicate?–Effects of a light-based communication approach in a Wizard-of-Oz study. In International Conference on Applied Human Factors and Ergonomics; Stanton, N., Ed.; Springer: Cham, Switzerland, 2019; pp. 79–91. [Google Scholar] [CrossRef]
- Mahadevan, K.; Somanath, S.; Sharlin, E. Communicating awareness and intent in autonomous vehicle-pedestrian interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada, 21–26 April 2018. [Google Scholar] [CrossRef]
- Vlakveld, W.; Van der Kint, S.; Hagezieker, M.P. Cyclists’ intentions to yield for automated cars at intersections when they have right of way: Results of an experiment using high-quality video animations. Submitted.
- Drive.ai. The Self-Driving Car Is Here. Available online: https://web.archive.org/web/20181025194248/https://www.drive.ai/# (accessed on 2 December 2019).
- Colley, A.; Häkkilä, J.; Pfleging, B.; Alt, F. A design space for external displays on cars. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct, Oldenburg, Germany, 24–27 September 2017; pp. 146–151. [Google Scholar] [CrossRef] [Green Version]
- Colley, A.; Häkkilä, J.; Forsman, M.T.; Pfleging, B.; Alt, F. Car exterior surface displays: Exploration in a real-world context. In Proceedings of the 7th ACM International Symposium on Pervasive Displays, Munich, Germany, 6–8 June 2018. [Google Scholar] [CrossRef]
- Dietrich, A.; Willrodt, J.-H.; Wagner, K.; Bengler, K. Projection-based external human-machine interfaces–Enabling interaction between automated vehicles and pedestrians. In Proceedings of the Driving Simulation Conference Europe, Antibes, France, 5–7 September 2018; pp. 43–50. [Google Scholar]
- Löcken, A.; Wintersberger, P.; Frison, A.K.; Riener, A. Investigating user requirements for communication between automated vehicles and vulnerable road users. In Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV’19), Paris, France, 9–12 June 2019; pp. 879–884. [Google Scholar] [CrossRef]
- Mitsubishi Electric. Mitsubishi Electric Introduces Road-Illuminating Directional Indicators. Available online: http://www.mitsubishielectric.com/news/2015/1023.html (accessed on 2 December 2019).
- Mercedes-Benz USA. Mercedes-Benz F 015 Luxury in Motion. Available online: https://www.youtube.com/watch?v=MaGb3570K1U (accessed on 2 December 2019).
- Senders, J.W.; Kristofferson, A.B.; Levison, W.H.; Dietrich, C.W.; Ward, J.L. The attentional demand of automobile driving. Highw. Res. Rec. 1967, 195, 15–33. [Google Scholar]
- AlAdawy, D.; Glazer, M.; Terwilliger, J.; Schmidt, H.; Domeyer, J.; Mehler, B.; Fridman, L. Eye contact between pedestrians and drivers. In Proceedings of the Tenth International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, Santa Fe, NM, USA, 24–27 June 2019; pp. 301–307. [Google Scholar]
- Dey, D.; Walker, F.; Martens, M.; Terken, J. Gaze patterns in pedestrian interaction with vehicles: Towards effective design of external human-machine interfaces for automated vehicles. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Utrecht, The Netherlands, 22–25 September 2019; pp. 369–378. [Google Scholar] [CrossRef]
- Bazilinskyy, P.; Wesdorp, D.; De Vlam, V.; Hopmans, B.; Visscher, J.; Dodou, D.; De Winter, J.C.F. Visual scanning behaviour on a parking lot. In preparation.
- Liu, C.; Wang, Z. Effect of narrowing traffic lanes on pavement damage. Int. J. Pavement Eng. 2003, 4, 177–180. [Google Scholar] [CrossRef]
- Cefkin, M.; Zhang, J.; Stayton, E.; Vinkhuyzen, E. Multi-methods research to examine external HMI for highly automated vehicles. In International Conference on Human-Computer Interaction; Springer: Cham, Switzerland, 2019; pp. 46–64. [Google Scholar] [CrossRef]
- Troel-Madec, L.; Alaimo, J.; Boissieux, L.; Chatagnon, S.; Borkoswki, S.; Spalanzani, A.; Vaufreydaz, D. eHMI positioning for autonomous vehicle/pedestrians interaction. In Proceedings of the IHM 2019—31e Conférence Francophone sur l’Interaction Homme-Machine, Grenoble, France, 10–13 December 2019; pp. 1–8. [Google Scholar]
- Ineos159challenge The Role of the Car. Available online: https://www.ineos159challenge.com/news/the-role-of-the-car/ (accessed on 2 December 2019).
- Powelleit, M.; Winkler, S.; Vollrath, M. Cooperation through communication–Using headlight technologies to improve traffic climate. Proceedings of the Human Factors and Ergonomics Society Europe Chapter 2018 Annual Conference, De Waard, D., Brookhuis, K., Coelho, D., Fairclough, S., Manzey, D., Naumann, A., Onnasch, L., Röttger, S., Toffetti, A., Wiczorek, R., Eds.; 2018; 149–160. [Google Scholar]
- Eisma, Y.B.; Borst, C.B.; Van Paassen, M.M.; De Winter, J.C.F. Augmented visual feedback: Cure or distraction? Submitted.
- Kooijman, L.; Happee, R.; De Winter, J.C.F. How do eHMIs affect pedestrians’ crossing behavior? A study using a head-mounted display combined with a motion suit. Information 2019, 10, 386. [Google Scholar] [CrossRef] [Green Version]
- Moore, D.; Currano, R.; Strack, G.E.; Sirkin, D. The case for implicit external human-machine interfaces for autonomous vehicles. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Utrecht, The Netherlands, 22–25 September 2019; pp. 295–307. [Google Scholar] [CrossRef]
- Wai, J.; Lubinski, D.; Benbow, C.P. Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. J. Educ. Psychol. 2009, 101, 817–835. [Google Scholar] [CrossRef]
- Salthouse, T.A. Aging and measures of processing speed. Biol. Psychol. 2000, 54, 35–54. [Google Scholar] [CrossRef]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Eisma, Y.B.; van Bergen, S.; ter Brake, S.M.; Hensen, M.T.T.; Tempelaar, W.J.; de Winter, J.C.F. External Human–Machine Interfaces: The Effect of Display Location on Crossing Intentions and Eye Movements. Information 2020, 11, 13. https://doi.org/10.3390/info11010013
Eisma YB, van Bergen S, ter Brake SM, Hensen MTT, Tempelaar WJ, de Winter JCF. External Human–Machine Interfaces: The Effect of Display Location on Crossing Intentions and Eye Movements. Information. 2020; 11(1):13. https://doi.org/10.3390/info11010013
Chicago/Turabian StyleEisma, Y. B., S. van Bergen, S. M. ter Brake, M. T. T. Hensen, W. J. Tempelaar, and J. C. F. de Winter. 2020. "External Human–Machine Interfaces: The Effect of Display Location on Crossing Intentions and Eye Movements" Information 11, no. 1: 13. https://doi.org/10.3390/info11010013
APA StyleEisma, Y. B., van Bergen, S., ter Brake, S. M., Hensen, M. T. T., Tempelaar, W. J., & de Winter, J. C. F. (2020). External Human–Machine Interfaces: The Effect of Display Location on Crossing Intentions and Eye Movements. Information, 11(1), 13. https://doi.org/10.3390/info11010013