Multimodal Interaction in the Car

The full title is Multimodal Interaction in the Car.

Description

The Multimodal Interaction in the Car aim at facilitating the driver-car interaction with intuitive multimodal interaction so that users can use functionality and services in the car (e.g., navigation, entertainment) effectively and efficiently and without being distracted from monitoring the road and driving the vehicle.

Approach

The approach explores, developes, and evaluates multiple modalities (such as gestures, speech, eyetracking) that are orchestrated for optimal driver-car interaction.

Partners

• Bayerische Motoren Werke Aktiengesellschaft (BMW), Forschungs- und Innovationszentrum (FIZ)
• University of Bamberg

People

Prof. Dr. Tom Gross, Scientific Advisor
Florian Roider

Funding

The project is partly funded by Bayerische Motoren Werke Aktiengesellschaft (BMW) and by University of Bamberg; it started in 2015.

Further Information

Publications

Roider, Florian, Ruemelin, Sonja, Pfleging, Sebastian and Gross, Tom. Investigating the Effects of Modality Switches on Driver Distraction and Interaction Efficiency in the Car. Journal on Multimodal User Interfaces 13 (Mar. 2019). pp. 89-97. (ISSN: 1783-7677). doi:doi.org/10.1007/s12193-019-00297-9.

Braun, Michael, Roider, Florian, Alt, Florian and Gross, Tom. Automotive Research in the Public Space: Towards Deployment-Based Prototypes For Real Users. In Adjunct Proceedings of the 10th ACM International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI 2018 (Sept. 23-25, Toronto, Canada). ACM, N.Y., 2018. pp. 181-185. (ISBN: 978-1-4503-5947-4/18/09). doi:10.1145/3239092.3265964.

Roider, Florian and Gross, Tom. I See Your Point: Integrating Gaze to Enhance Pointing Gesture Accuracy While Driving. In Proceedings of the 10th ACM International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI 2018 (Sept. 23-25, Toronto, Canada). ACM, N.Y., 2018. pp. 351-358. (ISBN: 978-1-4503-5946-7/18/09). doi:10.1145/3239060.3239084.

Roider, Florian, Reisig, Lars and Gross, Tom. Just Look: The Benefits of Gaze-Activated Voice Input in the Car. In Adjunct Proceedings of the 10th ACM International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI 2018 (Sept. 23-25, Toronto, Canada). ACM, N.Y., 2018. pp. 210-214. (ISBN: 978-1-4503-5947-4/18/09). doi:10.1145/3239092.3265968.

Roider, Florian, Ruemelin, Sonja and Gross, Tom. Using Visual Cues to Leverage the Use of Speech Input in the Vehicle (Honorable Mention Paper Award). In Proceedings of the 13th International Conference on Persuasive Technology - Persuasive Technology 2018 (Apr. 16-19, Waterloo, Canada). Springer-Verlag, Heidelberg, 2018. pp. 120-131. (ISBN: 978-3-319-78978-1_10). doi:10.1007/978-3-319-78978-1_10.

Roider, Florian, Ruemelin, Sonja, Pfleging, Sebastian and Gross, Tom. The Effects of Situational Demands on Gaze, Speech, and Gesture Input in the Vehicle. In Proceedings of the 9th ACM International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI 2017 (Sept. 24-27, Oldenburg, Germany). ACM, N.Y., 2017. pp. 94-102. (ISBN: 978-1-4503-5150-8).