AUTONEWS

Drivers struggle to multitask when using dashboard touchscreens, study finds

Once the domain of buttons and knobs, car dashboards are increasingly home to large touchscreens. While that makes following a mapping app easier, it also means drivers can't feel their way to a control; they have to look. But how does that visual component affect driving?

New research from the University of Washington and Toyota Research Institute, or TRI, explores how drivers balance driving and using touchscreens while distracted.

In the study, participants drove in a vehicle simulator, interacted with a touchscreen and completed memory tests that mimic the mental effort demanded by traffic conditions and other distractions. The team found that when people multitasked, their driving and touchscreen use both suffered.

The car drifted more in the lane while people used touchscreens, and their speed and accuracy with the screen declined when driving. The effects increased further when they added the memory task.

These results could help auto manufacturers design safer, more responsive touchscreens and in-car interfaces.

The team presented the research at the ACM Symposium on User Interface Software and Technology in Busan, Korea.

"We all know it's dangerous to use your phone while driving," said co-senior author James Fogarty, a UW professor in the Paul G. Allen School of Computer Science & Engineering. "But what about the car's touchscreen? We wanted to understand that interaction so we could design interfaces specifically for drivers."

As the study's 16 participants drove the simulator, sensors tracked their gaze, finger movements, pupil diameter and electrodermal activity. The last two are common ways to measure mental effort, or "cognitive load." For instance, pupils tend to grow when people are concentrating.

While driving, participants had to touch specific targets on a 12-inch touchscreen, similar to how they would interact with apps and widgets. They did this while completing three levels of an "N-back task," a memory test in which the participants hear a series of numbers, 2.5 seconds apart, and have to repeat specific digits.

The participants' performance changed significantly under different conditions:

When interacting with the touchscreen, participants drifted side to side in their lane 42% more often. Increasing cognitive load had no effect on the results.

Touchscreen accuracy and speed decreased 58% when driving, then another 17% under high cognitive load.

Each glance at the touchscreen was 26.3% shorter under high cognitive load.

A "hand-before-eye" phenomenon, in which drivers reached for a control before looking at it, increased from 63% to 71% as memory tasks were introduced.

The team also found that increasing the size of the target areas participants were trying to touch did not improve their performance.

"If people struggle with accuracy on a screen, usually you want to make bigger buttons," said Xiyuan Alan Shen, a UW doctoral student in the Allen School. "But in this case, since people move their hand to the screen before touching, the thing that takes time is the visual search."

Based on these findings, the researchers suggest future in-car touchscreen systems might use simple sensors in the car—eye tracking, or touch sensors on the steering wheel—to monitor drivers' attention and cognitive load. Based on these readings, the car's system might adjust the touchscreen's interface to make important controls more prominent and safer to access.

"Touchscreens are widespread today in automobile dashboards, so it is vital to understand how interacting with touchscreens affects drivers and driving," said co-senior author Jacob O. Wobbrock, a UW professor in the Information School.

"Our research is some of the first that scientifically examines this issue, suggesting ways for making these interfaces safer and more effective."

The study...In partnership with Toyota Research Institute, UW researchers are exploring how modern touch screens in cars affect driving now that dashboard knobs and buttons are increasingly a thing of the past. The results could help auto manufacturers design safer, more responsive screens and in-car interfaces.

The team’s study, which was presented this fall at the ACM Symposium on User Interface Software and Technology in Busan, Korea, adds to what we already know about the dangers of distracted driving when it comes to phone use.

Participants driving a vehicle simulator and interacting with a touch screen (see video above) were given memory tests that mimic the mental effort demanded by traffic conditions and other distractions, the UW reported. Sensors tracked their gaze, finger movements, pupil diameter and electrodermal activity.

While driving, participants had to touch specific targets on a 12-inch touch screen, similar to how they would interact with apps and widgets. They did this while completing three levels of an “N-back task,” a memory test in which the participants hear a series of numbers, 2.5 seconds apart, and have to repeat specific digits. 

Researchers found that when people try to multitask behind the wheel, their driving and their ability to use a touch screen both suffer. The simulator car drifted in its lane, and speed and accuracy using the screen declined while driving.

“Touch screens are widespread today in automobile dashboards, so it is vital to understand how interacting with touch screens affects drivers and driving,” said co-senior author Jacob O. Wobbrock, a UW professor in the Information School. “Our research is some of the first that scientifically examines this issue, suggesting ways for making these interfaces safer and more effective.”

Provided by University of Washington