The pioneering Vision AVTR concept vehicle first shown by Mercedes-Benz at CES 2020—just before COVID-19 pandemic shutdowns—has been revived for IAA Mobility 2021 duty in Munich. At the event, the company used the already pioneering concept as a vehicle to show its research into brain-control interfaces (BCIs). It presented how BCI technology works and gave a preview of how mind control could be another way of human-machine interaction with a vehicle.

While not available in everyday life just yet, Mercedes says that BCIs are no longer science fiction. For example, in medical research, BCI applications are considered a viable option for helping people with physical handicaps to become more independent. The new form of machine control could be used in car applications starting with functions such as selecting a navigation destination, switching interior ambient lighting, and changing the radio station.

“Mercedes-Benz is setting another milestone in the merging of man and machine with the research and development of brain-computer interface applications in cars,” said Britta Seeger, Member of the Board of Management of Daimler AG and Mercedes-Benz AG, responsible for Sales. “BCI technology has the potential to further enhance driving comfort in the future, for example. This opens up revolutionary possibilities for intuitive interaction with the vehicle.”

After a short calibration process in the IAA demo, a BCI device attached to the user’s head can analyze the measured brain waves and trigger a defined function. Visitors were able to experience controlling the user interface in the vehicle with their thoughts and interacting with it in real-time.

“With the continuous further development of our ‘Hey Mercedes’ voice assistant and the zero-layer concept of the MBUX Hyperscreen, we’ve already simplified vehicle operation radically,” said Markus Schäfer, Member of the Board of Management of Daimler AG and Mercedes-Benz AG; responsible for Daimler Group Research and Mercedes-Benz Cars COO. “BCI technology can make it possible to relieve the user even more in order to be able to focus on the driving experience.

“The VISION AVTR underlines the courage and pioneering spirit of our brand and is exactly the right concept to test and further develop BCI applications,” added Schäfer. This concept vehicle impressively depicts the future of mobility in which man, nature, and technology are in harmony with each other.”

At the IAA, the biometric interaction already enabled by the Vision AVTR concept is enhanced by a direct connection to the human brain. The company’s first approaches to mind control based on visual perception were demonstrated in a seat mockup of the concept.

For the demo, light dots were projected onto the fully digital dashboard. The BCI device, with electrodes attached to the back of the user’s head, recorded brain activity and established a direct connection to the vehicle after a one-minute calibration. As the user’s brain reacted to the visual stimuli on the dashboard, the BCI device measured neuronal activity at the cortex in real-time. It analyzed the measured brain waves and recognized on which light points the user was directing focus and full attention. The stronger the focus, the higher the neuronal activity. The device then triggered the targeted function in the vehicle.

Users were able to experience how quickly their own brain connected with the vehicle similar to the neuronal connection between the Na’vi and nature in the visionary Hollywood blockbuster “Avatar”—the inspiration for the concept vehicle. With the integration of BCI technology, Mercedes-Benz says it is continuing the revolutionary story of the Vision AVTR concept, which was a result of a collaboration with Disney.

The ground-breaking concept vehicle, whose name stands for Advanced Vehicle TRansformation, embodies the vision of Mercedes-Benz designers, engineers, and trend researchers for mobility in the distant future. The biometric connection enables a completely new interaction between man, machine, and nature in the autonomous-driving concept vehicle.

The concept car’s stretched “one-bow” organic design language is applied to exterior and interior by the team led by Gorden Wagener, Chief Design Officer Daimler Group. It uses many sustainable materials such as vegan Dinamica “leather” from Miko made from recycled materials; Karuun renewable fast-growing rattan from Out for Space GmbH; and organic, compostable battery technology created for closed-loop consumption. On the back of the vehicle are 33 bionic flaps that can communicate with the outside world using naturally flowing movements in subtle gestures.

Instead of a conventional steering wheel, the concept car has a multifunctional control element in the center console. By placing the hand on the control, the interior comes to life and the vehicle recognizes the user by their heart rate. A raise of a hand can project a menu onto the palm of the hand, allowing the user to choose among different vehicle functions.