Assistant on the Go: How In-vehicle Infotainment Systems (IVI) are Reshaping Driver Experience

09-11-2023

<span style="font-family: "Segoe UI", sans-serif; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">The origin of in-vehicle infotainment systems (IVI) can be traced back to as early as the 1900s, with the push-button AM radios being considered the first-ever feature. Ever since, IVI systems have become indispensable in creating a spectacular in-vehicle experience, so much so that cars have been famously dubbed as “smartphones on wheels.” But with advancements in automotive technology, including autonomous vehicles, and the growing demand for a personalized experience, the role of IVI may have evolved to a point where they are turning cars into personal assistants on the go.<o:p></o:p><h2 style="margin: 7.5pt 0in; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">Automotive trends driving IVI innovations<o:p></o:p></h2><ol style="margin-top:0in" start="1" type="1"> <li class="MsoNormal" style="text-align: left; margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">    1. Demand for advanced features:<o:p></o:p></li> </ol><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">Demand for a bespoke driver experience has been rising steadily, so much so that advanced features have become a critical deciding factor for choosing car brands. Indeed, in a survey by Deloitte, advanced features are ranked by Japanese drivers as the most important factor for choosing car brands for their next purchase. The factor also makes the top list in other major markets, ranked second in the US, South East Asia, and India, and third in South Korea and China <a href="https://www.deloitte.com/global/en/Industries/automotive/perspectives/global-automotive-consumer-study.html">[1]</a>. Although features can vary from brand to brand, here are some of the most-wanted features by drivers, according to AutoPacific's 2022 Future Attribute Demand Study <a href="https://www.autopacific.com/autopacific-insights">[2]:</a><o:p></o:p><ul style="margin-top:0in" type="disc"> <li class="MsoNormal" style="margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">        - Parking sensors, rear and front: voted by 41% of the respondents<o:p></o:p></li> <li class="MsoNormal" style="margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">        - Distracted or drowsy driver monitoring system: voted by 39%<o:p></o:p></li> <li class="MsoNormal" style="margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">        - Tire fill complete alert: voted by 39%  <o:p></o:p></li> </ul><ol style="margin-top:0in" start="2" type="1"> <li class="MsoNormal" style="text-align: left; margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">    2.Rising autonomous vehicle market:<o:p></o:p></li> </ol><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">Autonomous vehicles have emerged as a megatrend in the automotive industry, with McKinsey & Company predicting that 12% of global vehicles sold will be equipped with L3+ autonomous technologies by 2030 and 37% equipped with advanced autonomous technology by 2035. Despite customers’ rising concerns about the safety of fully autonomous vehicles, they are highly interested in advanced autonomous driving features, with 25% of the respondents showing such enthusiasm and two-thirds showing a willingness to pay a premium of US$ 10,000 for advanced features <a href="https://www.mckinsey.com/industries/automotive-and-assembly/our-insights/autonomous-drivings-future-convenient-and-connected">[3]</a>.<o:p></o:p><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">As safety plays a deciding role in the future of autonomous vehicles, the Advanced Driver Assistance System (ADAS) has been strongly advocated as part of the regulatory requirements for launching autonomous vehicles. For instance, the European Commission recently introduced new rules on advanced safety features in an attempt to improve road safety and enable fully automated vehicles <a href="https://ec.europa.eu/commission/presscorner/detail/en/IP_22_4312">[4]</a>. The regulations set out additional requirements for certain vehicles:<o:p></o:p><ul style="margin-top:0in" type="disc"> <li class="MsoNormal" style="text-align: left; margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">        - All road vehicles: require features including intelligent speed assistance and attention warning in case of driver drowsiness, etc.<o:p></o:p></li> <li class="MsoNormal" style="text-align: left; margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">        - Cars and vans: lane keeping, automated braking<o:p></o:p></li> <li class="MsoNormal" style="margin-top: 11.25pt; margin-bottom: 0.0001pt; text-align: justify; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;"><div style="text-align: left;">        - Trucks and busses: blind spot monitoring, collision warning, tire pressure monitoring</div><div style="text-align: left;"> </div>  <o:p></o:p></li> </ul><h2 style="margin: 7.5pt 0in; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">Artificial Intelligence for improved safety and personalized in-car experience<o:p></o:p></h2><ol style="margin-top:0in" start="1" type="1"> <li class="MsoNormal" style="text-align: left; margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">    1. Driver Drowsiness Alert:<o:p></o:p></li> </ol><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">As safety plays a deciding role in enabling the mass adoption of autonomous vehicles, ADAS has been hugely supported by regulators to include advanced features such as driver drowsiness alerts. With drowsy drivers causing over 90,000 crashes in the US In 2017, according to the National Highway Traffic Safety Administration <a href="https://www.mathworks.com/company/mathworks-stories/ai-determines-driver-drowsiness-in-level-3-autonomous-cars.html">[5]</a>, alerting driver distractions and drowsiness has become critical in ensuring on-road safety. This is where AI comes in handy by collecting and analyzing drivers’ facial expressions to identify potential drowsiness signals and alert accordingly. Such an AI application has been statistically studied and proven to be highly accurate.<o:p></o:p><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">For instance, a study by Inkeaw et al. utilized the artificial neural networks model to analyze participants’ multiple facial variables, including the eye aspect ratio, mouth aspect ratio, face length, and face width balance. The participants also provide electroencephalogram signals (a recording of the human brain’s activity) as the baseline for comparing the performance of facial analysis. The study shows a promising result as the analysis of the eye aspect ratio, mouth aspect ratio, and face length successfully predicts driver drowsiness with a significant accuracy rate of 60,76% <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9482962/">[6].</a><o:p></o:p><ol style="margin-top:0in" start="2" type="1"> <li class="MsoNormal" style="text-align: left; margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">    2. Predictive maintenance:<o:p></o:p></li> </ol><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">Predictive maintenance is a popular AI application and has been effectively utilized in multiple industries. For those unaware, predictive maintenance is the ability to analyze engine health and predict future downtime so that preventive solutions can be taken in advance. Unlike the traditional method of engine inspection, wherein machines undergo pre-scheduled checks or when experiencing irregularities, predictive maintenance updates machine status in real time and suggests optimal inspection timelines. With the AI-powered solution, unexpected downtime is minimized, and machine checks are optimized, thus enabling lowered costs, improved efficiency, and undisrupted business. Such benefits also extend to the automotive industry. By applying predictive maintenance, car owners can have a smoother in-car experience and save costs with minimized breakdowns and fewer pre-scheduled engine checks.<o:p></o:p><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">Global automotive players are beginning to explore the possibility of in-car predictive maintenance. For example, Israel’s Kavim Public Transportation company recently partnered with Questar – an automotive technology solution company, to roll out the vehicle management platform, which collects in-vehicle data and utilizes AI to detect potential malfunctions. As a result, the platform managed to identify serious malfunctions in 10% of the Israeli company’s bus fleet <a href="https://www.analyticsvidhya.com/blog/2022/07/application-of-ai-in-predictive-maintenance-of-vehicles/">[7]</a>.<o:p></o:p><ol style="margin-top:0in" start="3" type="1"> <li class="MsoNormal" style="text-align: left; margin-top: 11.25pt; margin-bottom: 0.0001pt; line-height: normal; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">    3. Personalized in-car experience:<o:p></o:p></li> </ol><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">With AI applications becoming mainstream, customers increasingly expect personalization in every service they experience, and that includes transportation. According to a 2022 survey by Capgemini Research Institute, a whopping 73% of car users expect a built-in AI-powered in-vehicle voice assistant <a href="https://www.futurebridge.com/industry/perspectives-mobility/future-of-in-vehicle-ai-powered-voice-controlled-personal-assistant/">[8]</a>. Such a demand has fueled intense competition not just among carmakers but also technology companies. While Google and Apple have established their presence in the automotive industry with Android Auto and Carplay, Amazon just recently entered the market with Echo Auto, aiming to bring Alexa into vehicles. On the other hand, automakers are creating their own AI-powered assistant with even more advanced features. For instance, in 2018, Mercedes-Benz introduced the AI-powered voice assistant - Mercedes-Benz User Experience that is capable of understanding indirect commands. It means that instead of requiring driver to make a command statement such as “volume up,” the BMW system can automatically volume up when drivers express dissatisfaction.<o:p></o:p><h2 style="margin: 7.5pt 0in; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">Infotainment goes big with AR/VR<o:p></o:p></h2><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">The in-car entertainment has undergone several evolvements, from a humble push-button AM radio to an advanced system with an Internet connection. But with the introduction of AR/VR technology, the driver experience is about to be elevated to a new height. Needless to say, the benefit of AR/VR technology is to bring users to a digital world with new and exciting interactive experiences, and automakers are beginning to redefine the in-car entertainment system with such technology. For example, Audi recently introduced Holoride – a VR-based entertainment package for some of its newest car models, aiming to provide riders with a variety of interactive games and applications. Partnering with game and blockbuster writers, such as the Russo Brothers from Marvel Cinematic Universe, the automaker strives to create its own Holoride universe [<a href="https://www.holoride.com/en/newsroom/market-launch">8</a>].<o:p></o:p><p style="text-align: left; margin: 11.25pt 0in 22.5pt; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">Exciting applications apart, AR/VR technology has been well received and applied in vehicles. One prominent use case is the head-up display, where vehicle information is displayed at eye level, allowing drivers to maintain their head position instead of looking down at the usual lower instruments. With the AR-powered solution, data such as speed, lane information, or distance with ahead vehicles are presented directly onto the windscreen. Mercedes-Benz has successfully rolled out this feature in their car models and even takes a step further by incorporating eye-tracking. This feature allows the projected information to move around as the driver’s head moves, allowing for the vehicle information to always be in the optimal display position [<a href="https://www.forbes.com/sites/bernardmarr/2023/05/12/how-mercedes-benz-uses-virtual-and-augmented-reality-to-sell-cars-train-staff-and-create-new-customer-experiences/?sh=4ab68ec15f4f">9</a>].<o:p></o:p><h2 style="margin: 7.5pt 0in; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">Closing thoughts<o:p></o:p></h2> The in-vehicle infotainment system has undergone major updates to better suit growing consumers’ demand and tightening regulations. Technology such as AI and AR/VR offers some exciting applications for creating a be-spoke in-car experience, but successful implementation of such use cases requires more than just pure technology adoption. Building a clear roadmap, solid software development capabilities, and a high-quality, scalable digital workforce are among several keys to success.

You may like also