At the Consumer Electronics Show (CES) in January, in-vehicle infotainment was a hot topic, with both OEMs and tech companies announcing partnerships and new products that will make vehicles more connected than ever.
Virtual personal assistants (VPAs) like Siri, Google Assistant and Amazon’s Alexa are also making their way into vehicles. According to new research from IHS Markit, nearly 700 million of these software platforms will be used in vehicles by 2024. That includes embedded systems, smartphone-based solutions, or connections to smart home solutions.
A survey by Voicebot.ai found that 77 million U.S. adults use voice assistants in their cars at least monthly. Google and Amazon have both made strong plays for in-vehicle assistant use.
“What’s driving this is consumer dissatisfaction with voice recognition systems that come in the vehicles from OEM suppliers,” says Colin Bird-Martinez, senior analyst of automotive software and services at IHS Markit. “Consumers are used to smartphone performance, and want to see cars be more like smartphones on wheels.”
There was also plenty of activity around VPAs at the CES show. Amazon and Qualcomm announced a partnership that will make it easier to integrate its Alexa personal assistant system into vehicles. Alexa will be embedded into Qualcomm’s future auto processors. In the CES demo, a driver was able to use Alexa to play music, start a movie on a backseat display, get directions, and obtain restaurant recommendations.
Amazon and Alexa were busy at CE. Alexa has mobile app partnerships with Audi, Ford, Lexus, Lincoln, and Toyota, and Telenav announced it would integrate Alexa into its navigation systems. Likewise, HERE Technologies announced that Alexa will integrate its HERE Navigation On-Demand services.
Eyelights and Alexa have come up with a solution that uses Alexa voice commands to pull smartphone displays onto the windshield, while Jarvish demonstrated its X-AR motorcycle helmet that includes voice-activated heads-up display and augmented reality. At least a dozen other partnerships were also announced at CES that would integrated Alexa with everything form parking apps to audio systems.
A new player, Nuance, had its own driver assistance system on display at CES. The Dragon assistant can even recognize when a driver yawns, and take action to try to keep them awake or engaged. A camera-based system can even recognize a driver’s mood based on an image of their face.
Anker has released a Roav Bolt car adapter that uses Google Assistant, while JBL released a similar device called Link Drive that also uses Google Assistant for music, navigation, and other services.
According to the IHS Markit report, Google Assistant and Alexa are projected to be the first significant embedded VPA solutions available in cars via infotainment head unit integration and other systems. Approximately 12 million light vehicles will have this type of system by 2024.
Smartphone integration, however, will account for the largest chunk of the market, with more than 300 million vehicles equipped with such systems in the same period. Roughly 40 million vehicles will have device-to-car systems that take commands from a home device like Amazon Echo or Google Home.
“Some automakers have not made an investment in this technology, and partnering with Google or Amazon helps raise brand awareness and excitement from consumers,” Bird-Martinez says.
Others are hesitant to adopt third-party technology because they don’t want to lose control of branding and driver data. There are also data privacy and data monetization issues, as well as perceived competition for services between the OEMs and providers like Amazon.
At CES, Bird-Matinez says he also saw companies trying to develop solutions that would allow access to the full gamut of VPAs through third-party devices. “They were software agnostic and really show the ease of use of these VPAs,” he says. “This goes back to the marketplace idea that GM and Hyundai have followed so that consumers can download different apps and payments for things like gas and food.”
New Interfaces, Displays Coming
There were plenty of other in-vehicle infotainment innovations on display at CES. Samsung subsidiary HARMAN International unveiled a number of new technology initiatives aimed at the passenger compartment. Those include a new Digital Cockpit platform that is scalable across a range of vehicles and that can show ADAS data, navigation, multi-media player information, and feature menus. The solution can also integrate with a driver’s smartphone to integrate with personal assistants like Alexa.
The company’s Premium Digital Cockpit and Compute Platform with integrated modular hardware integrates with a vehicle’s cluster, infotainment, and safety features, along with facial recognition and sensor-based cabin monitoring.
HARMAN also offers a Premium Communication platform for smart audio and acoustic signal processing that can accommodate voice-based solutions. HARMAN also announced it was working to equip more vehicles with 5G telematics solutions to improve its ability to update in-vehicle systems.
Parent company Samsung was on hand with its Exynos Auto V, the company’s first dedicated automotive system-on-a-chip for in-vehicle infotainment solutions. It can support up to six HR displays. It can also support facial, speech, and gesture recognition solutions.
Audi drivers could soon have access to a virtual reality gaming application from Holoride (a start-up co-founded by Audi Electronic Venture) that uses VR headsets to let passengers play a game that features Marvel Comics character Rocket Raccoon flying a spaceship. When the vehicle brakes or turns, the same thing happens in the game.
WayRay demonstrated an augmented reality solution that projects 3D images onto the road ahead. Those images can include arrows for navigation or markers that show the locations of businesses that may be hidden from the driver. WayRay is also working on side window projectors that give even more information to passengers. WayRay is already working with Honda, Hyundai and Porsche.
Another company, Sain-Gobain Sekurit also demonstrated an augmented reality windshield, and Texas Instruments is working on AR side-window displays.
Valeo, meanwhile, will offer “invisible trailer” software that uses cameras to give truck drivers a rear view with the correct perspective, so that they can virtually “see through” the trailer attached to the vehicle.
Honda’s Dream Drive: Passenger app runs on portable tablets and uses data form the car to and navigation system to affect games on the mobile device. Dream Drive also has a driver display component that allows drivers to make purchases from the vehicle, in addition to making restaurant reservations, buying movie tickets, and order food via GrubHub. Passengers, meanwhile, can watch movies, read DC comic books and listen to music via the apps.
Mercedes-Benz is expanding its MBUX infotainment system to more models, including the CLA Class and GLE-Class SUV. It includes augmented reality for navigation, voice support, and gesture controls. There are also motion sensors that can turn interior lights on and off. There’s also an integrated voice assistant.
Clarion also announced a number of new infotainment products, including smart cockpit technologies that use integrated artificial intelligence for driver monitoring, new display audio units, and Tactile Wave Audio, which uses interior components of the auto to provide sound via coneless speakers.
New cockpit systems will also have access to much larger displays. Electric vehicle startup Byton offers a 48-inch screen in its M-Byte car. The 2019 Mercedes EQC has to 10.25-inch displays, and the Chrysler RAM 1500 has a 12-inch vertical display.
Given how many features that OEMs and tech companies are trying to cram into the vehicle, they will likely make good use of the extra display real estate.