Of course, making the windshield a highly centralized, intelligent device must be connected to any sensor in the car.
According to Apple, the vehicle includes multiple sets of external and internal sensors, with the external generating environmental data and the internal user data, including equipment such as visible and infrared cameras, ultrasonic sensors, depth cameras and radar.The sheer number of devices that come together makes it more than twice as difficult as a phone, but at the same time offers new experiences that can reach new heights.
Apple has already applied artificial intelligence to its phones, tablets and other devices. The most typical example is that each generation of chips contains a neural network engine that allows the phone to run a lot of AI calculations.
The same is true for cars.Apple filed two patents in 2018 for neural network-controlled self-driving cars, which specifically mentioned that neural networks could be used for multitasking outputs, including lane changes, observing pedestrians, motion control, and more.
The technology isn’t that hard to achieve, and the main use of in-car AI chips is in real-time identification and analysis of external environmental data and feedback to the vehicle.But the two Apple patents detail how, for example, a self-driving car would use a neural network to transmit data to multiple tasks, which would then make judgments.One example is when analyzing road images, the data is fed back into the vehicle navigation system in real time.
Real-time image recognition analysis, is the “essential skills” all automated driving | Patenty Apple
Navigation also works well with the aforementioned AR windshield.In a self-driving car, a passenger uses a combination of hand gestures and voice to tell the car to stop.If the position isn’t exact, you can use the iPhone’s virtual joystick to fine-tune it.Sounds a bit similar to Tesla’s summon mode.
There’s still a lot of room for growth, and Apple, which is late to the game, doesn’t have much of an advantage over companies like Waymo and Cruise that are focused on autonomous driving.In California’s annual road test report on self-driving cars, Apple tests more than 60 vehicles, compared with 153 for Waymo, one of the first to test self-driving cars.
The report also shows that Apple is taking self-driving testing less and less seriously. Not only did the number of cars drop to 23, but the mileage dropped dramatically, from 79,745 kilometers to 12,140 kilometers.
In terms of pure technical metrics, Apple doesn’t get much of a boost, but it’s interesting to combine its unique advantage — smart devices — with autonomous driving.