Kuo stated that Apple AR headphones will use Face ID technology for gesture tracking
2022-01-05


Analyst Ming Chi Kuo now claims that the upcoming Apple AR earphones will track hand movements, which will enable devices to interpret gestures. In the second Apple AR report released in recent days, respected analyst Ming Chi Kuo reported more details on the sensors expected to be used in Apple's upcoming first headphones. Gesture control and object detection are key human-machine UI designs for Apple AR/MR headphones, Guo wrote in a report to investors. Apple's AR/MR headphones are equipped with more 3D sensing modules than the iPhone. 'We predict that Apple's AR/MR headphones will have four sets of 3D sensing (while iPhone/high-end smartphones only have one to two sets),' he continued. We predict that the structured light of AR/MR earphones can not only detect changes in the position of users or other people's hands and objects in front of users, but also detect dynamic detail changes in the hands. This 'dynamic detail change' is similar to the way Face ID detects facial expression changes, and Guo claims that capturing 'details of hand movements can provide a more intuitive and vivid human-machine interface. However, there is a difference between Face ID and this type of hand tracking.
图扬科技|Kuo 表示 Apple AR 耳机将使用 Face ID 技术进行手势跟踪


Although both use structured light, the distance between the hand (user or someone else's) and the object detected by the earphone device needs to be longer than what the iPhone's Face ID sees, 'Guo continued,' so the structured light power consumption of the earphone device is higher

We predict that the detection distance of Apple's structured light AR/MR earphones is 100-200% higher than the detection distance of iPhone Face ID. In order to increase the field of view (FOV) for gesture detection, we predict that Apple AR/MR headphones will be equipped with three sets of ToF [flight time] to detect hand motion trajectories with low latency requirements

Kuo's focus is on the impact these components and requirements will have on the companies his clients may choose to invest in. Therefore, he reported that WIN semi and Lumentum are considered the main suppliers of headspace VCSEL (vertical cavity surface emission). Laser sensor.

However, he also supports his previous report that Apple ultimately plans to replace the iPhone with AR headphones.

The innovative human-machine UI of earphone devices requires the integration of many technologies, 'he wrote. It will be crucial for headphones to replace existing consumer electronics products with displays in the next decade