At Apple’s developer conference WWDC 2022, it was announced that the latest version of iOS (iOS 16) will include the ability to scan the user’s ears. With the introduction of this function, the quality of 3D audio will be further improved.
“Spatial Audio” is a function that realizes a three-dimensional and immersive sound, and when listening to 5.1ch (surround) sound, the position and direction of the sound is reflected. increase. Apple described it as an experience “as if wrapped in sound from all directions.” The company’s systems are currently compatible with AirPods Pro, AirPods Max, AirPods (3rd generation) and more.
The iOS 16 ear scan feature allows you to create custom HRTFs. HRTF is a term that refers to “head related transfer function”. It is a quantification of the characteristics of how the sound changes when it is heard through the fingertips and ears. In the case of digital spatial audio, “position” and “three-dimensional effect” can be expressed more accurately by grasping the shape of the user’s head and ears.
Scanning is done using the iPhone’s sensor. According to the announcement, it can be used on iPhones equipped with the TrueDepth camera system including iPhone 10 and later. Note that improving accuracy requires a process that simulates the interaction between sound and ear shape.
Apple hasn’t announced at this time, but US media Road to VR argues that the system is likely to be implemented as well.
(reference)Road to VR
Mogura VR is a Road to VR partner media.