2023-07-05 21:57:33
One of the most interesting features of the Apple Vision Pro is the ability to command virtually anything in your operating system (the visionOS) using the gaze direction, which is considered by Apple, in the company’s new concept of spatial computing, as a pointing device — just like the mouse on computers and the finger on devices with a touch screen.
Apple’s headset hasn’t been released yet, but who says you can’t have a little bit of experience using the device before then? And we’re not talking regarding virtualizing it through macOS. A Supernova Technologies released for download a demo that “imitates” visionOS and runs on virtual reality headsets already available on the market, such as the Meta Quest Pro.
Obviously, this is something very experimental and embryonic. It will not give you access to other parts of Apple’s operating system beyond the application grid presented by the company at WWDC23. This interface was developed by Supernova for the framework New, having been designed by programmers and designers who work with Unity.
When running on a device like the Quest Pro, which features eye tracking, Nova is able to use users’ gaze direction to highlight interface elements (such as icons) as well as pinch gestures to select those elements — such as which in Vision Pro.
A demo video showed a person using gaze direction and gestures to interact both with this grid (which is a visionOS imitation) and with an interface of the same framework:
Obviously, as the Quest Pro doesn’t have the inferior cameras like the Vision Pro, the user has to keep their hand raised whenever they want to use it to interact with system elements. It’s also not functional at all on Meta’s other less powerful AR/VR headsets, as devices like the Quest 2 or Quest 3 lack the eye-tracking feature of the more powerful model.
One of the project’s developers made it clear that only certain aspects of the visionOS user interface were recreated. He recommends that testers — who can find the setup file on the GitHub — perform the headset eye tracking calibration and also be in a place with good lighting for best performance.
via 9to5Mac
1688594942
#Framework #simulates #visionOS #elements #Meta #Quest #Pro
