Is the quest 3 Getting Eye and Face Tracking? Meet the EF Tracker
Table of Contents
- 1. Is the quest 3 Getting Eye and Face Tracking? Meet the EF Tracker
- 2. Who Is Behind the EF Tracker?
- 3. A Rocky Start: the diVRse Partnership
- 4. Open-Source Controversy
- 5. What Does This Mean for Quest 3 Users?
- 6. What are teh potential long-term safety risks associated with the EF Tracker’s use of infrared illumination?
- 7. The Split with diVRse Inc.
- 8. Open-Source Controversy
- 9. Safety concerns
- 10. What This Means for Quest 3 Users
- 11. The Future of the EF Tracker
Virtual reality enthusiasts have long awaited eye and face tracking for the Meta Quest 3, and a Japanese engineer claims to have the solution. Though, skepticism surrounds the project, raising questions about its feasibility and credibility.
Who Is Behind the EF Tracker?
The engineer, known as “Nami,” has a background in computer vision and currently works for a Japanese automotive company. He has teamed up with a VRChat user, bbbbb_himiko, to promote the device under the name Vlugin. Their product,the EF Tracker,is marketed as an accessory for the Quest 3,promising to add both eye and face tracking capabilities using three cameras and infrared LEDs.
Vlugin’s render of the EF tracker for Quest 3.
A Rocky Start: the diVRse Partnership
Vlugin was initially formed in 2023 as a partnership with diVRse, a Japanese startup known for its VRsatile prescription lens inserts. The original plan was to create a variant of VRsatile with added eye tracking,dubbed VRsatile Eye C.However, just two days ago, Vlugin announced the termination of this partnership, shifting focus to the Quest 3-specific EF Tracker.
“diVRse Inc. provided their opinion on the current situation of the vlugin team, and diVRse Inc. expressed their intention to proceed with their own development with a new development partner. In response, the Vlugin team recognized that the directions aimed for by both parties are different and decided to dissolve the cooperation.”
This sudden split raises concerns, especially since Vlugin now consists of just one engineer and has only released renders of the EF Tracker, not a functional prototype.
Open-Source Controversy
Adding to the skepticism, Vlugin appears to have used open-source eye-tracking software without proper licensing or attribution. The lead developer of EyeTrackVR, an open-source project used to mod eye tracking onto headsets like the Quest 2 and Bigscreen Beyond, has pointed out similarities between Vlugin’s tracking visualization overlay and their own work.
While Vlugin claims to “develop hardware and software,” the lack of transparency and reliance on unlicensed open-source tools cast doubt on the project’s legitimacy.
What Does This Mean for Quest 3 Users?
For now, the EF Tracker remains a concept rather than a tangible product. The absence of a prototype, combined with the dissolution of a key partnership and questionable use of open-source software, makes it challenging to trust Vlugin’s claims.While the idea of adding eye and face tracking to the Quest 3 is exciting, users may need to wait for a more established solution.
As the VR community watches closely,the future of the EF Tracker remains uncertain. Will Vlugin deliver on its promises, or is this another ambitious project destined to fade away? Only time will tell.
vr.com”>only exhibition video as identical to EyeTrackVR.
The developer, who goes by the handle Prohurtz, says he confronted Vlugin about this in a public reply on X, and that Vlugin claimed it was their “own development”. When Prohurtz pointed out the interface was identical to EyeTrackVR, Vlugin deleted the post, he says.
Vlugin has been accused of doing the same for its face tracking too, using the open-source project Project Babble, and today Project Babble updated its github page to clarify that it does not allow commercial use without a license.
こんにちは、vluginです！
開発中のアイトラッキングデバイス、 #VRsatileEyeC の実機動作映像を公開致します。
また、今後はホームページ内にも活動報告を投稿します。こちらも合わせてお楽しみください。
-技術書典15に出典してきました！https://t.co/lWgaCD0Zqr pic.twitter.com/mXhodKxPa9— Vlugin (@Vlugin_jp) November 19, 2023
Vlugin’s only demonstration video.
But even worse, the hardware Vlugin is using may possibly be unsafe for human eyes.Multiple VR experts, including Prohurtz and the lead developer of the visionOS port of ALVR, have noticed that the camera sensors used in EF Tracker look unusually large compared to the kind used in existing VR eye tracking. prohurtz believes he has pinpointed it to be an off-the-shelf sensor and IR illuminator board used in DIY Arduino and Raspberry Pi projects which he says is “not designed for eye tracking”, and which he says he himself once tested with concerning results.
To allow the sensor to see your eye clearly, Vlugin is using infrared illumination and brightnesses multiple times stronger than the hardware EyeTrackVR recommends, Prohurtz says, putting it beyond the recommended eye safety levels for long-term exposure, which he says would result in “discomfort and an increased risk of cataracts due to cornea damage”. Prohurtz says his testing with the board caused “immediate eye dryness and strain”. The EyeTrackVR community has put significant effort into researching and warning about IR emitter safety.
The race to enhance virtual reality experiences is heating up, with multiple companies vying to bring eye and face tracking capabilities to the Meta Quest 3. One such contender is Vlugin, which has teased its EF Tracker add-on. Though, they are not alone in this space. Inseye, a startup, has also thrown its hat into the ring with its Lumi eye-tracking device, priced at $160. Unlike traditional systems that rely on cameras, Lumi uses cost-effective photosensors, which are less demanding in terms of processing power and energy consumption. Despite the initial buzz, Inseye has remained silent about its progress since September 2023.
Inseye Lumi: A budget-Kind Eye Tracking Solution for Quest 2 & 3
Inseye aims to deliver an affordable eye-tracking addon for Quest 2 and Quest 3, though a release date remains unclear.
While third-party developers are pushing forward, Meta itself has been hesitant to commit to similar features. This reluctance is surprising, especially considering HTC’s success in launching eye and face tracking addons for its Vive Focus 3 headset. if HTC can achieve this, it raises questions about why Meta hasn’t pursued a similar path for the Quest 3.
Meta Dismisses Quest 3 Eye Tracking Add-On possibility
Meta’s CTO has publicly dismissed the idea of an eye-tracking addon for quest 3, leaving enthusiasts wondering about the company’s priorities.
As for Vlugin’s EF Tracker, details remain scarce. The company has not opened preorders,nor has it revealed pricing or a release timeline. Given the uncertainties surrounding the project,it’s advisable to approach any future availability with caution. For now, VR enthusiasts will have to wait and see weather these third-party solutions can deliver on their promises or if Meta will eventually step up to the plate.
What are teh potential long-term safety risks associated with the EF Tracker’s use of infrared illumination?
Irtual reality (VR) experiences continues to heat up, with companies striving to integrate advanced features like eye and face tracking into consumer headsets. However, the recent developments surrounding Vlugin and its EF Tracker project have raised meaningful concerns within the VR community.
The Split with diVRse Inc.
The dissolution of Vlugin’s partnership with diVRse Inc.has left many questioning the future of the EF Tracker. With Vlugin now reduced to a single engineer and having only released renders rather than a functional prototype, the project’s viability is under scrutiny. The split suggests a divergence in vision between the two companies, but it also leaves Vlugin without the resources and support that diVRse could have provided.
Open-Source Controversy
Adding to the skepticism, Vlugin has been accused of using open-source eye-tracking software without proper licensing or attribution. the lead developer of EyeTrackVR, an open-source project, has pointed out striking similarities between Vlugin’s tracking visualization overlay and their own work. This lack of openness and reliance on unlicensed open-source tools casts doubt on Vlugin’s claims of developing their own hardware and software.
Safety concerns
Perhaps even more alarming are the potential safety risks associated with the EF Tracker. Multiple VR experts have noted that the camera sensors used in the device appear to be unusually large and may not be designed for eye tracking. The use of infrared illumination at brightness levels significantly higher than recommended by EyeTrackVR raises concerns about long-term eye safety. Prohurtz, the lead developer of EyeTrackVR, has warned that such high levels of IR illumination could lead to discomfort, eye dryness, strain, and even an increased risk of cataracts due to cornea damage.
What This Means for Quest 3 Users
For now, the EF Tracker remains a concept rather than a tangible product. The absence of a functional prototype, combined with the dissolution of a key partnership and questionable use of open-source software, makes it difficult to trust Vlugin’s claims. While the idea of adding eye and face tracking to the Quest 3 is undoubtedly exciting, users may need to wait for a more established and reliable solution.
The Future of the EF Tracker
As the VR community watches closely,the future of the EF Tracker remains uncertain. Will Vlugin be able to deliver on its promises, or is this another enterprising project destined to fade away? only time will tell. In the meantime, potential users and investors should approach with caution, given the current concerns surrounding the project’s legitimacy and safety.
while the EF Tracker represents an exciting potential advancement for VR technology, the current controversies and uncertainties make it a risky proposition. The VR community will undoubtedly continue to monitor Vlugin’s progress, but for now, it may be wise to temper expectations and wait for more concrete developments.
