Oculus’ Passthrough API Experimental allows you to create and test hybrid reality apps.
Oculus claims that the Passthrough API Experimental allows users to work remotely with friends or coworkers through virtual monitors. They can also access their keyboard and computer from their desk. The Passthrough API Experimental will allow users to play games in virtual environments while still having the familiarity and comfort of the real world. It will also allow for a Co-located Social Presence that allows users to interact with others in the same room while engaging in virtual content.
Passthrough API capabilities include:
* Composition – Users can combine Passthrough layers with other VR layers via existing blending techniques such as hole punching or alpha blending.
* Style – Users can apply styles and tints to layers using a predefined list.
* Custom Geometry: Passthrough images can be rendered to a custom geometry instead of using the default mesh.
Oculus stated that apps using Passthrough API couldn’t access, view, or store images or videos of the user’s physical environment from the Oculus Quest 2 sensor. Instead, they can only use raw images from Oculus Quest 2 sensor for privacy purposes.
Unity developers will have access to the Passthrough API Experimental in the upcoming SDK releases. Other development platforms will also be supported in the future. Keep checking back for updates.