OpenUSD schemas for AR
Add augmented reality functionality to your 3D content using USD schemas.
Overview
Universal Scene Description (USD) is a widely-supported specification for the interchange and storage of 3D graphic data. USD files are the preferred interchange format for apps displaying 3D and AR content using the ARKit and RealityKit frameworks. Apple, in collaboration with Pixar, developed a set of schemas to extend USD for AR use cases. These schemas, among other things, add the ability to:
Anchor 3D content at a specific location in the real world.
React to real-world situations.
Participate in a physics simulation.
Connect audio effects to a location.
Annotate the environment by displaying text.
These schemas allow you to include the data needed to support augmented reality features in AR Quick Look, and also let you use USD files in place of .reality files when writing RealityKit apps. Reality Composer Pro uses these schemas to store data for AR features, like anchoring, in its USDA scene files.
To enable AR features in assets from a third-party digital content-creation (DCC) tool that doesn’t support these schemas, export the file as a .usda file using the USD Toolset and edit them by hand.
Implement AR functionality
The following illustration depicts a virtual castle rendered by a runtime, the app or system framework that implements the AR functionality described in the schemas. The prim for the virtual castle (USD refers to individual units of 3D content as prims; see UsdPrim) instructs the runtime to place the castle on a known image in the physical environment, called the image anchor. When the user comes into proximity with the anchor, the runtime displays the 3D visualization of the castle. Falling snowflakes represent additional prims that behave as if in accordance with gravity, and disappear as they approach a real-world surface.
[Image]