ARKit updates

Learn about important changes to ARKit.

Overview

Browse notable changes to ARKit.

Convert coordinates between SwiftUI, RealityKit and ARKit by getting a coordinate space for any tracked anchor with the new ARKitCoordinateSpaceProviding protocol, adopted by anchor types across ARKit.

Track how well an app’s content covers a person’s field of view, receive device fit updates, and present coaching alerts with VisualFidelityProvider and FieldOfViewAnchor.
Update the set of accessories a running AccessoryTrackingProvider tracks without restarting the session using updateAccessories(_:).
Configure reference objects for high-frame-rate tracking with ReferenceObject.Configuration.

Drive AR views from a rotation angle instead of a UIInterfaceOrientation with viewRotationAngle and the new orientation-independent variants on ARCamera and ARFrame.
Attach an ARSession to a specific CALayer with viewLayer.
Receive AVFoundation metadata objects, such as detected faces, alongside camera frames with metadataObjects.
Detect and track physical objects in world-tracking sessions with trackingObjects.
Generate environment textures during face-tracking sessions from rear-camera imagery with isEnvironmentTexturingEnabled.

Bring ARKit to Mac apps by using ARKitSession with WorldTrackingProvider to query device pose and manage world anchors on macOS.
Classify surfaces consistently across plane, mesh, and room anchors using the unified SurfaceClassification enumeration.
Opt into higher-fidelity hand data with fidelity.

Track spatial accessories, such as styli, controllers, and purpose-built devices, with AccessoryTrackingProvider and AccessoryAnchor.
Prepare an accessory for tracking by following Preparing spatial accessories for tracking in your visionOS app and adopt the workflow in Tracking accessories in volumetric windows.

Share a world coordinate space among nearby participants with SharedCoordinateSpaceProvider.
Persist world anchors across nearby devices by opting in with isSharedWithNearbyParticipants, and observe availability with worldAnchorSharingAvailability.

Capture from a defined region of space in enterprise apps with CameraRegionProvider and CameraRegionAnchor.
Access the right-eye camera feed and choose between mono- and stereo-corrected frames using CameraFrameProvider.CameraPosition.right and CameraFrameProvider.CameraRectification.

Detect physical objects and attach digital content to them with ObjectTrackingProvider.
Use the RoomTrackingProvider to understand the shape and size of the room that people are in and detect when they enter a different room.