RealityKit
Simulate and render 3D content for use in your augmented reality apps.
Mentioned in
Overview
RealityKit provides high-performance 3D simulation and rendering capabilities you can use to create apps with 3D or augmented reality (AR) for iOS, iPadOS, macOS, tvOS, and visionOS. RealityKit is an AR-first 3D framework that leverages ARKit to seamlessly integrate virtual objects into the real world.
[Image]
Use RealityKit’s rich functionality to create compelling augmented reality (AR) experiences:
Create and import full RealityKit scenes with models, animations, and Spatial Audio by using Reality Composer Pro for visionOS.
Build or modify scenes at runtime by adding 3D models, shape primitives, and sounds from code.
Have virtual objects interact with objects in the real world.
Animate objects, both manually and with physics simulations.
Respond to user input and changes in a person’s surroundings.
Synchronize across devices and use SharePlay to enable group AR experiences.
Topics
Essentials
Understanding the modular architecture of RealityKitBuilding an immersive experience with RealityKitEntityComponent
Presentation
Scene management and logic
Asset creation
Reality Composer ProSwift SplashDioramaPresenting an artist’s sceneObject captureUSDComposing interactive 3D content with RealityKit and Reality Composer Pro
Scene content
Hello WorldEnabling video reflections in an immersive environmentCreating a spatial drawing app with RealityKitGenerating interactive geometry with RealityKitCombining 2D and 3D views in an immersive appTransforming RealityKit entities using gesturesResponding to gestures on an entityModels and meshesMaterials, textures, and shadersAnchorsLights and camerasContent synchronizationAudioVideosImagesMesh deformationGlobal illumination and baked lighting
Game development
Gaming sample code projectsEntity animationsCharacter control, skeletons, and inverse kinematicsNavigationComponentNavigationMeshComponentNavigationControllerNavigationMeshResource
Physics simulation
Performance improvements
Improving the Performance of a RealityKit AppReducing GPU Utilization in Your RealityKit AppReducing CPU Utilization in Your RealityKit AppConstruct an immersive environment for visionOSPassing Metal command objects around your applicationLow-level rendering
Classes
Structures
BoundingBoxCalculatorComputeGraphComponentComputeGraphOutputComponentComputeGraphRuntimeComponentComputeGraphViewpointComponentGaussianSplatComponentMaterialDecodingConfigurationMaterialXVersionRenormalizingDeformerSubdivisionSurfaceDeformer