Media Intelligence
Analyze video content and group faces in images using on-device machine learning.
Overview
Media Intelligence provides on-device algorithms to analyze image and video content. Use it in video editors, photo organizers, and other media apps to add intelligence features without building the underlying analysis pipeline yourself.
For images, FaceGroupAnalyzer detects faces in a collection of image assets and groups matching faces into entities, each representing a unique person. You can then query the analyzer to retrieve faces by asset, entity, or face ID, and use the results to build features like person-based photo organization or face search.
For video, VideoAnalyzer accepts one or more analysis requests for a specified asset and returns results for each. Use HighlightAnalysisRequest to identify the most engaging segments of a video clip, or use KeyFrameAnalysisRequest to select a keyframe that represents the overall theme of the video. Both requests run in-process on the device, with no data leaving the system.
Topics
Image analysis
Video analysis
Finding the best moments in a videoVideoAnalyzerMediaIntelligenceVideoAssetHighlightAnalysisRequestKeyFrameAnalysisRequest