Original Objective-C and Swift API
Topics
Essentials
Still-image analysis
Detecting Objects in Still ImagesClassifying images for categorization and searchAnalyzing Image Similarity with Feature PrintVNRequestVNImageBasedRequestVNClassifyImageRequestVNGenerateImageFeaturePrintRequestVNFeaturePrintObservationVNImageRequestHandlerVNObservation
Image sequence analysis
Applying Matte Effects to People in Images and VideoDetecting human actions in a live video feedSegmenting and colorizing individuals from a surrounding sceneVNStatefulRequestVNGeneratePersonSegmentationRequestVNGeneratePersonInstanceMaskRequestVNDetectDocumentSegmentationRequestVNSequenceRequestHandler
Image aesthetics analysis
Saliency analysis
Cropping Images Using SaliencyHighlighting Areas of Interest in an Image Using SaliencyVNGenerateAttentionBasedSaliencyImageRequestVNGenerateObjectnessBasedSaliencyImageRequestVNSaliencyImageObservation
Object tracking
Tracking the User’s Face in Real TimeTracking Multiple Objects or Rectangles in VideoVNTrackingRequestVNTrackRectangleRequestVNTrackObjectRequestVNDetectedObjectObservation
Rectangle detection
Face and body detection
Selecting a selfie based on capture qualityVNDetectFaceCaptureQualityRequestVNDetectFaceLandmarksRequestVNDetectFaceRectanglesRequestVNDetectHumanRectanglesRequestVNHumanObservation
Body and hand pose detection
Detecting Human Body Poses in ImagesDetecting Hand Poses with VisionVNDetectHumanBodyPoseRequestVNDetectHumanHandPoseRequestVNRecognizedPointsObservationVNHumanBodyPoseObservationVNHumanHandPoseObservationVNPointVNDetectedPointVNRecognizedPointVNRecognizedPointKeyVNRecognizedPointGroupKey
3D body pose detection
Identifying 3D human body poses in imagesDetecting human body poses in 3D with VisionVNDetectHumanBodyPose3DRequestVNHumanBodyPose3DObservationVNRecognizedPoints3DObservationVNHumanBodyRecognizedPoint3DVNPoint3DVNRecognizedPoint3DVNHumanBodyPose3DObservation.JointNameVNHumanBodyPose3DObservation.JointsGroupName
Animal detection
Animal body pose detection
Trajectory detection
Contour detection
Optical flow
Barcode detection
Text detection
Text recognition
Recognizing Text in ImagesStructuring recognized text on a documentExtracting phone numbers from text in imagesLocating and displaying recognized textVNRecognizeTextRequestVNRecognizedTextObservation
Object recognition
Recognizing Objects in Live CaptureUnderstanding a Dice Roll with Vision and Object DetectionVNRecognizedObjectObservation
Request progress tracking
Horizon detection
Image alignment
Aligning Similar ImagesVNTargetedImageRequestVNImageRegistrationRequestVNTranslationalImageRegistrationRequestVNTrackTranslationalImageRegistrationRequestVNHomographicImageRegistrationRequestVNTrackHomographicImageRegistrationRequestVNImageAlignmentObservationVNImageTranslationAlignmentObservationVNImageHomographicAlignmentObservation
Image background removal
Applying visual effects to foreground subjectsVNInstanceMaskObservationVNGenerateForegroundInstanceMaskRequestVNGenerateForegroundInstanceMaskRequestRevision1
Machine learning image analysis
Classifying Images with Vision and Core MLTraining a Create ML Model to Classify FlowersVNCoreMLRequestVNClassificationObservationVNPixelBufferObservationVNCoreMLFeatureValueObservation
Coordinate conversion
VNImagePointForNormalizedPoint(_:_:_:)VNNormalizedPointForImagePoint(_:_:_:)VNImagePointForNormalizedPointUsingRegionOfInterest(_:_:_:_:)VNNormalizedPointForImagePointUsingRegionOfInterest(_:_:_:_:)VNImageRectForNormalizedRect(_:_:_:)VNNormalizedRectForImageRect(_:_:_:)VNImageRectForNormalizedRectUsingRegionOfInterest(_:_:_:_:)VNNormalizedRectForImageRectUsingRegionOfInterest(_:_:_:_:)VNNormalizedIdentityRectVNNormalizedRectIsIdentityRect(_:)VNImagePointForFaceLandmarkPoint(_:_:_:_:)VNNormalizedFaceBoundingBoxPointForLandmarkPoint(_:_:_:_:)
Utilities
Common data types
Errors
Version and revision numbers
VNVisionVersionNumberVNDetectAnimalBodyPoseRequestRevision1VNDetectHumanBodyPose3DRequestRevision1VNTrackHomographicImageRegistrationRequestRevision1VNTrackTranslationalImageRegistrationRequestRevision1VNTrackOpticalFlowRequestRevision1VNClassifyImageRequestRevision1VNClassifyImageRequestRevision2VNGenerateObjectnessBasedSaliencyImageRequestRevision2VNGenerateAttentionBasedSaliencyImageRequestRevision2VNGenerateImageFeaturePrintRequestRevision1VNGenerateImageFeaturePrintRequestRevision2VNDetectFaceCaptureQualityRequestRevision3VNDetectBarcodesRequestRevision4VNCalculateImageAestheticsScoresRequestRevision1VNRequestRevisionUnspecified