Objects that Simplify the Creation of Neural Networks
Simplify the creation of neural networks using networks of filter, image, and state nodes.
Overview
Graphs in Metal Performance Shaders offer a higher level graph API, intended to simplify the creation of neural networks. The graph is a network of MPSNNFilterNode, MPSNNImageNode and MPSNNStateNode objects.
MPSNNImageNode represents MPSImage or MPSTemporaryImage objects
MPSNNFilterNode represents MPSCNNKernel objects—each of the lower level MPSCNNKernel subclasses has an associated object that is a subclass of the MPSNNFilterNode
MPSNNStateNode represents MPSState objects
Topics
Neural Network Graphs
Arithmetic Layer Nodes
MPSNNAdditionNodeMPSNNAdditionGradientNodeMPSNNSubtractionNodeMPSNNSubtractionGradientNodeMPSNNMultiplicationNodeMPSNNMultiplicationGradientNodeMPSNNDivisionNodeMPSNNBinaryArithmeticNodeMPSNNArithmeticGradientNodeMPSNNArithmeticGradientStateNode
Convolution Layer Nodes
MPSCNNBinaryConvolutionNodeMPSCNNConvolutionNodeMPSCNNConvolutionTransposeNodeMPSCNNConvolutionGradientNodeMPSCNNConvolutionGradientStateNodeMPSCNNCrossChannelNormalizationGradientNode
Pooling Layer Nodes
MPSCNNPoolingAverageNodeMPSCNNDilatedPoolingMaxNodeMPSCNNPoolingL2NormNodeMPSCNNPoolingMaxNodeMPSCNNPoolingNodeMPSCNNDilatedPoolingMaxGradientNodeMPSCNNPoolingAverageGradientNodeMPSCNNPoolingGradientNodeMPSCNNPoolingL2NormGradientNodeMPSCNNPoolingMaxGradientNode
Fully Connected Layer Nodes
Neuron Layer Nodes
MPSCNNNeuronAbsoluteNodeMPSCNNNeuronELUNodeMPSCNNNeuronHardSigmoidNodeMPSCNNNeuronLinearNodeMPSCNNNeuronPReLUNodeMPSCNNNeuronReLUNNodeMPSCNNNeuronReLUNodeMPSCNNNeuronSigmoidNodeMPSCNNNeuronSoftPlusNodeMPSCNNNeuronSoftSignNodeMPSCNNNeuronTanHNodeMPSCNNNeuronExponentialNodeMPSCNNNeuronGradientNodeMPSCNNNeuronLogarithmNodeMPSCNNNeuronPowerNodeMPSCNNNeuronNode
Softmax Layer Nodes
Normalization Layer Nodes
MPSCNNCrossChannelNormalizationNodeMPSCNNLocalContrastNormalizationNodeMPSCNNSpatialNormalizationNodeMPSCNNBatchNormalizationGradientNodeMPSCNNBatchNormalizationNodeMPSCNNBatchNormalizationDataSourceMPSCNNInstanceNormalizationGradientNodeMPSCNNInstanceNormalizationDataSourceMPSCNNInstanceNormalizationNodeMPSCNNLocalContrastNormalizationGradientNodeMPSCNNSpatialNormalizationGradientNodeMPSCNNNormalizationNode
Upsampling Layer Nodes
MPSCNNUpsamplingBilinearNodeMPSCNNUpsamplingNearestNodeMPSCNNUpsamplingBilinearGradientNodeMPSCNNUpsamplingNearestGradientNode