Contents

quantize(_:scaleTensor:zeroPoint:dataType:axis:name:)

Creates a Quantize operation and returns the result tensor.

Declaration

func quantize(_ tensor: MPSGraphTensor, scaleTensor: MPSGraphTensor, zeroPoint: Double, dataType: MPSDataType, axis: Int, name: String?) -> MPSGraphTensor

Parameters

  • tensor:

    Input tensor to be quantized

  • scaleTensor:

    Scale 1D Tensor parameter with size == tensor.shape[axis]

  • zeroPoint:

    Bias scalar parameter (converted to dataType of resultTensor)

  • dataType:

    Integer data type of the result tensor.

  • axis:

    Axis on which the scale 1D value is being broadcasted

  • name:

    The name for the operation.

Return Value

A valid MPSGraphTensor array of datatype dataType

Discussion

Convert the float tensor to an i8 or u8 tensor by applying a scale + bias transform: result = (tensor / scaleTensor) + zeroPoint