Contents

streamingAdvanceCount

Sets streaming advancement amount for cases with dynamically shaped inputs.

Declaration

var streamingAdvanceCount: Int { get set }

Parameters

  • context:

    The graph context.

  • advance_count:

    An integer value that specifies the number of elements that the function advances the internal state pointer.

Discussion

For models compiled with the BNNSOption attribute StateMode=Streaming enabled, where slice_update operations use an update parameter of dynamic shape, BNNS can’t unambigiously determine the streaming advancement size. In this case, call this function before calling BNNSGraphContextExecute(_:_:_:_:_:_:) to set the advancement size for each frame.

This function advances the internal state pointer by advance_count elements in the streaming dimension before returning from BNNSGraphContextExecute(_:_:_:_:_:_:).