streamingAdvanceCount
Sets streaming advancement amount for cases with dynamically shaped inputs.
Declaration
var streamingAdvanceCount: Int { get set }Parameters
- context:
The graph context.
- advance_count:
An integer value that specifies the number of elements that the function advances the internal state pointer.
Discussion
For models compiled with the BNNSOption attribute StateMode=Streaming enabled, where slice_update operations use an update parameter of dynamic shape, BNNS can’t unambigiously determine the streaming advancement size. In this case, call this function before calling BNNSGraphContextExecute(_:_:_:_:_:_:) to set the advancement size for each frame.
This function advances the internal state pointer by advance_count elements in the streaming dimension before returning from BNNSGraphContextExecute(_:_:_:_:_:_:).