Contents

cachedTokenCount

The number of input tokens that were served from a cache.

Declaration

var cachedTokenCount: Int

Discussion

This value will always be less than or equal to totalTokenCount.

See Also

Getting the token count