Contents

LanguageModelExecutorGenerationChannel.Usage

Snapshot of an entry’s token totals.

Declaration

struct Usage

Overview

Producers report the current cumulative totals on every update and consumers replace prior totals wholesale.

Topics

Creating a usage token instance

Updating the token counts

See Also

Accessing the event types