Contents

LanguageModelExecutorGenerationChannel.TextSegmentReplacement

A replacement for a streaming entry’s current text segment.

Declaration

struct TextSegmentReplacement

Overview

The tokenCount is the producer’s count of tokens carried by content and is used by safety or usage accounting to credit the replacement against.

Topics

Handling the replacement

See Also

Accessing the event types