Contents

respond(to:model:streamingInto:)

Creates a response stream containing deltas.

Declaration

nonisolated(nonsending) func respond(to request: LanguageModelExecutorGenerationRequest, model: Self.Model, streamingInto channel: LanguageModelExecutorGenerationChannel) async throws

Parameters

  • request:

    The generation request.

  • model:

    The model instance for this request, providing live model state.

  • channel:

    A channel used to send events.

Discussion