Contents

LanguageModelExecutorGenerationRequest

A type that contains the details for a generation request.

Declaration

struct LanguageModelExecutorGenerationRequest

Overview

A generation request is the input payload that respond(to:model:streamingInto:) handles. It bundles everything the executor needs to translate a framework call into a backend request, like the conversation so far, what tools are available, and so on.

Topics

Creating a generation request

Configuring a generation request

See Also

Custom language model provider