Contents

SampleGenerator

An actor that generates evaluation samples using a language model.

Declaration

actor SampleGenerator<SampleType> where SampleType : ModelSampleProtocol

Mentioned in

Overview

Create a generator, configure its properties, then call run() to produce new samples as an async stream. After iteration completes, access samples for all generated samples, or invalidSamples for any the validator rejected.

Topics

Configuring generation

Running generation

Accessing results

Initializers

See Also

Datasets