Contents

SampleGenerator

An actor that generates evaluation samples using a language model.

Declaration

actor SampleGenerator<SampleType> where SampleType : ModelSampleProtocol

Mentioned in

Overview

To produce new samples, create an instance, configure its properties, and call run(). After iteration completes, access samples for the full dataset, or invalidSamples for any samples the validator rejected.

Topics

Creating a generator

Configuring generation

Running generation

Accessing results

See Also

Datasets