scale
The scale applied to the result of the query–key matrix multiply before softmax. Typically set to 1/sqrt(headDimension).
Declaration
var scale: Float { get set }The scale applied to the result of the query–key matrix multiply before softmax. Typically set to 1/sqrt(headDimension).
var scale: Float { get set }