add_zero_attn
A Boolean value that, if true, adds a row of zeroes to the projected K and V inputs to the calculation.
Declaration
var add_zero_attn: BoolA Boolean value that, if true, adds a row of zeroes to the projected K and V inputs to the calculation.
var add_zero_attn: Bool