init(modelDimension:headCount:)
Creates a multi-head attention descriptor with the model dimension and number of parallel attention heads you specify.
Declaration
convenience init(modelDimension: Int, headCount: Int)Parameters
- modelDimension:
The total dimension of model space.
- headCount:
The number of parallel attention heads.