---
title: "init(modelDimension:keyDimension:valueDimension:headCount:dropout:hasBiases:hasAttentionBiases:addsZeroAttention:)"
framework: ML Compute
role: symbol
role_heading: Initializer
platforms: [iOS 14.0+, iPadOS 14.0+, Mac Catalyst 14.0+, macOS 11.0+, tvOS 14.0+]
path: "mlcompute/mlcmultiheadattentiondescriptor/init(modeldimension:keydimension:valuedimension:headcount:dropout:hasbiases:hasattentionbiases:addszeroattention:)"
---

# init(modelDimension:keyDimension:valueDimension:headCount:dropout:hasBiases:hasAttentionBiases:addsZeroAttention:)

Creates a multi-head attention descriptor with the dimensions, number of attention heads, dropout rate, and bias and padding options you specify.

## Declaration

```swift
convenience init?(modelDimension: Int, keyDimension: Int, valueDimension: Int, headCount: Int, dropout: Float, hasBiases: Bool, hasAttentionBiases: Bool, addsZeroAttention: Bool)
```

## Parameters

- `modelDimension`: The total dimension of model space.
- `keyDimension`: The total dimension of key space; the default value is equal to modelDimension.
- `valueDimension`: The total dimension of value space; the default value is equal to modelDimension.
- `headCount`: The number of parallel attention heads.
- `dropout`: The dropout rate you apply to the output projection weights; the default value is 0.0.
- `hasBiases`: A Boolean that specifies whether you add a bias to query, key, value, and output projections; the default value is true.
- `hasAttentionBiases`: A Boolean that specifies whether you add a row of zeros to projected key and value; the default value is false.
- `addsZeroAttention`: A Boolean that specifies whether you add a row of zeros to projected key and value; the default value is false.

## See Also

### Creating Multi-Head Attention Descriptors

- [init(modelDimension:headCount:)](mlcompute/mlcmultiheadattentiondescriptor/init(modeldimension:headcount:).md)
