mlx.core.fast.rope#
- rope(a: array, dims: int, *, traditinoal: bool, base: float, scale: float, offset: int, stream: None | Stream | Device = None) array#
Apply rotary positional encoding to the input.
- Parameters:
a (array) – Input array.
dims (int) – The feature dimensions to be rotated. If the input feature is larger than dims then the rest is left unchanged.
traditional (bool) – If set to
Truechoose the traditional implementation which rotates consecutive dimensions.base (float) – The base used to compute angular frequency for each dimension in the positional encodings.
scale (float) – The scale used to scale the positions.
offset (int) – The position offset to start at.
- Returns:
The output array.
- Return type: