mlx.core.distributed.init

Contents

mlx.core.distributed.init#

init(strict: bool = False, backend: str = 'any') → Group#

Initialize the communication backend and create the global communication group.

Example

import mlx.core as mx

group = mx.distributed.init(backend="ring")
Parameters:

  • strict (bool, optional) – If set to False it returns a singleton group in case mx.distributed.is_available() returns False otherwise it throws a runtime error. Default: False

  • backend (str, optional) – Which distributed backend to initialize. Possible values mpi, ring, nccl, any. If set to any all available backends are tried and the first one that succeeds becomes the global group which will be returned in subsequent calls. Default: any

Returns:

The group representing all the launched processes.

Return type:

Group

Contents