MLX Data

MLX Data is a framework agnostic data loading library brought to you by Apple machine learning research.

MLX Data can be used to load data for machine learning training or on its own for data pre-processing. You can use it with PyTorch, Jax or MLX.

The goal of this library is to allow users to leverage multiple threads for data processing pipelines without the inflexibility of dealing with multiple processes or having to write in a symbolic language.

Note

In MLX Data pipelines you can use Python to process data, implement logic or cause side effects!

Install

• Build and Install

Usage

• Quick Start Guide
• Buffers, Streams and Samples

Python API Reference

• Common operations
• Buffer
• Stream
• Common Datasets
• Tokenizing with MLX data
• Feature extraction
• Miscellaneous