Ctrl+K

mlx.data.stream_line_reader

mlx.data.stream_line_reader#

mlx.data.stream_line_reader(file: object, key: str, unzip: bool = False, *, local_prefix: str = '', file_fetcher: mlx::data::core::FileFetcher = None, file_fetcher_handle: mlx::data::core::FileFetcherHandle = None) → mlx.data._c.Stream#

Stream lines from a file.

Similar to stream_csv_reader(), a file can be a filename or a python object with a read() and a seek().

Note

The newline characters are not included in the samples.

Parameters:

  • file (str or python readable object) – The file to read the csv from.

  • key (str) – The destination key for the lines of the file.

  • unzip (bool) – Treat the file as a compressed stream and decompress it on the fly. (default: False)

  • local_prefix (str) – The filepath prefix to use to read the files. (default: ‘’)

  • file_fetcher (mlx.data.core.FileFetcher, optional) – A file fetcher to read the csv files possibly from a remote location.

  • file_fetcher_handle (mlx.data.core.FileFetcherHandle, optional) – A handle to ensure that the file is kept on disk if a stream is passed instead of a filename.