mlx.core.metal.get_cache_memory

mlx.core.metal.get_cache_memory#

get_cache_memory() int#

Get the cache size in bytes.

The cache includes memory not currently used that has not been returned to the system allocator.