blockrun

blockrun: resumable, chunked parallel maps on dask — locally or on SLURM.

A small, dependency-light substrate for block-wise jobs (volume conversion, meshing, skeletonization):

  • start_dask: one context manager that yields a connected dask Client backed by a LocalCluster or a SLURMCluster, selected by a YAML config.

  • block_map: map a function over items via batched client.map + as_completed (incremental, durable results) or serially.

  • Manifest: a single-writer completion log for resume + intent tracking.

  • iter_blocks / Block: tile an N-d shape into chunk blocks.

Config templates are under blockrun/configs/; docs/dask-slurm.md is the guide.

Submodules