reload_data

HSTB.kluster.fqpr_convenience.reload_data(converted_folder, require_raw_data=True, skip_dask=False, silent=False, show_progress=True)

Pick up from a previous session. Load in all the data that exists for the session using the provided converted_folder. Expects there to be fqpr generated zarr datastore folders in this folder.

os.listdir(r’C:/data_dir/converted_093926’)

[‘attitude.zarr’, ‘soundings.zarr’, ‘navigation.zarr’, ‘ping_389_1_270000.zarr’, ‘ping_389_1_290000.zarr’, ‘ping_394_1_310000.zarr’, ‘ping_394_1_330000.zarr’]

fqpr = reload_data(r’C:/data_dir/converted_093926’)

fqpr = fully qualified ping record, the term for the datastore in kluster

Parameters
  • converted_folder (str) – path to the parent folder containing all the zarr data store folders

  • require_raw_data (bool) – if True, raise exception if you can’t find the raw data

  • skip_dask (bool) – if True, will not start/find the dask client. Only use this if you are just reading attribution

  • silent (bool) – if True, will not print messages

  • show_progress (bool) – If true, uses dask.distributed.progress. Disabled for GUI, as it generates too much text

Returns

Fqpr object reloaded from disk

Return type

Fqpr