client_needs_restart¶
- HSTB.kluster.dask_helpers.client_needs_restart(client)¶
Having issues with memory leaks, even though workers have no assigned tasks. Only way I have figured out how to effectively deal with this is to check if the workers are using a bunch of memory when we go to get the client. If so, it means memory is being used even though we aren’t doing any processing. This function tells us if this is the case
- Parameters
client (
Client) – dask client- Returns
if True, the client needs a restart
- Return type
bool