Fix issue with :bb:worker:`DockerLatentWorker` accumulating connections with the docker server (:issue:`6538`).