Open
Description
As @JinZhou5042 noted, the pruning of files can lead to workers failing. In this scenario, the manager will direct a worker to remove a file while a pending transfer is taking place. This transfer will then fail. If this happens multiple times for the same worker, this worker will be treated as faulty and removed. As we have knowledge of pending transfers and which files are being pruned, we should not have these types of failures condemn a worker as we should know that the transfer is failing anyway.
Working on replicating this issue.
Metadata
Metadata
Assignees
Labels
No labels