Open
Description
What happened + What you expected to happen
Currently, when spilling/restoration happens, the IO worker uses its IO thread to run spill/restoration operations. Since they are blocking, it will slow down all other IO thread processes (e.g., handling RPCs).
This is a bug we should fix. Without this things like ray memory will be extremely slow when there are lots of spilling going on
Versions / Dependencies
master
Reproduction script
N/A
Issue Severity
No response