Closed
Description
What happened + What you expected to happen
I want to log a video to wandb that is stored as a file, what I did was roughly.
python
from wandb import Video
result["video"] = Video("a_file", format="mp4")
train.report(result)
I just did this in a custom WandbLoggerCallback.log_trial_result function.
As a result the WandB logger did not only not log my video but no further metrics at all. I then realized that no final output of the _WandbLoggingActor was shown and I assume something has crashed it without logging an error.
Finally, I could solve the problem with using an absolute path for the video:
result["video"] = Video(os.path.abspath("a_file"), format="mp4")I strongly assume that there is a silent FileNotFoundError underneath that is not logged.
Versions / Dependencies
ray, version 2.38.0
python3.10
Ubuntu
wandb, version 0.19.5
Reproduction script
Setup a Tuner with a WandbLoggerCallback.
In the trainable
from wandb import Video
def trainable(params):
for i in range(19):
result = {}
result["video"] = Video("a_file", format="mp4") # for the silent error id does not matter that the file does not exist
train.report(result)Issue Severity
Medium: It is a significant difficulty but I can work around it.