Is there some ready made tool to monitor the execution of CWL Workflows? I’m currently using cwltool as my runner.
By “monitor”, I mean some tool that would show the current progress of the workflow in a structured manner. I can see the STDERR logs just fine, but I am wondering if there is something more friendly towards automated monitoring that could, for example, show that steps A, B, C have already completed, step D scattered, D.1 completed, D.2 is running and D.3 had an error for example.
My first idea is to try to read this information from the logs, which while certainly doable, feels not very robust (what if the log formatting changes in the future?). I see that cwltool keeps each step information in the --cachedir if that is specified, but it is also not clear to me how to associate each step to the hashed files and directories generated there.