Extending CWL for High-Performance Computing: A Visual Workflow System with HPC Enhancements

Presenter: Zhang Yexi, Starlight Develop Team, National Supercomputer Center in Guangzhou, China

Schedule:
Session 2 (Online Only) Thursday 9 May / Friday 10 May, APAC-Americas Friendly time

And:

Session 3 (Amsterdam / Online hybrid) Wednesday 15 May, APAC-EMEA Friendly time

In this presentation, we delve into our cutting-edge development: a visualization workflow editor and submission system based on the Common Workflow Language (CWL), with a special focus on our extensions tailored for High-Performance Computing (HPC) environments. Our primary enhancements revolve around loops and resource descriptions, designed to significantly streamline the creation and management of complex workflows. These adaptations enable researchers and engineers to utilize computational resources with greater efficiency. Through an intuitive drag-and-drop interface and advanced workflow configuration options, users can effortlessly construct, test, and deploy workflows optimized for HPC settings. We will demonstrate how these CWL extensions empower users to leverage HPC-specific capabilities, such as batch job management and parallel computing, thereby enhancing the execution efficiency of computational tasks. Join us to explore how this innovative tool can propel the forefront of scientific research and engineering projects by optimizing workflow management for HPC environments.

Please leave your questions for the presenter below!

As an alternative to YouTube, this presentations is also available on ConfTube