[GCP] Google Batch Support #3987
Description
Background
The purpose of this task is to integrate the Cloud Pipeline platform with Google Batch, a managed service designed to efficiently handle batch-processing workloads. Google Batch provides intelligent job queuing, resource provisioning, and automatic scaling, making it an ideal service for offloading large-scale computational tasks. By incorporating Google Batch as an execution backend, the platform will deliver enhanced scalability, improved performance for batch workloads, and optimized utilization of GCP resources.
To implement this integration, the Cloud Pipeline platform will need to be configured to seamlessly interact with Google Batch for job submission, status monitoring, and resource management. This can be archieved by using Nextflow pipeline execution engine supporting GCP as one of executors. Platform shall provide the necessary identity and allow to run Nextflow pipelines with GCP Batch as backend executor.