This repository has been archived by the owner on Jun 13, 2024. It is now read-only.
This repository has been archived by the owner on Jun 13, 2024. It is now read-only.
AWS S3 URIs & URLs not currently handled by the pipeline #28
Open
Description
Is your feature request related to a problem? Please describe
When parsing the manifest file as part of the CHECK_INPUT process, there's a small check about that the provided path or url exists. However that check systematically fails for any s3 URI or URL provided.
Describe the solution you'd like
It would be great to be able to point to files on s3 in the manifest.
Describe alternatives you've considered
Running the workflow with files locally but this is a problem with mac as there are memory issues in another part of the workflow.