Skip to content

Submitting a batch job with file_path_lister is failing/timing out #2178

@vishalbollu

Description

@vishalbollu

Try the following config:

{
    ...
    "file_path_lister": {
        "s3_paths": [<string>], 
    }
}

When a list of 600 files is passed, the request times out when making a POST request using python's request library.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions