Skip to content

compileall with workers would is faster with larger chunksize #117205

Closed
@hauntsaninja

Description

@hauntsaninja

Feature or enhancement

Proposal:

Currently we do a map with the default chunksize=1 over files:

results = executor.map(partial(compile_file,

A quick local benchmark suggests that chunksize=4 would be 20% faster

Has this already been discussed elsewhere?

This is a minor feature, which does not need previous discussion elsewhere

Links to previous discussion of this feature:

No response

Linked PRs

Metadata

Metadata

Assignees

No one assigned

    Labels

    performancePerformance or resource usagestdlibPython modules in the Lib dirtype-featureA feature request or enhancement

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions