Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[3.13] gh-119118: Fix performance regression in tokenize module (GH-119615) #119682

Merged
merged 1 commit into from
May 28, 2024
Merged

[3.13] gh-119118: Fix performance regression in tokenize module (GH-119615) #119682

merged 1 commit into from
May 28, 2024

Commits on May 28, 2024

  1. pythongh-119118: Fix performance regression in tokenize module (pytho… 

    …nGH-119615)

* pythongh-119118: Fix performance regression in tokenize module

- Cache line object to avoid creating a Unicode object
  for all of the tokens in the same line.
- Speed up byte offset to column offset conversion by using the
  smallest buffer possible to measure the difference.

(cherry picked from commit d87b015)

Co-authored-by: Lysandros Nikolaou <lisandrosnik@gmail.com>
Co-authored-by: Pablo Galindo <pablogsal@gmail.com>
    @lysnikolaou @pablogsal @miss-islington
    2 people authored and miss-islington committed May 28, 2024
    Configuration menu
    Copy the full SHA
    64be1b7 View commit details
    Browse the repository at this point in the history