Add Python 3.13 support

[yookoala]

Python 3.13 has been released in 7th Oct 2024. It is already scheduled to be shipped by some upcoming distro (e.g. Fedora 41). And since #3821, it is unable to be installed in Python 3.13. Please help to test and implement Python 3.13 support.

Related issue: ModelTC/LightLLM#575

[alex]

It's already supported: https://pyo3.rs/v0.22.5/changelog#packaging-1

[davidhewitt]

Yes, it looks like downstream just needs to bump their PyO3 version.

[yookoala]

How may I install the latest PyO3 with pip?

[alex]

You don't install pyo3 with pip. pyo3 is a dependency of the Rust portion of a Python package.

…

On Mon, Oct 21, 2024 at 12:26 PM Koala Yeung ***@***.***> wrote: How may I install the latest PyO3 with pip? — Reply to this email directly, view it on GitHub <#4636 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAAAGBAH4X3DRRKQF7UYANLZ4UTNDAVCNFSM6AAAAABQKPZYN2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMRXGE2TGNZXGE> . You are receiving this because you commented.Message ID: ***@***.***>

-- All that is necessary for evil to succeed is for good people to do nothing.

[yookoala]

I believe the project in question is tokenizers: https://github.com/huggingface/tokenizers

It is depending on pyo3 version 0.21. Which version should it depend on instead so it supports Python 3.13?

[davidhewitt]

It looks like you are waiting on huggingface/tokenizers#1639

[yookoala]

Seems to be waiting for huggingface/tokenizers#1646 for that.