Pypi package size limit

[yifeif]

Hi,

I'm running into the following issue when trying to twine upload a package around 80MB:
HTTPError: 400 Client Error: distribution file too large for url: https://testpypi.python.org/pypi
What is the size limit for pypi package? Is there a way we can up the limit? Thanks.

[dstufft]

We can increase the limit on a package per package basis. I think the default limit is somewhere around 60MB? You'll have to upload to Warehouse (upload.pypi.org/legacy/ and test.pypi.org/legacy/) instead of to current PyPI but it will still show up on both.

[yifeif]

Thanks @dstufft! Will I still be able to use twine or the upload process is completely different?
I got the following by replacing with the given url,
HTTPError: 404 Client Error: Not Found for url: https://testpypi.python.org/legacy

[merwok]

The hostname in your error message is testpypi.python.org, but Donald’s message talks about test.pypi.org :)

[matham]

Our project has been waiting for this to be active but I hadn't realized this was already possible. How do we request a size increase for our project?

[dstufft]

@yifeif You can still use twine, but you need to use either https://test.pypi.org/legacy/ or upload.pypi.org/legacy/ for TestPyPI or PyPI (note the domain and trailing slash). You would also need to tell me the name of your project and why you need it increased (e.g. large image files, lots of compiled .so's, whatever) if you want the file size limit increased for that project.

@matham You can just ask me for one in this issue or via email or whatever. I just need to know the name of the project and why you need it increased (e.g. large image files, lots of compiled .so's, whatever).

[matham]

@dstufft that's great!

The project name is kivy.deps.gstreamer https://pypi.python.org/pypi/kivy.deps.gstreamer. It's a dependency of the kivy project and is used by the kivy project for video. The reason for the large size is that it includes all the gstreamer binaries and plugin dlls.

Currently we host it on our site and it's about 120MB. However,could you increase the limit to around 150MB in case the gstreamer distribution gets larger?

Thanks!

[yifeif]

Thanks @merwok and @dstufft! I was totally using the wrong sites :)

May I get a file size limit increased to 100MB for project 'tensorflow-gpu' https://pypi.python.org/pypi/tensorflow-gpu? It is currently at around 85MB.
In additional to the normal tensorflow package, it has much bigger .so for all the GPU supports. Thanks!

[yifeif]

@dstufft gentle ping on the file size increase request. Much appreciated!

[dstufft]

Okay, I've set kivy.deps.gstreamer to 150MB and tensorflow-gpu to 100MB. Note: This will only take affect when uploading to the new site at https://upload.pypi.org/legacy/, but the change will be reflected in both the old and the new site.

[yifeif]

Was able to upload to https://upload.pypi.org/legacy/ just now. Thanks so much @dstufft!

One more request, can we have the same size increase at https://test.pypi.org/legacy/ as well?

[dstufft]

@yifeif done!

[yifeif]

Awesome. Thanks again for all your help @dstufft :)

[matham]

@dstufft Thanks a lot!