chore: another attempt at fixing pip-compile-multi

both @john-bodley and I have tried to fix the pip-compile-multi flow
that we need to manage our complex network of python dependencies.

Last attempt was here -> #26944

Here I'm reopening the PR on the main fork so we can collaborate on it
more easily.

requirements/base.in

@@ -20,3 +20,5 @@
 urllib3>=1.26.18
 werkzeug>=3.0.1
 numexpr>=2.9.0
+urllib3>=1.25.4,<1.27 # botocore 1.34.32
+referencing>=0.28.0,<0.32.0 # jsonschema-path 0.3.2