* Integrated asyncio.Queue within JobScaler (removes JobsQueue) and fully take advantage of its blocking .get .put functions
* Using asyncio.Queue(maxsize) to dictate concurrency (via concurrency_modifier)
* JobScaler.set_scale() adjusts concurrency when needed and safe in runtime
* JobScaler.current_occupancy() uses asyncio.Queue size and JobsProgress(set) size to gate capacity
* Simpler/cleaner job acquisition steps
* Removed legacy tracers for http clients

* fixed and added a test case for  Input validation "not working as expected #373"
* added an additional unit test for None

Updates the requirements on [cryptography](https://github.com/pyca/cryptography) to permit the latest version.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](pyca/cryptography@0.1...44.0.0)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dean Quiñanola <dean.quinanola@runpod.io>

…Huggingface repositories (#377)

* added a utility for resolving model cache paths from a huggingface repository

* Added a TODO for the `path_template` key word argument

* added unit tests for model cache resolver

* fixed module documentation

* resolve to None when a repository is improperly formatted

* fixed comment wording

---------

Co-authored-by: Dean Quiñanola <dean.quinanola@runpod.io>

This created false-positive completed tasks

* refactor: moved handle_uncaught_exception to rp_scale
* refactor: bind handle_uncaught_exception on JobScaler init
* fix: python <3.11 compatibility

* Add allowed CUDA versions parameter to endpoint creation
* Add gpu_count parameter to endpoint creation functions