Fix typing issues with SigLip2

[EricWiener]

What does this PR do?

Fixes #36754

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline,
  Pull Request section?
• Was this discussed/approved via a Github issue or the forum? Please add a link
  to it if that's the case.
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings.
• Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

[qubvel]

Thanks @EricWiener!

[EricWiener]

For sure and thanks for the quick review @qubvel ! Do you know if the failing tests are known to be flakey or could these failures be due to the slight difference in the type hints? Ex:

FAILED tests/models/kosmos2/test_modeling_kosmos2.py::Kosmos2ModelTest::test_generate_continue_from_past_key_values - AssertionError: Lists differ: [[86,[209 chars], 1, 1], [23, 21, 44, 83, 82, 86, 30, 54, 25, [277 chars] 25]] != [[86,[209 chars], 1, 45], [23, 21, 44, 83, 82, 86, 30, 54, 25,[278 chars] 25]]

[qubvel]

That's unrelated test failures, waiting for CI to pass to be able to merge

[EricWiener]

Hi @qubvel, could we please merge?

[qubvel]

Sure, thanks!