TestLinearTransform.test_transform[cpu-dtype1-make_image_tensor] is flaky

[NicolasHug]

This test has been failing on a bunch of PRs now (e.g. https://hud.pytorch.org/pr/pytorch/vision/8452#25558824911).

2024-05-29T15:03:12.9534780Z _______ TestLinearTransform.test_transform[cpu-dtype1-make_image_tensor] _______
2024-05-29T15:03:12.9535200Z test/test_transforms_v2.py:5202: in test_transform
2024-05-29T15:03:12.9535480Z     check_transform(
2024-05-29T15:03:12.9535710Z test/test_transforms_v2.py:409: in check_transform
2024-05-29T15:03:12.9536180Z     _check_transform_v1_compatibility(transform, input, **_to_tolerances(check_v1_compatibility))
2024-05-29T15:03:12.9536710Z test/test_transforms_v2.py:270: in _check_transform_v1_compatibility
2024-05-29T15:03:12.9537190Z     assert_close(F.to_image(output_v2), F.to_image(output_v1), rtol=rtol, atol=atol)
2024-05-29T15:03:12.9537650Z E   AssertionError: Tensor-likes are not close!
2024-05-29T15:03:12.9537910Z E   
2024-05-29T15:03:12.9538080Z E   Mismatched elements: 1 / 561 (0.2%)
2024-05-29T15:03:12.9538500Z E   Greatest absolute difference: nan at index (2, 16, 6) (up to 1e-05 allowed)
2024-05-29T15:03:12.9539040Z E   Greatest relative difference: nan at index (2, 16, 6) (up to 1.3e-06 allowed)