Skip to content

Update test dependencies #1114

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Oct 25, 2023
Merged

Update test dependencies #1114

merged 1 commit into from
Oct 25, 2023

Conversation

justinchuby
Copy link
Collaborator

ORT -> 1.16.1 / PyTorch -> 2.1

ORT -> 1.16.1 / PyTorch -> 2.1
@justinchuby justinchuby requested a review from jcwchen October 25, 2023 20:56
@jcwchen jcwchen added dependencies Pull requests that update a dependency file merge at lgtm Reviewers can merge when they approve labels Oct 25, 2023
@codecov
Copy link

codecov bot commented Oct 25, 2023

Codecov Report

Merging #1114 (bca0dd9) into main (c68468e) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1114   +/-   ##
=======================================
  Coverage   78.17%   78.17%           
=======================================
  Files         117      117           
  Lines       14952    14952           
  Branches     1585     1585           
=======================================
  Hits        11688    11688           
  Misses       2897     2897           
  Partials      367      367           

@github-actions
Copy link

Test Results

         18 files  ±         0         18 suites  ±0   1h 26m 53s ⏱️ - 3m 53s
  11 074 tests  -   1 178    8 308 ✔️  -    931      2 729 💤  -      246       37 ±0 
158 748 runs   - 13 733  36 371 ✔️  - 3 243  120 523 💤  - 10 489  1 854 ±0 

For more details on these failures, see this check.

Results for commit bca0dd9. ± Comparison against base commit c68468e.

This pull request removes 2329 and adds 1151 tests. Note that renamed tests count towards both.
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0000_test_reduce_sum_square_negative_axes_keepdims_example_expanded
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0001_test_reduce_l2_do_not_keepdims_example
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0002_test_cast_FLOAT_to_BFLOAT16
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0003_test_bitwise_not_2d
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0004_test_asin_example
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0005_test_optional_has_element_tensor_input
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0006_test_layer_normalization_3d_axis_negative_1_epsilon_expanded_ver18
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0007_test_hardsigmoid_example_expanded_ver18
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0008_test_sequence_map_add_1_sequence_1_tensor
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0009_test_gru_batchwise
…
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0014_test_hardmax_one_hot
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0015_test_maxunpool_export_without_output_shape
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0016_test_max_example
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0017_test_layer_normalization_4d_axis_negative_2_expanded_ver18
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0018_test_sequence_map_extract_shapes_expanded
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0019_test_hardmax_default_axis
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0020_test_sub_bcast
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0022_test_concat_2d_axis_1
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0023_test_reduce_prod_keepdims_example
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0024_test_min_float16
…
This pull request removes 441 skipped tests and adds 193 skipped tests. Note that renamed tests count towards both.
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0002_test_cast_FLOAT_to_BFLOAT16
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0005_test_optional_has_element_tensor_input
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0008_test_sequence_map_add_1_sequence_1_tensor
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0009_test_gru_batchwise
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0010_test_cast_FLOAT16_to_FLOAT8E5M2FNUZ
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0020_test_split_variable_parts_2d_opset13
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0036_test_pow_types_float32_uint64
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0045_test_scan9_sum
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0047_test_cast_FLOAT8E4M3FN_to_FLOAT16
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0050_test_cast_FLOAT_to_FLOAT8E5M2FNUZ
…
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0018_test_sequence_map_extract_shapes_expanded
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0033_test_castlike_FLOAT_to_FLOAT8E4M3FN_expanded
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0044_test_cast_FLOAT16_to_FLOAT8E4M3FNUZ
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0049_test_castlike_FLOAT_to_FLOAT8E5M2FNUZ_expanded
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0054_test_center_crop_pad_crop_negative_axes_hwc_expanded
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0055_test_castlike_BFLOAT16_to_FLOAT_expanded
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0057_test_max_uint16
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0063_test_min_uint8
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0066_test_batchnorm_epsilon
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0068_test_maxunpool_export_with_output_shape
…
This pull request skips 3 and un-skips 1 tests.
onnxscript.tests.function_libs.torch_lib.ops_test.TestOutputConsistencyEagerCPU ‑ test_output_match_opinfo__normal_number_mean_cpu_float32
onnxscript.tests.function_libs.torch_lib.ops_test.TestOutputConsistencyFullGraphCPU ‑ test_output_match_opinfo__normal_number_mean_cpu_float16
onnxscript.tests.function_libs.torch_lib.ops_test.TestOutputConsistencyFullGraphCPU ‑ test_output_match_opinfo__normal_number_mean_cpu_float32
onnxscript.backend.onnx_export_test.TestOnnxBackEnd ‑ test_export2python_produces_correct_onnx_script_model_0000_test_constantofshape_float_ones

@justinchuby justinchuby merged commit 67f790b into main Oct 25, 2023
@justinchuby justinchuby deleted the justinchu/test-deps branch October 25, 2023 22:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file merge at lgtm Reviewers can merge when they approve
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants