Skip to content

[UR] Disable SYCL Graph submit tests in CI #17138

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Feb 24, 2025
Merged

[UR] Disable SYCL Graph submit tests in CI #17138

merged 1 commit into from
Feb 24, 2025

Conversation

reble
Copy link
Contributor

@reble reble commented Feb 24, 2025

No description provided.

@reble reble requested a review from a team as a code owner February 24, 2025 14:32
@github-actions GitHub Actions
Copy link
Contributor

Compute Benchmarks level_zero run (with params: --filter "graph"):
https://github.com/intel/llvm/actions/runs/13500591786

@github-actions GitHub Actions
Copy link
Contributor

Benchmarks level_zero run (--filter "graph"):
https://github.com/intel/llvm/actions/runs/13500591786
Job status: success. Test status: success.

Summary

(Emphasized values are the best results)
No diffs to calculate performance change

Performance change in benchmark groups

Compute Benchmarks
Relative perf in group SinKernelGraph 5 (5)
Benchmark This PR
graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:5 29.125000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:5 25.860000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:5 28.764000 μs
graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:5 33.058000 μs
graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:5 52.156000 μs
Relative perf in group SinKernelGraph 100 (5)
Benchmark This PR
graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:100 320.695000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:100 245.929000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:100 251.483000 μs
graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:100 270.836000 μs
graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:100 311.681000 μs

Details

Benchmark details - environment, command...
graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_sycl --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_sycl --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

@github-actions GitHub Actions
Copy link
Contributor

Compute Benchmarks level_zero run (with params: --filter "graph" --env UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1):
https://github.com/intel/llvm/actions/runs/13500934877

@github-actions GitHub Actions
Copy link
Contributor

Benchmarks level_zero run (--filter "graph" --env UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1):
https://github.com/intel/llvm/actions/runs/13500934877
Job status: success. Test status: success.

Summary

(Emphasized values are the best results)
No diffs to calculate performance change

Performance change in benchmark groups

Compute Benchmarks
Relative perf in group SinKernelGraph 5 (6)
Benchmark This PR
graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:5 29.144000 μs
graph_api_benchmark_sycl SinKernelGraph graphs:1, numKernels:5 39.101000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:5 25.680000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:5 29.245000 μs
graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:5 33.205000 μs
graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:5 43.030000 μs
Relative perf in group SinKernelGraph 100 (6)
Benchmark This PR
graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:100 321.756000 μs
graph_api_benchmark_sycl SinKernelGraph graphs:1, numKernels:100 277.878000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:100 246.420000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:100 250.305000 μs
graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:100 270.499000 μs
graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:100 282.857000 μs

Details

Benchmark details - environment, command...
graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_sycl --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_sycl SinKernelGraph graphs:1, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_sycl --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_sycl --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_sycl SinKernelGraph graphs:1, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_sycl --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

Environment Variables:

UR_L0_CMD_BUFFER_USE_IMMEDIATE_APPEND_PATH=1

@github-actions GitHub Actions
Copy link
Contributor

Compute Benchmarks level_zero run (with params: --filter "graph"):
https://github.com/intel/llvm/actions/runs/13501083971

@github-actions GitHub Actions
Copy link
Contributor

Benchmarks level_zero run (--filter "graph"):
https://github.com/intel/llvm/actions/runs/13501083971
Job status: success. Test status: success.

Summary

(Emphasized values are the best results)
No diffs to calculate performance change

Performance change in benchmark groups

Compute Benchmarks
Relative perf in group SinKernelGraph 5 (5)
Benchmark This PR
graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:5 29.025000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:5 25.716000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:5 29.137000 μs
graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:5 33.175000 μs
graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:5 51.755000 μs
Relative perf in group SinKernelGraph 100 (5)
Benchmark This PR
graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:100 317.963000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:100 245.648000 μs
graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:100 255.552000 μs
graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:100 270.638000 μs
graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:100 310.534000 μs

Details

Benchmark details - environment, command...
graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_sycl --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_sycl SinKernelGraph graphs:0, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_sycl --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_l0 SinKernelGraph graphs:0, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_l0 SinKernelGraph graphs:1, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_l0 --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:5

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=5 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_ur SinKernelGraph graphs:0, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=0 --withCopyOffload=1 --immediateAppendCmdList=0

graph_api_benchmark_ur SinKernelGraph graphs:1, numKernels:100

Command:

/home/test-user/llvm_bench_workdir/compute-benchmarks-build/bin/graph_api_benchmark_ur --test=SinKernelGraph --csv --noHeaders --iterations=10000 --numKernels=100 --withGraphs=1 --withCopyOffload=1 --immediateAppendCmdList=0

@reble reble changed the title [SYCL][Graph] Disable submit tests in CI [UR] Disable SYCL Graph submit tests in CI Feb 24, 2025
@reble
Copy link
Contributor Author

reble commented Feb 24, 2025

@intel/llvm-gatekeepers this can be merged.

@sarnex sarnex merged commit 47630fe into intel:sycl Feb 24, 2025
29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@pbalcer pbalcer pbalcer approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@reble @pbalcer @sarnex