Skip to content

[SYCL] Events caching for in-order queues in the L0 plugin #6643

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 15 commits into from
Closed

[SYCL] Events caching for in-order queues in the L0 plugin #6643

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
7ce4d4b
[SYCL] Events caching for in-order queues in the L0 plugin
againull Aug 24, 2022
77bc051
Merge remote-tracking branch 'origin/sycl' into advanced_caching_publ…
againull Aug 30, 2022
c308a1e
Add comments describing the optimization
againull Aug 30, 2022
5c2c3f8
Fix after merge with immediate command list changes and enable optimi…
againull Aug 30, 2022
cc788fa
Additional improvements and fixes
againull Sep 2, 2022
a4e88ef
Can't enable all events caching yet because of the issue in the L0 ru…
againull Sep 8, 2022
a4192c2
Merge remote-tracking branch 'origin/sycl' into advanced_caching
againull Sep 8, 2022
c83f3ad
Allow caching when profiling enabled
againull Sep 8, 2022
88814e6
Merge remote-tracking branch 'origin/sycl' into advanced_caching
againull Sep 13, 2022
1388ba4
Updates
againull Sep 14, 2022
be08d55
Remove loc
againull Sep 14, 2022
ce0c80e
Address review comments
againull Sep 14, 2022
3d1484d
Fix env variable values and rename function
againull Sep 14, 2022
c4e7b14
Rename candidate
againull Sep 14, 2022
b2610ed
Renaming
againull Sep 15, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions sycl/doc/EnvironmentVariables.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -187,6 +187,7 @@ variables in production code.</span>
| `SYCL_PI_LEVEL_ZERO_DEVICE_SCOPE_EVENTS` | Any(\*) | Enable support of device-scope events whose state is not visible to the host. If enabled mode is SYCL_PI_LEVEL_ZERO_DEVICE_SCOPE_EVENTS=1 the Level Zero plugin would create all events having device-scope only and create proxy host-visible events for them when their status is needed (wait/query) on the host. If enabled mode is SYCL_PI_LEVEL_ZERO_DEVICE_SCOPE_EVENTS=2 the Level Zero plugin would create all events having device-scope and add proxy host-visible event at the end of each command-list submission. The default is 2, meaning only the last event in a batch is host-visible. |
| `SYCL_PI_LEVEL_ZERO_USE_IMMEDIATE_COMMANDLISTS` | Integer | When set to a positive value enables use of Level Zero immediate commandlists, which means there is no batching and all commands are immediately submitted for execution. Default is 0. Note: When immediate commandlist usage is enabled it is necessary to also set SYCL_PI_LEVEL_ZERO_DEVICE_SCOPE_EVENTS to either 0 or 1. |
| `SYCL_PI_LEVEL_ZERO_USE_MULTIPLE_COMMANDLIST_BARRIERS` | Integer | When set to a positive value enables use of multiple Level Zero commandlists when submitting barriers. Default is 0. |
| `SYCL_PI_LEVEL_ZERO_INORDER_QUEUE_REUSE_EVENTS` | Integer | This environment variable controls an optimization for in-order queues which allows to reuse uncompleted Level Zero events in scope of the same queue based on the dependency chain between commands. When set to 0 the plugin will not perform this optimization. When set to 1 the plugin will reuse only explicitely discarded device-scope events for in-order queues. When set to 2 the plugin will try to reuse all device-scope events based on reference counting. Default is 2. |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| `SYCL_PI_LEVEL_ZERO_INORDER_QUEUE_REUSE_EVENTS` | Integer | This environment variable controls an optimization for in-order queues which allows to reuse uncompleted Level Zero events in scope of the same queue based on the dependency chain between commands. When set to 0 the plugin will not perform this optimization. When set to 1 the plugin will reuse only explicitely discarded device-scope events for in-order queues. When set to 2 the plugin will try to reuse all device-scope events based on reference counting. Default is 2. |
| `SYCL_PI_LEVEL_ZERO_INORDER_QUEUE_REUSE_EVENTS` | Integer | This environment variable controls an optimization for in-order queues which allows the reuse of uncompleted Level Zero events in scope of the same queue based on the dependency chain between commands. When set to 0 the plugin will not perform this optimization. When set to 1 the plugin will reuse only explicitly discarded device-scope events for in-order queues. When set to 2 the plugin will try to reuse all device-scope events based on reference counting. Default is 2. |


## Debugging variables for CUDA Plugin

Expand Down
Loading