Skip to content

[SYCL] Guard access to memory objects with a mutex #5231

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 19 commits into from
Mar 9, 2022
Merged

[SYCL] Guard access to memory objects with a mutex #5231

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
ef17116
[SYCL] Guard access to memory objects with a mutex
againull Dec 27, 2021
988e14f
Merge remote-tracking branch 'origin/sycl' into mem_mutex
againull Feb 22, 2022
00d4aa3
Use shared_lock to separate shared read and exclusive read/write access
againull Feb 23, 2022
c8c8564
Inline addMapping/removeMapping and move mutex to the pi_object class
againull Feb 23, 2022
2d3ad92
Use more fine-grained approach to lock mutexes
againull Feb 23, 2022
acb3bce
Replace PiQueueMutex with Mutex
againull Feb 23, 2022
20fc7fb
Remove comment
againull Feb 23, 2022
071d1bf
Adjust comments
againull Feb 23, 2022
3b66b4b
Use shorter style to lock multiple mutexes and add examples
againull Feb 23, 2022
8d150ac
Add single-threaded mode
againull Feb 23, 2022
cbcca19
Fix to exclusive access in piEnqueueMemUnmap
againull Feb 23, 2022
7c88b55
Fix env variable name
againull Feb 23, 2022
978cc9e
Merge remote-tracking branch 'origin/sycl' into mem_mutex
againull Feb 24, 2022
f543be3
Turn env variable into an integer
againull Feb 24, 2022
61b1cbc
Include header for std::stoi
againull Feb 24, 2022
addfc7d
Merge remote-tracking branch 'origin/sycl' into mem_mutex
againull Mar 3, 2022
786dc4b
Fix missing queue locks
againull Mar 4, 2022
2c0e864
Fix formatting
againull Mar 8, 2022
43f534a
Merge remote-tracking branch 'origin/sycl' into mem_mutex_publish
againull Mar 8, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions sycl/doc/EnvironmentVariables.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -140,6 +140,7 @@ variables in production code.</span>

| Environment variable | Values | Description |
| -------------------- | ------ | ----------- |
| `SYCL_PI_LEVEL_ZERO_SINGLE_THREAD_MODE` | Integer | A single-threaded app has an opportunity to enable this mode to avoid overhead from mutex locking in the Level Zero plugin. A value greater than 0 enables single thread mode. A value of 0 disables single thread mode. The default is 0. |
| `SYCL_PI_LEVEL_ZERO_MAX_COMMAND_LIST_CACHE` | Positive integer | Maximum number of oneAPI Level Zero Command lists that can be allocated with no reuse before throwing an "out of resources" error. Default is 20000, threshold may be increased based on resource availabilty and workload demand. |
| `SYCL_PI_LEVEL_ZERO_USM_ALLOCATOR` | [EnableBuffers][;[MaxPoolSize][;[host\|device\|shared:][MaxPoolableSize][,[Capacity][,SlabMinSize]]]...] | EnableBuffers enables pooling for SYCL buffers, default 0, set to 1 to enable. MaxPoolSize is the maximum size of the pool, default 0. MemType is host, device or shared. Other parameters are values specified as positive integers with optional K, M or G suffix. MaxPoolableSize is the maximum allocation size that may be pooled, default 0 for host and shared, 32KB for device. Capacity is the number of allocations in each size range freed by the program but retained in the pool for reallocation, default 0. Size ranges follow this pattern: 64, 96, 128, 192, and so on, i.e., powers of 2, with one range in between. SlabMinSize is the minimum allocation size, 64KB for host and device, 2MB for shared. Example: SYCL_PI_LEVEL_ZERO_USM_ALLOCATOR=1;32M;host:1M,4,64K;device:1M,4,64K;shared:0,0,2M|
| `SYCL_PI_LEVEL_ZERO_BATCH_SIZE` | Integer | Sets a preferred number of compute commands to batch into a command list before executing the command list. A value of 0 causes the batch size to be adjusted dynamically. A value greater than 0 specifies fixed size batching, with the batch size set to the specified value. The default is 0. |
Expand Down
Loading