Skip to content

Commit

Permalink
Merge branch 'oneapi-src:main' into gelu_erf
Browse files Browse the repository at this point in the history
  • Loading branch information
nikhilfujitsu committed Sep 9, 2024
2 parents f2bc645 + a8b478b commit f61ac72
Show file tree
Hide file tree
Showing 175 changed files with 4,107 additions and 3,298 deletions.
2 changes: 1 addition & 1 deletion CITATION.cff
Original file line number Diff line number Diff line change
Expand Up @@ -18,4 +18,4 @@ abstract: >-
oneDNN has experimental support for the following architectures: NVIDIA GPU,
AMD GPU, OpenPOWER Power ISA (PPC64), IBMz (s390x), and RISC-V.
license: Apache-2.0
version: v3.6
version: v3.7
2 changes: 1 addition & 1 deletion CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ endif()

set(PROJECT_NAME "oneDNN")
set(PROJECT_FULL_NAME "oneAPI Deep Neural Network Library (oneDNN)")
set(PROJECT_VERSION "3.6.0")
set(PROJECT_VERSION "3.7.0")

if (CMAKE_VERSION VERSION_LESS 3.0)
project(${PROJECT_NAME} C CXX)
Expand Down
4 changes: 2 additions & 2 deletions cmake/TBB.cmake
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#===============================================================================
# Copyright 2018-2022 Intel Corporation
# Copyright 2018-2024 Intel Corporation
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down Expand Up @@ -27,7 +27,7 @@ macro(handle_tbb_target)
if(TBB_FOUND)
set_property(TARGET TBB::tbb PROPERTY "MAP_IMPORTED_CONFIG_RELWITHMDD" "DEBUG")
include_directories_with_host_compiler(${_tbb_include_dirs})
list(APPEND EXTRA_SHARED_LIBS ${TBB_IMPORTED_TARGETS})
list(APPEND EXTRA_SHARED_LIBS TBB::tbb)

# Print TBB location
get_filename_component(_tbb_root "${_tbb_include_dirs}" PATH)
Expand Down
Binary file modified doc/graph/images/sdpa.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
10 changes: 5 additions & 5 deletions doc/graph/sdpa.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,11 +40,11 @@ optional.

1. The first MatMul calculates the dot products between Query and Key. See
[MatMul](@ref dev_guide_op_matmul) operation in Graph API.
2. The Scale node scales the output of the first MatMul with a scaling factor.
It can be constructed by [Multiply](@ref dev_guide_op_multiply) or
[Divide](@ref dev_guide_op_divide) operation in Graph API. The scaling factor
is given by users as an input of SDPA. \f$\sqrt{d_k}\f$ in the formula is not
considered as part of the SDPA pattern as it is constant.
2. The Scale node is optional and is used to scale the output of the first
MatMul with a scaling factor. It can be constructed by [Multiply](@ref dev_guide_op_multiply)
or [Divide](@ref dev_guide_op_divide) operation in Graph API. The scaling
factor is given by users as an input of SDPA. \f$\sqrt{d_k}\f$ in the formula
is not considered as part of the SDPA pattern as it is constant.
3. The Mask node is optional and is used to apply an attention mask to the
output of the previous Scale node. It can be constructed by [Add](@ref dev_guide_op_add)
or [Select](@ref dev_guide_op_select) operation in Graph API for different
Expand Down
1 change: 1 addition & 0 deletions examples/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -89,6 +89,7 @@ if(NOT ONEDNN_BUILD_GRAPH)
${CMAKE_CURRENT_SOURCE_DIR}/graph/sdpa.cpp
${CMAKE_CURRENT_SOURCE_DIR}/graph/mqa.cpp
${CMAKE_CURRENT_SOURCE_DIR}/graph/sdpa_stacked_qkv.cpp
${CMAKE_CURRENT_SOURCE_DIR}/graph/gqa.cpp
)
endif()

Expand Down
Loading

0 comments on commit f61ac72

Please sign in to comment.