-
Notifications
You must be signed in to change notification settings - Fork 3.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add dot product support for quantized convolution. #6445
Commits on Sep 29, 2020
-
Add dot product support for quantized convolution.
We added two new intrinsics in: topi/arm_cpu/tensor_intrin.py, namely - mmla4x4: compute a matrix multiplication between tile A(4,4) and tile B(4,4) - mmla16x4: compute a matrix multiplication between tile A(rows,4) and tile B(4,16) Then we used those intrinsics in two separate strategies. We added the strategies in topi/arm_cpu/conv2d_int8.py and implemented the schedules in topi/arm_cpu/conv2d_gemm.py. In particular: - schedule_conv2d_gemm, when accelerated, packs matrix A, compute GEMM, and unpack the resulting matrix. This uses the mmla4x4 intrinsic - schedule_conv2d_gemm_hybrid doesn't do any packing on A and C which are in native form. This uses the mmla16x4 intrinsic Please note that for the limitations of `tensorize` we need to pad matrix A in both cases (when dimensions are not multiple of the tiling shape) Change-Id: Id0d818d84ffc458c6dad7983fd350a0f3d5db395
Giuseppe Rossini committedSep 29, 2020 Configuration menu - View commit details
-
Copy full SHA for 30fe89b - Browse repository at this point
Copy the full SHA 30fe89bView commit details -
Add back nhwc_spatial_pack strategy as default
Change-Id: I8b1826a7ae1d742956296e8d157da19955a4942c
Giuseppe Rossini committedSep 29, 2020 Configuration menu - View commit details
-
Copy full SHA for 8b69ffd - Browse repository at this point
Copy the full SHA 8b69ffdView commit details -
Change-Id: Ic74ef5461a90bca9f4d4980a214137e384d5f923
Giuseppe Rossini committedSep 29, 2020 Configuration menu - View commit details
-
Copy full SHA for 16292e9 - Browse repository at this point
Copy the full SHA 16292e9View commit details -
Change-Id: I5fb8a2ae4467a87bd3470f6b3753c074f9b7cc78
Giuseppe Rossini committedSep 29, 2020 Configuration menu - View commit details
-
Copy full SHA for 7c8c867 - Browse repository at this point
Copy the full SHA 7c8c867View commit details -
Change-Id: I284b1f2c121051e672f548d6c6ee2a3267854e31
Giuseppe Rossini committedSep 29, 2020 Configuration menu - View commit details
-
Copy full SHA for 8168589 - Browse repository at this point
Copy the full SHA 8168589View commit details -
Change-Id: I1813b0226b536aedee0dce9eeeba27aa2d95518b
Giuseppe Rossini committedSep 29, 2020 Configuration menu - View commit details
-
Copy full SHA for 01d827a - Browse repository at this point
Copy the full SHA 01d827aView commit details -
Fixing failing test and adding tests for dot-product compilation
Change-Id: Ic040722abd5538fccb85af4de922394c939e7000
Giuseppe Rossini committedSep 29, 2020 Configuration menu - View commit details
-
Copy full SHA for 82ce647 - Browse repository at this point
Copy the full SHA 82ce647View commit details -
Fixing linting and review comments
Change-Id: If09e3baa514c85dc78d3c27c2ac2fa2e01773d89
Giuseppe Rossini committedSep 29, 2020 Configuration menu - View commit details
-
Copy full SHA for 16b9c6e - Browse repository at this point
Copy the full SHA 16b9c6eView commit details -
Fixing black linting and address comments
Change-Id: I857b28b6f9b23307d8c1eebc509de6ad2783c756
Giuseppe Rossini committedSep 29, 2020 Configuration menu - View commit details
-
Copy full SHA for 8fd794a - Browse repository at this point
Copy the full SHA 8fd794aView commit details
Commits on Oct 2, 2020
-
Change-Id: I63d1a639d4a72abeb33148fd2868cd356ef84122
Giuseppe Rossini committedOct 2, 2020 Configuration menu - View commit details
-
Copy full SHA for 0f8116a - Browse repository at this point
Copy the full SHA 0f8116aView commit details