Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[TOPI] VNNI support for int8 dense #10230

Merged
merged 19 commits into from
Feb 15, 2022
Merged

[TOPI] VNNI support for int8 dense #10230

Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
7751352
wip
masahi Jan 30, 2022
47c65f2
revert for now
masahi Feb 7, 2022
50a6207
simplify blocking
masahi Feb 10, 2022
15a2c5c
add bench script
masahi Feb 10, 2022
274360b
update type rel
masahi Feb 10, 2022
c726482
refactor tests
masahi Feb 10, 2022
a1bcb04
end to end compilation working
masahi Feb 10, 2022
1d61d52
paralleize outer loop
masahi Feb 10, 2022
3c93283
add shape check
masahi Feb 11, 2022
5a82e1f
fused schedule first cut
masahi Feb 11, 2022
4be2c8a
restore original test
masahi Feb 11, 2022
9d4f161
black
masahi Feb 11, 2022
eb47404
add vnni check
masahi Feb 11, 2022
1aac044
add relay test
masahi Feb 11, 2022
7840a9e
skip on ci
masahi Feb 11, 2022
a786bde
check dtype
masahi Feb 11, 2022
f7de3bf
lint
masahi Feb 11, 2022
cbfe979
make it tunable
masahi Feb 13, 2022
35f6bb1
minor cleanup
masahi Feb 13, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add vnni check
  • Loading branch information
@masahi
masahi committed Feb 13, 2022
commit eb4740401eb02141279b6a2509eaf6a0a2ddcbd3
5 changes: 4 additions & 1 deletion python/tvm/topi/x86/dense_alter_op.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@
from .dense import _default_dense_pack_config
from ..utils import get_const_tuple
from ..nn import dense_alter_layout
from .utils import target_has_vnni


@dense_alter_layout.register(["cpu", "arm_cpu"])
Expand All @@ -34,9 +35,11 @@ def _alter_dense_layout(attrs, inputs, tinfos, out_type):
out_dtype = out_type.dtype
M, K = get_const_tuple(data_tensor.shape)
N, _ = get_const_tuple(weight_tensor.shape)
mcpu = tvm.target.Target.current().mcpu

if (
"int8" in data_tensor.dtype
target_has_vnni(mcpu)
and "int8" in data_tensor.dtype
and weight_tensor.shape[0] % 16 == 0
and weight_tensor.shape[1] % 4 == 0
):
Expand Down