Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add optimization patterns fusing ops into custom ops #1636

Draft
wants to merge 20 commits into
base: main
Choose a base branch
from

Merge branch 'main' into custom

3b4d700
Select commit
Loading
Failed to load commit list.
Draft

Add optimization patterns fusing ops into custom ops #1636

Merge branch 'main' into custom
3b4d700
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Jul 15, 2024 in 1s

84.83% of diff hit (target 74.88%)

View this Pull Request on Codecov

84.83% of diff hit (target 74.88%)

Annotations

Check warning on line 22 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L20-L22

Added lines #L20 - L22 were not covered by tests

Check warning on line 34 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L33-L34

Added lines #L33 - L34 were not covered by tests

Check warning on line 38 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L36-L38

Added lines #L36 - L38 were not covered by tests

Check warning on line 40 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L40

Added line #L40 was not covered by tests

Check warning on line 45 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L45

Added line #L45 was not covered by tests

Check warning on line 186 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L186

Added line #L186 was not covered by tests

Check warning on line 238 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L238

Added line #L238 was not covered by tests

Check warning on line 240 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L240

Added line #L240 was not covered by tests

Check warning on line 242 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L242

Added line #L242 was not covered by tests

Check warning on line 244 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L244

Added line #L244 was not covered by tests

Check warning on line 281 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L281

Added line #L281 was not covered by tests

Check warning on line 283 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L283

Added line #L283 was not covered by tests

Check warning on line 299 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L299

Added line #L299 was not covered by tests

Check warning on line 303 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L303

Added line #L303 was not covered by tests

Check warning on line 330 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L330

Added line #L330 was not covered by tests

Check warning on line 334 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L334

Added line #L334 was not covered by tests

Check warning on line 336 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L336

Added line #L336 was not covered by tests

Check warning on line 341 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L341

Added line #L341 was not covered by tests

Check warning on line 352 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L352

Added line #L352 was not covered by tests

Check warning on line 367 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L367

Added line #L367 was not covered by tests

Check warning on line 372 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L372

Added line #L372 was not covered by tests

Check warning on line 378 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L377-L378

Added lines #L377 - L378 were not covered by tests

Check warning on line 381 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L380-L381

Added lines #L380 - L381 were not covered by tests

Check warning on line 385 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L385

Added line #L385 was not covered by tests

Check warning on line 396 in onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/rewriter/custom_ops/llm_rule_sets_cuda.py#L396

Added line #L396 was not covered by tests