Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lambda inlining optimization #353

Open
wants to merge 87 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
87 commits
Select commit Hold shift + click to select a range
274fd19
Added lambda inlining
TimothyGeerkensGuardsquare Aug 3, 2023
043be3a
Fixes from inlining lambdas in the klox compiler
MaartenS11 Aug 4, 2023
c098ad8
Added test for retracer + addressed Oberon's comment from index 1 to 9
TimothyGeerkensGuardsquare Aug 4, 2023
7922f11
Merge branch 'lambda-inlining' of github.com:MaartenS11/proguard into…
MaartenS11 Aug 7, 2023
bb66672
Fixed regression from merge
MaartenS11 Aug 7, 2023
573995e
Removed some unused fields from the RecursiveInliner
MaartenS11 Aug 7, 2023
e4ce1e0
Removed import .* in LambdaLocator
TimothyGeerkensGuardsquare Aug 7, 2023
70e5966
Simplified the RecursiveInliner a bit
MaartenS11 Aug 7, 2023
aabc5bd
Cleaned up RecursiveInliner by moving some code into a new CalledMeth…
MaartenS11 Aug 7, 2023
f4a22fa
Move some code into IndyLambdaImplVisitor class
MaartenS11 Aug 7, 2023
7b2146e
Remove argument from RecursiveInliner because it isn't really needed …
MaartenS11 Aug 7, 2023
3573c19
Reduce line length a bit by putting index calculation in a variable
MaartenS11 Aug 7, 2023
025571c
Remove wildcard imports from RecursiveInliner
MaartenS11 Aug 7, 2023
845d044
Merge branch 'lambda-inlining' of github.com:MaartenS11/proguard into…
MaartenS11 Aug 7, 2023
13b38d5
Removed visitor staircase in LambdaLocator
TimothyGeerkensGuardsquare Aug 7, 2023
fb9fe7d
Removed wildcards in import
TimothyGeerkensGuardsquare Aug 7, 2023
cf74760
Cleaned up the while loop in the LambdaUsageFinder by using the new I…
MaartenS11 Aug 7, 2023
2090514
Merge branch 'lambda-inlining' of github.com:MaartenS11/proguard into…
MaartenS11 Aug 7, 2023
fb5eedb
Merge pull request #1 from MaartenS11/klox-fixes
MaartenS11 Aug 7, 2023
6ae5fc3
Removed unused class and method
TimothyGeerkensGuardsquare Aug 7, 2023
e90c5c9
merge
TimothyGeerkensGuardsquare Aug 7, 2023
33aa83d
Add more comments to the RecursiveInliner
MaartenS11 Aug 7, 2023
1d49b49
removed print and added logging
TimothyGeerkensGuardsquare Aug 7, 2023
cb60c13
refactored test and added performance tests
TimothyGeerkensGuardsquare Aug 7, 2023
3d3bf8f
Only stop inlining if we actually have the current lambda in one of t…
MaartenS11 Aug 7, 2023
8c354ab
refactored util
TimothyGeerkensGuardsquare Aug 8, 2023
813be34
Use argument index from LambdaUsageFinder instead of searching in the…
MaartenS11 Aug 8, 2023
f155107
RecursiveInliner should also use the argument index from the lambda u…
MaartenS11 Aug 8, 2023
7d82d2d
Remove findFirstLambdaParameter method since it is no longer needed
MaartenS11 Aug 8, 2023
047719c
WIP commit (please amend)
MaartenS11 Aug 8, 2023
5cc6748
Merge branch 'lambda-inlining' of github.com:MaartenS11/proguard into…
MaartenS11 Aug 8, 2023
1f5c85b
Merge pull request #2 from MaartenS11/recursive-inliner-adjustments
MaartenS11 Aug 8, 2023
54233a5
Put stop condition that was duplicated into a method
MaartenS11 Aug 8, 2023
ef37241
Don't hardcode the MethodInliner max resulting code size
MaartenS11 Aug 8, 2023
beeadd5
Merge branch 'lambda-inlining' of github.com:MaartenS11/proguard into…
MaartenS11 Aug 8, 2023
343df22
Fixed cast removal so it works in all cases
MaartenS11 Aug 8, 2023
71213fe
Reverted some minor accidental changes
MaartenS11 Aug 8, 2023
42493c6
Cleaned up a bit
MaartenS11 Aug 8, 2023
8cfd505
Merge pull request #3 from MaartenS11/more-fixes
MaartenS11 Aug 8, 2023
cff6565
Conditionally inline lambdas
MaartenS11 Aug 9, 2023
5644a9d
Added logging when a lambda has been inlined and only print method le…
MaartenS11 Aug 9, 2023
48c52e5
Log the consuming method and invoke method so the use knows which met…
MaartenS11 Aug 9, 2023
badf492
Merge pull request #4 from MaartenS11/inline-conditionally
MaartenS11 Aug 9, 2023
61e1e98
Fixed typo in comment
MaartenS11 Aug 9, 2023
00664b2
Removed some unnecessary comments from the tests
MaartenS11 Aug 9, 2023
fca2cde
Fixed typo in comment
MaartenS11 Aug 9, 2023
f8f1155
Rename package to lambdainline instead of lambdaInline
MaartenS11 Aug 9, 2023
bcab91e
Merge branch 'lambda-inlining' of github.com:MaartenS11/proguard into…
MaartenS11 Aug 9, 2023
2710ff3
Rename lambda_locator package to lambdalocator
MaartenS11 Aug 9, 2023
49bd302
Added newline to Lambda class and removed some unneeded methods
MaartenS11 Aug 9, 2023
55b4f0e
Use result of lambdaUsageHandler.handle() directly instead of storing…
MaartenS11 Aug 9, 2023
7613999
This doesn't have to be a nested if
MaartenS11 Aug 9, 2023
ee3e3ab
Added more javadoc comments to the IterativeInstructionVisitor
MaartenS11 Aug 9, 2023
f1ba773
Added more javadoc strings and fixed a typo
MaartenS11 Aug 9, 2023
7d602c9
Renamed isSourceInstruction to isNotSourceInstruction
TimothyGeerkensGuardsquare Aug 9, 2023
4d18370
Merge branch 'lambda-inlining' of github.com:MaartenS11/proguard into…
TimothyGeerkensGuardsquare Aug 9, 2023
2648338
Added more javadoc comments
MaartenS11 Aug 9, 2023
b431cb7
Apply suggestions from code review
MaartenS11 Aug 9, 2023
11f21f1
Use Optional in MethodLengthFinder so the programmer is made aware th…
MaartenS11 Aug 9, 2023
028e8c4
Merge branch 'lambda-inlining' of github.com:MaartenS11/proguard into…
MaartenS11 Aug 9, 2023
0cc53cd
Return ProgramMethod instead of just Method
MaartenS11 Aug 9, 2023
a440b45
Use the name kotlin lambdas instead of static lambdas in the LambdaLo…
MaartenS11 Aug 9, 2023
7e652b3
Renamed constantInstruction and offset to be more precise also added …
MaartenS11 Aug 9, 2023
607bf86
Added more info about what "a lambda" really means
MaartenS11 Aug 10, 2023
f69fd14
Change some things to the FixedPointCodeAttributeVisitor API
MaartenS11 Aug 10, 2023
95b23ab
invokespecial is now considered a potential source for the sourcetracer
TimothyGeerkensGuardsquare Aug 10, 2023
c5bca4a
merge
TimothyGeerkensGuardsquare Aug 10, 2023
23d4efe
Use library and program class pools instead of passing AppView
MaartenS11 Aug 10, 2023
7cdac26
Merge branch 'lambda-inlining' of github.com:MaartenS11/proguard into…
MaartenS11 Aug 10, 2023
03ae5c6
Made one of the debug log messages info again because it was accident…
MaartenS11 Aug 10, 2023
ad8b5ff
Add large javadoc comment explaining all the steps taken when using t…
MaartenS11 Aug 10, 2023
26d9850
Added comment explaining why descriptor is changed to use unboxed types
MaartenS11 Aug 10, 2023
a5ebb5e
Move a lot of code from the BaseLambdaInliner into a private inner cl…
MaartenS11 Aug 10, 2023
71b63a4
Fixed incorrect comment mentioning method that no longer exists
MaartenS11 Aug 10, 2023
7da8e01
Disable replacing usages with aconst_null
MaartenS11 Aug 10, 2023
751cc74
Add -inlinekotlinlambdas command line option to enable and disable la…
MaartenS11 Aug 10, 2023
f4f84e4
Moved lambda inlining optimization from inline to lambdainline packag…
MaartenS11 Aug 10, 2023
9d080b2
Add CannotInlineException message to debug log
MaartenS11 Aug 10, 2023
b8fbcd0
Add ProGuard header to every class
MaartenS11 Aug 11, 2023
3a866fc
Added detection for the second null check method for parameters in Ko…
MaartenS11 Aug 11, 2023
a910309
Added WIP README file to the lambdainline package
MaartenS11 Aug 11, 2023
0cf13a7
Fix example and explain more about the cast removal/boxing/unboxing
MaartenS11 Aug 11, 2023
1ba33ba
Mention a bit more which classes are used to do which operations
MaartenS11 Aug 11, 2023
ceea1b6
Be more specific when using the ClassReferenceInitializer, not all re…
MaartenS11 Aug 12, 2023
93d3bb6
Only re-run the ClassReferenceInitializer on the consuming class
MaartenS11 Aug 12, 2023
ac7f42d
Only run AccessFixer on consumingClass instead of the entire programC…
MaartenS11 Aug 12, 2023
370704b
Adjust conditional inlining attempt condition to use sum of consuming…
MaartenS11 Aug 13, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Renamed isSourceInstruction to isNotSourceInstruction
Resolved infinite loop when tracing source instruction of unreachable code
  • Loading branch information
TimothyGeerkensGuardsquare committed Aug 9, 2023
commit 7d602c96e7d8334a7080da99a3be48a25921b00a
24 changes: 17 additions & 7 deletions base/src/main/java/proguard/optimize/inline/SourceTracer.java
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ public static List<InstructionAtOffset> traceParameterOffset(PartialEvaluator pa
while (
(!isLoad(currentInstruction) ||
!partialEvaluator.getVariablesBefore(currentOffset).getProducerValue(((VariableInstruction) currentInstruction).variableIndex).instructionOffsetValue().isMethodParameter(0)) &&
isSourceInstruction(currentInstruction)
isNotSourceInstruction(currentInstruction)
) {
logger.debug(currentInstruction.toString(currentOffset));
currentTracedStack = partialEvaluator.getStackBefore(currentOffset);
Expand All @@ -62,7 +62,11 @@ public static List<InstructionAtOffset> traceParameterOffset(PartialEvaluator pa
}
currentOffset = offsetValue.instructionOffset(0);
} else {
currentOffset = currentTracedStack.getTopActualProducerValue(0).instructionOffsetValue().instructionOffset(0);
int newOffset = currentTracedStack.getTopActualProducerValue(0).instructionOffsetValue().instructionOffset(0);
if (newOffset == currentOffset) {
return null;
}
currentOffset = newOffset;
}
currentInstruction = InstructionFactory.create(codeAttribute.code, currentOffset);
trace.add(new InstructionAtOffset(currentInstruction, currentOffset));
Expand All @@ -80,7 +84,7 @@ public static Node traceParameterTree(PartialEvaluator partialEvaluator, CodeAtt
Node root = new Node(new InstructionAtOffset(currentInstruction, offset), new ArrayList<>());

// We stop when we found the source instruction
if (isSourceInstruction(currentInstruction)) {
if (isNotSourceInstruction(currentInstruction)) {
logger.debug(currentInstruction.toString(offset));
currentTracedStack = partialEvaluator.getStackBefore(offset);
logger.debug(currentTracedStack);
Expand All @@ -94,10 +98,16 @@ public static Node traceParameterTree(PartialEvaluator partialEvaluator, CodeAtt
offsetValue = currentTracedStack.getTopActualProducerValue(0).instructionOffsetValue();
}
for (int i = 0; i < offsetValue.instructionOffsetCount(); i++) {
if (!isLoad(currentInstruction) || !partialEvaluator.getVariablesBefore(offset).getProducerValue(((VariableInstruction) currentInstruction).variableIndex).instructionOffsetValue().isMethodParameter(i))
root.children.add(traceParameterTree(partialEvaluator, codeAttribute, offsetValue.instructionOffset(i), leafNodes));
else
if (!isLoad(currentInstruction) || !partialEvaluator.getVariablesBefore(offset).getProducerValue(((VariableInstruction) currentInstruction).variableIndex).instructionOffsetValue().isMethodParameter(i)) {
int newOffset = offsetValue.instructionOffset(i);
if (newOffset == offset) {
return root;
}
root.children.add(traceParameterTree(partialEvaluator, codeAttribute, newOffset, leafNodes));
}
else {
leafNodes.add(root.value);
}
}
}
else {
Expand All @@ -112,7 +122,7 @@ public static Node traceParameterTree(PartialEvaluator partialEvaluator, CodeAtt
* itself, without having to look further up the chain of instructions. We use this as a stopping condition when we
* are tracing the source of an instruction.
*/
private static boolean isSourceInstruction(Instruction instruction) {
private static boolean isNotSourceInstruction(Instruction instruction) {
return instruction.opcode != Instruction.OP_ACONST_NULL &&
instruction.canonicalOpcode() != Instruction.OP_ICONST_0 &&
instruction.canonicalOpcode() != Instruction.OP_DCONST_0 &&
Expand Down