Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

jj #5

Merged
merged 60 commits into from
Jun 13, 2020
Merged

jj #5

Changes from 1 commit
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
100a31a
Fix imports
oneonestar Jun 8, 2020
db1661e
Remove generics from ObjectReadFunction
findepi Jun 8, 2020
fd66bb7
Remove generics from ObjectWriteFunction
findepi Jun 8, 2020
6236648
Add source-pruning rule for TableWriterNode
kasiafi Jun 5, 2020
e3ba4d8
Refactor presto-orc module
Lewuathe May 4, 2020
7db9b48
Make partition_values optional in drop_stats
findepi Jun 6, 2020
a779a8a
Add @FileExists validation to presto-proxy
wendigo May 8, 2020
d343cde
Add @FileExists validation to presto-atop
wendigo May 8, 2020
0780220
Add @FileExists validation to presto-base-jdbc
wendigo May 8, 2020
c9fbbb1
Add @FileExists validation to presto-bigquery
wendigo May 8, 2020
4feb5f3
Add @FileExists validation to presto-cassandra
wendigo May 8, 2020
f48dd09
Add @FileExists validation to presto-elasticsearch
wendigo May 8, 2020
e27e037
Add @FileExists validation to presto-google-sheets
wendigo May 8, 2020
a55dfd9
Add @FileExists validation to presto-hive
wendigo May 8, 2020
267c6f4
Add @FileExists validation to presto-local-file
wendigo May 8, 2020
6605ca6
Add @FileExists validation to presto-main
wendigo May 8, 2020
0e5cebd
Add @FileExists validation to presto-password-authenticators
wendigo May 8, 2020
0c9a2c1
Add @FileExists validation to presto-phoenix
wendigo May 8, 2020
ec22fde
Add @FileExists validation to presto-plugin-toolkit
wendigo May 8, 2020
d04546d
Add @FileExists validation to presto-resource-group-managers
wendigo May 8, 2020
ab3772b
Add @FileExists validation to presto-session-property-managers
wendigo May 8, 2020
5a282bb
Verify dynamic filters are above table scan in DynamicFiltersChecker
raunaqmorarka Jun 8, 2020
b36baf5
Add test to verify that dynamic filters not above table scan are removed
raunaqmorarka Jun 8, 2020
6ffffd1
Add connector smoke test exercising table stats API
findepi May 26, 2020
4c51ac3
Code cleanup
findepi May 29, 2020
6238d6d
Increase tolerance in testEquateDistributionConsistentHashing test
sopel39 Jun 9, 2020
b6c06e9
Rename ThriftMetastoreClientFactory to DefaultThriftMetastoreClientFa…
losipiuk Jun 8, 2020
de7ec45
Extract ThriftMetastoreClientFactory interface
losipiuk Jun 8, 2020
d48409b
Make ThriftMetastoreClientFactory extendable
losipiuk Jun 8, 2020
0027cbe
Move Accumulo iterators to a separate module
adamjshook May 8, 2020
a00432f
Fix incorrect cast from timestamp to time
martint Jun 7, 2020
1792ae0
Fix version in the module
findepi Jun 9, 2020
cdb3c08
Remove redundant binding of RecordSetProvider
Praveen2112 Jun 9, 2020
d492734
Inject class loader safe classes with guice in Phoenix
Praveen2112 Jun 9, 2020
448363f
Remove check that each node has cached data
sopel39 Jun 9, 2020
ae7bab6
Avoid NPE when enumerating ThreadInfo's
wendigo Jun 10, 2020
130620b
Allow to override concurrency in benchmarks
sopel39 Jun 10, 2020
acdf5e3
Fix name of test runner script
losipiuk Jun 10, 2020
d656383
Remove dynamic filters with expression which are not a SymbolReference
raunaqmorarka May 15, 2020
b451b8d
Implement runtime partition pruning
raunaqmorarka Jul 2, 2019
7f278db
Rename LocalDynamicFilter to LocalDynamicFilterConsumer
raunaqmorarka May 15, 2020
45f9261
Remove unused variable
sopel39 Jun 10, 2020
e0bed26
Use more accurate node id
sopel39 Jun 10, 2020
9ba18bb
Test getFileBlockLocations with cache
sopel39 Jun 10, 2020
d034437
Fix typo
ssquan Jun 11, 2020
a33835e
Add main() to CassandraQueryRunner
findepi Jun 10, 2020
60932a1
Recognize tempto annotations in ReportUnannotatedMethods
findepi Jun 8, 2020
a1858e5
Add toString to table handle
martint Jun 11, 2020
4052f33
Add support for aggregation pushdow
Parth-Brahmbhatt May 11, 2020
a841e34
Inline stageDynamicFilterDomains
sopel39 Jun 11, 2020
35979dd
Use toImmutableList collector
sopel39 Jun 11, 2020
755b769
Remove unused method
sopel39 Jun 11, 2020
67a57ef
Filter already collected dynamic filters
sopel39 Jun 11, 2020
3ec59f4
Use ImmutableMap.of instead of builder
sopel39 Jun 11, 2020
708ebae
Remove redundant isNone check
sopel39 Jun 11, 2020
2f0fe3e
Stop collecting filters when all dynamic filters have been collected
sopel39 Jun 11, 2020
1a6626a
Document why no CHAR → VARCHAR coercion
findepi Jun 12, 2020
454bcbf
Fix ResultSet#getDate for dates before 1582
findepi Jun 11, 2020
9f3262c
Fix ResultSet#getTimestamp for historical timestamps
findepi Jun 12, 2020
f776741
Add pass-through query documentation
mosabua Jun 12, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Inline stageDynamicFilterDomains
  • Loading branch information
@sopel39
sopel39 committed Jun 12, 2020
commit a841e342049bf04ec9aa6153532ca60b1cc3aeda
7 changes: 3 additions & 4 deletions presto-main/src/main/java/io/prestosql/server/DynamicFilterService.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -112,12 +112,11 @@ public synchronized void collectDynamicFilters()
continue;
}
List<TaskInfo> tasks = stageInfo.getTasks();
Map<String, List<Domain>> stageDynamicFilterDomains = tasks.stream()
tasks.stream()
.map(taskInfo -> taskInfo.getTaskStatus().getDynamicFilterDomains())
.flatMap(taskDomains -> taskDomains.entrySet().stream())
.collect(groupingBy(Map.Entry::getKey, mapping(Map.Entry::getValue, toList())));

stageDynamicFilterDomains.entrySet().stream()
.collect(groupingBy(Map.Entry::getKey, mapping(Map.Entry::getValue, toList())))
.entrySet().stream()
// check if all tasks of a dynamic filter source have reported dynamic filter summary
.filter(stageDomains -> stageDomains.getValue().size() == tasks.size())
.forEach(stageDomains -> dynamicFilterSummaries.put(
Expand Down