feat: Add a spark.comet.exec.memoryPool
configuration for experimenting with various datafusion memory pool setups.
#3105
Job | Run time |
---|---|
6m 29s | |
6m 41s | |
59m 27s | |
53m 56s | |
6m 31s | |
59m 44s | |
6m 38s | |
53m 40s | |
56m 59s | |
56m 56s | |
52m 6s | |
52m 27s | |
58m 18s | |
53m 26s | |
54m 16s | |
58m 1s | |
56m 39s | |
5m 6s | |
0s | |
1h 0m 27s | |
5m 6s | |
49m 14s | |
4m 47s | |
5m 38s | |
57m 3s | |
45m 42s | |
50m 4s | |
44m 3s | |
50m 18s | |
42m 3s | |
1h 4m 48s | |
54m 9s | |
5m 13s | |
51m 29s | |
45m 13s | |
5m 7s | |
5m 3s | |
51m 54s | |
5m 22s | |
54m 16s | |
56m 13s | |
54m 48s | |
50m 27s | |
49m 40s | |
1h 3m 44s | |
0s | |
1d 5h 49m 11s |