feat: Add a spark.comet.exec.memoryPool
configuration for experimenting with various datafusion memory pool setups.
#3101
Job | Run time |
---|---|
2m 19s | |
2m 19s | |
58m 5s | |
58m 4s | |
2m 23s | |
2m 25s | |
53m 41s | |
1h 0m 10s | |
58m 37s | |
53m 13s | |
51m 14s | |
1m 44s | |
58m 23s | |
2m 2s | |
55m 10s | |
51m 47s | |
1m 45s | |
1h 0m 56s | |
1m 51s | |
48m 42s | |
0s | |
1h 1m 47s | |
1h 10m 20s | |
50m 23s | |
56m 7s | |
59m 44s | |
1m 40s | |
54m 36s | |
2m 13s | |
58m 19s | |
1m 59s | |
49m 48s | |
1m 47s | |
57m 48s | |
52m 51s | |
50m 42s | |
44m 43s | |
47m 19s | |
44m 41s | |
1h 2m 48s | |
52m 9s | |
0s | |
44m 52s | |
43m 15s | |
50m 9s | |
43m 39s | |
1d 5h 8m 29s |