Support query filter on all benchmarks

[pepijnve]

Which issue does this PR close?

None

Rationale for this change

bench.sh currently supports query filtering for tpch specifically. Most of the other multi query benchmarks support this too, but not via bench.sh. It would make sense to have this capability for all benchmarks that support it.

What changes are included in this PR?

Promote the tpch specific logic to the top level

Are these changes tested?

Manually tested

Are there any user-facing changes?

No

[alamb]

I ran the following command:

(venv) andrewlamb@Andrews-MacBook-Pro-3:~/Software/datafusion$ ./benchmarks/bench.sh run clickbench_partitioned

And it passes n main but fails on this branch:

     Running `/Users/andrewlamb/Software/datafusion/target/release/dfbench clickbench --iterations 5 --path /Users/andrewlamb/Software/datafusion/benchmarks/data/hits_partitioned --queries-path /Users/andrewlamb/Software/datafusion/benchmarks/queries/clickbench/queries -o /Users/andrewlamb/Software/datafusion/benchmarks/results/bench_query_filter/clickbench_partitioned.json`
Running benchmarks with the following options: RunOpt { query: None, common: CommonOpt { iterations: 5, partitions: None, batch_size: None, mem_pool_type: "fair", memory_limit: None, sort_spill_reservation_bytes: None, debug: false }, path: "/Users/andrewlamb/Software/datafusion/benchmarks/data/hits_partitioned", queries_path: "/Users/andrewlamb/Software/datafusion/benchmarks/queries/clickbench/queries", output_path: Some("/Users/andrewlamb/Software/datafusion/benchmarks/results/bench_query_filter/clickbench_partitioned.json") }
Error: Execution("Could not open \"/Users/andrewlamb/Software/datafusion/benchmarks/queries/clickbench/queries\": No such file or directory (os error 2)")

🤔

Clicked wrong button

[pepijnve]

Oh now I see what happened. I got some bench.sh changes intended for PR #16476 mixed up with this branch 🤦‍♂️.

[alamb]

Thank you @pepijnve !

I tried

./benchmarks/bench.sh run clickbench_partitioned

and also

./benchmarks/bench.sh run clickbench_partitioned 1

And they both worked great!

[pepijnve]

I can't seem to make sense of the doc error. Doesn't seem to be related to the changes in this PR.

Just saw this was fixed on main.

[alamb]

I also double checked that the commands from #16477 (review) still work.

🚀

[alamb]

Thanks again @pepijnve