Add CI checks that we can serde all benchmark queries

[andygrove]

Which issue does this PR close?

N/A

Rationale for this change

Ballista relies on the ability to serde all benchmark queries. These CI checks help ensure that DataFusion continues to support this.

What changes are included in this PR?

• Add serde tests for all benchmark queries
• ignore test for q16 for now due to datafusion-proto deserialize with q16 sql fails  #3820 (this will be fixed in single_distinct_to_groupby no longer drops qualifiers #4050)

Are there any user-facing changes?

No

[andygrove]

@avantgardnerio fyi

[alamb]

I couldn't find evidence that this test actually ran 🤔

[alamb]

Why feature gate this with ci? I would have thought

#[cfg(test)]

was sufficient.

Additionally, I couldn't find evidence that these new tests were actually run:

-*- mode: grep; default-directory: "~/Downloads/logs_52324/" -*-
Grep started at Tue Nov  1 12:19:52

rg -n -H --no-heading -e 'serde_q7' 

Grep finished with no matches found at Tue Nov  1 12:19:52

🤔

[andygrove]

These tests rely on the data files existing in a path from TPCH_DATA env var, which is set in CI

[andygrove]

I did look into using MemTable but we don't support serde with MemTable

hit wrong button

[andygrove]

I couldn't find evidence that this test actually ran thinking

Thanks for catching that! I pushed a commit to add these tests to the workflow

[andygrove]

Verified that tests ran this time:

 test ci::serde_q1 ... ok
test ci::serde_q10 ... ok
test ci::serde_q11 ... ok
test ci::serde_q12 ... ok
test ci::serde_q13 ... ok
test ci::serde_q14 ... ok
test ci::serde_q15 ... ok
test ci::serde_q16 ... ignored
test ci::serde_q17 ... ok
test ci::serde_q18 ... ok
test ci::serde_q19 ... ok
test ci::serde_q2 ... ok
test ci::serde_q20 ... ok
test ci::serde_q21 ... ok
test ci::serde_q22 ... ok
test ci::serde_q3 ... ok
test ci::serde_q4 ... ok
test ci::serde_q5 ... ok
test ci::serde_q6 ... ok
test ci::serde_q7 ... ok
test ci::serde_q8 ... ok
test ci::serde_q9 ... ok

[ursabot]

Benchmark runs are scheduled for baseline = 525ac45 and contender = 8c26530. 8c26530 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ec2-t3-xlarge-us-east-2] ec2-t3-xlarge-us-east-2
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on test-mac-arm] test-mac-arm
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ursa-i9-9960x] ursa-i9-9960x
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ursa-thinkcentre-m75q] ursa-thinkcentre-m75q
Buildkite builds:
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java