Incomprehensible benmark results from two `dfbench`s built in different dirs

[Rachelint]

Is your feature request related to a problem or challenge?

I found a extremely strange different results from two dfbench binaries...

• The first one is built by running cargo build --release --bin dfbench in datafusion dir.
• The second is built by running cargo build --release --bin dfbench in datafusion/benchmarks dir.

And in my local, I found in main branch:

• The first one cost 9200+ms when running q22 in clickbench.
• The second one cost 8800+ms when running q22 in clickbench.

In my branch in #11802

• The first one cost 8800+ms when running q22 in clickbench.
• The second one cost 9200+ms when running q22 in clickbench.

Describe the solution you'd like

I want to know why... It confused me much...

Describe alternatives you've considered

No response

Additional context

No response