Excessive integration test sizes causing builds to fail

[rtyler]

Environment

Delta-rs version: v0.13.1

Binding: rust

---

Bug

What happened:

When running cargo test -p deltalake --no-default-features --features integration_test,s3-native-tls,datafusion an excessive amount of disk space is consumed When running with RUSTFLAGS="-C debuginfo=1" CARGO_INCREMENTAL=0 as CI does, the local target/ directory generates about 3.3GB of junk for me, with each binary linked for the tests/ coming in between 400-500MB.

What you expected to happen:

cargo not to shred my disks that much.

How to reproduce it:

Run zee tests

More details:

😬

[rtyler]

Some interesting details I encountered while testing, observing a build:

• Stock command_optimize binary with HEAD on main: 511M
• with strip = "debuginfo" in `Cargo.toml: 116M
• with strip = "debuginfo" and opt-level = "z"inCargo.toml`: 43M

The build is quite slow with opt-level set to z, but the strip configuration is reasonably fast to me. Still doing some experimentation to understand how these binary sizes are becoming so large before I spend time consolidating some things which behave more like unit tests out of these files