Add kwarg to filter columns

[JoaoAparicio]

Currently we don't have the option to load just a subset of the columns. This matters e.g. when compression is the bottleneck.

For example, create a compressed arrow file.

using Arrow
p = tempname();
N = 1000000
tbl = (
    a=rand(N),
    b=rand(N),
    c=rand(N),
    d=rand(N),
    e=rand(N),
    f=[rand(rand(0:100)) for _ in 1:N],
);
Arrow.write(p, tbl; compress=:zstd);

Column f is the longest - it has an expected 50*N elements vs N for the rest Some times we only care for some of the other columns. Currently we must decompress all columns regardless:

using BenchmarkTools
@btime tbl = Arrow.Table(p);  # 359.205 ms (530 allocations: 794.23 MiB)

With this commit we can load only some of the columns

@btime tbl = Arrow.Table(p; filtercolumns=["a"]);  # 6.146 ms (231 allocations: 14.33 MiB)

[JoaoAparicio]

#340
#353

[JoaoAparicio]

Converting this to draft as I'm working on something that will supersede this.

[codecov-commenter]

Codecov Report

❌ Patch coverage is 15.58442% with 65 lines in your changes missing coverage. Please review.
✅ Project coverage is 85.78%. Comparing base (787768f) to head (bc9169e).
⚠️ Report is 48 commits behind head on main.

Files with missing lines	Patch %	Lines
src/table.jl	15.58%	65 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #412      +/-   ##
==========================================
- Coverage   87.45%   85.78%   -1.67%     
==========================================
  Files          26       26              
  Lines        3283     3356      +73     
==========================================
+ Hits         2871     2879       +8     
- Misses        412      477      +65     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[JoaoAparicio]

Does anyone wanna re-run CI? Looks like macos got stuck

[kou]

Done.

[Yuan-Ru-Lin]

Hi, what's the status of this PR? Would love to see what I can do @JoaoAparicio

[oschulz]

This would be a very important feature for us, too.

[ericphanson]

for the API, filtercolumns seems a bit ambiguous to me (are we keeping them or removing them). CSV.jl has select and drop (https://csv.juliadata.org/stable/reading.html#CSV.File) which seems nice. Maybe select or select_columns for the name here?

[kou]

We need to rebase on main to proceed this.