Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
115 commits
Select commit Hold shift + click to select a range
7d233cb
ARROW-8631: [C++][Python][Dataset] Add ReadOptions to CsvFileFormat, …
lidavidm Mar 23, 2021
e2440a3
ARROW-11591: [C++][Compute] Grouped aggregation
bkietz Mar 23, 2021
76c27d3
ARROW-12051: [GLib] Keep input stream reference of GArrowCSVReader
kou Mar 23, 2021
14441db
ARROW-12037: [Rust] [DataFusion] Support catalogs and schemas for tab…
returnString Mar 23, 2021
496d7b3
ARROW-12029: [R] Remove args from FeatherReader$create v2
Mar 23, 2021
d005075
ARROW-12012: [Java][JDBC] Fix BinaryConsumer reallocation
Mar 24, 2021
8e43f23
ARROW-11497: [Python] Provide parquet enable compliant nested type fl…
trucnguyenjgx Mar 24, 2021
61d7cd3
ARROW-11883: [C++] Add ConcatMap, MergeMap, and an async-reentrant ve…
westonpace Mar 24, 2021
43caa2a
ARROW-12065: [C++][Python] Fix segfault reading JSON file
pitrou Mar 24, 2021
fe6ef70
ARROW-12047: [Rust] [Parquet] Cleanup clippy
jorgecarleitao Mar 24, 2021
8dd6abb
ARROW-12032: [Rust] Optimize comparison kernels
Dandandan Mar 24, 2021
33c826e
ARROW-12048: [Rust][DataFusion] Support Common Table Expressions
Dandandan Mar 24, 2021
bdbd1b3
ARROW-10606: [C++] Implement Decimal256 casts
lidavidm Mar 24, 2021
70b7330
ARROW-12073: [R] Fix R CMD check NOTE about ‘X_____X’
ianmcook Mar 24, 2021
9ad2562
ARROW-11693: [C++] Add string length kernel
edponce Mar 24, 2021
ece4606
ARROW-12070: [GLib] Drop support for GNU Autotools
kou Mar 25, 2021
41833d3
ARROW-12071: [GLib] Keep input stream reference of GArrowJSONReader
kou Mar 25, 2021
21483ad
ARROW-12076: [Rust] Fix build
alamb Mar 25, 2021
9262a5d
ARROW-11790: [Rust][DataFusion] Change builder signatures to take imp…
alamb Mar 25, 2021
47287fd
ARROW-11983: [Python] Avoid ImportError calling from_pandas in thread…
jorisvandenbossche Mar 25, 2021
65a4e65
ARROW-11596: [Python][Dataset] make ScanTask.execute() eager
lidavidm Mar 25, 2021
b13dc65
ARROW-11750: [Python][Dataset] Add support for project expressions
jorisvandenbossche Mar 25, 2021
1910224
PARQUET-1846: [C++] Remove deprecated IO classes
pitrou Mar 25, 2021
4749e70
ARROW-12077: [C++] Fix out-of-bounds write in ListArray::FromArrays
lidavidm Mar 25, 2021
14b75ee
PARQUET-2008: [C++] Fix information written in RowGroup::total_byte_size
pitrou Mar 25, 2021
7692461
ARROW-10580: [C++] Disallow non-monotonic dense union offsets
pitrou Mar 25, 2021
0bea590
ARROW-11422: [C#] add decimal support
llerrowa Mar 25, 2021
4eefa35
ARROW-12019: [Rust] [Parquet] Update README for 2.6.0 support
nevi-me Mar 25, 2021
b619cae
ARROW-12086: [C++] Fix environment variables for bzip2, utf8proc URLs
pitrou Mar 25, 2021
515b05c
ARROW-11703: [R] Implement dplyr::arrange()
ianmcook Mar 26, 2021
99d7291
ARROW-12081: [R] Bindings for utf8_length
nealrichardson Mar 26, 2021
a2a9f5d
ARROW-10306: [C++] Add string replacement kernel
maartenbreddels Mar 26, 2021
143c2be
ARROW-11736: [R] Allow string compute functions to be optional
nealrichardson Mar 26, 2021
2c5e264
ARROW-11365: [Rust] [Parquet] Logical type printer and parser
nevi-me Mar 26, 2021
b2fa55d
ARROW-12045: [Go][Parquet] Initial Chunk of Parquet port to Go
Mar 26, 2021
1d4856f
ARROW-11899: [Java] Refactor the compression codec implementation int…
liyafan82 Mar 26, 2021
6fe6c02
ARROW-11993: [C++] Don't download xsimd if ARROW_SIMD_LEVEL=NONE
cyb70289 Mar 26, 2021
a3130a8
ARROW-11914: [R] [CI] r-sanitizer nightly is broken
jonkeane Mar 26, 2021
51c9779
ARROW-11701: [R] Implement dplyr::relocate()
ianmcook Mar 26, 2021
5be6978
ARROW-12006: [Java] Fix checkstyle config to work on Windows
Mar 27, 2021
5f4252b
ARROW-11987: [C++][Gandiva] Implement trigonometric functions
jpedroantunes Mar 27, 2021
1c62117
ARROW-11988: [C++][Gandiva] Implements last_day function
anthonylouisbsb Mar 27, 2021
acbf264
ARROW-11658: [R] Handle mutate/rename inside group_by
nealrichardson Mar 27, 2021
017a93d
ARROW-12113: [R] Fix rlang deprecation warning from check_select_help…
ianmcook Mar 27, 2021
60011c0
ARROW-12116: [Rust] Fix and ignore 1.51 clippy lints
nevi-me Mar 27, 2021
894dd17
ARROW-12043: [Rust] [Parquet] Write FSB arrays
nevi-me Mar 28, 2021
05a507c
ARROW-12075: [Rust][DataFusion] Add CTE + UNION ALL to supported list…
alamb Mar 28, 2021
2661fc3
ARROW-11626: [Rust][DataFusion] Move [DataFusion] examples to own pro…
Dandandan Mar 28, 2021
22e452d
ARROW-12094: [C++][R] Fix re2 building on clang/libc++
nealrichardson Mar 29, 2021
3cfd611
ARROW-12130: [C++] Don't enable Neon if -DARROW_SIMD_LEVEL=NONE
cyb70289 Mar 29, 2021
229afa0
ARROW-12119: [Rust][DataFusion] Improve performance of to_array_of_si…
Dandandan Mar 29, 2021
be4fe74
ARROW-11838: [C++] Support IPC reads with shared dictionaries.
Mar 29, 2021
2756a03
ARROW-12067: [Python][Doc] Document pyarrow_(un)wrap_scalar
pitrou Mar 29, 2021
9e3aa85
ARROW-11887: [C++] Add asynchronous read to streaming CSV reader
westonpace Mar 29, 2021
7a35945
ARROW-11965: [R][Docs] Simplify install.packages command in R dev docs
Mar 29, 2021
1b9280f
ARROW-12131: [CI][GLib] Ensure upgrading MSYS2
kou Mar 29, 2021
bf9cbc0
ARROW-12103: [C++] Correctly handle unaligned access in bit-unpacking…
pitrou Mar 30, 2021
82c42bc
ARROW-12056: [C++] Create sequencing AsyncGenerator
westonpace Mar 30, 2021
e93c560
ARROW-12088: [Python] Fix compiler warning about offsetof
lidavidm Mar 30, 2021
897ff30
ARROW-10364: [Dev][Archery] Add support for semver 2.13.0
kou Mar 30, 2021
5535b48
ARROW-12139: [Python][Packaging] Use vcpkg to build macOS wheels
kszucs Mar 30, 2021
f004664
ARROW-12100: [C++][IPC] Allow null children field when num children is 0
pitrou Mar 30, 2021
066c6c3
ARROW-12136: [Rust][DataFusion] Reduce default batch_size to 8192
Dandandan Mar 30, 2021
b6982df
ARROW-12106: [Rust][DataFusion] Support `SELECT * from information_sc…
alamb Mar 30, 2021
9aa0f85
ARROW-11973 [Rust][DataFusion] Boolean kleene kernels
ch-sc Mar 30, 2021
4de0ed7
ARROW-12120: [Rust] Generate random arrays and batches
nevi-me Mar 30, 2021
2f56049
ARROW-9878: [Python] Document caveats of to_pandas(self_destruct=True)
lidavidm Mar 30, 2021
9386cfe
ARROW-12128: [CI][Crossbow] Remove test-ubuntu-16.04-cpp job
kou Mar 30, 2021
356630b
ARROW-11180: [Developer] cmake-format pre-commit hook doesn't run
MarcoGorelli Mar 30, 2021
a542e52
ARROW-12145: [Developer][Archery] Flaky: test_static_runner_from_json
dianaclarke Mar 31, 2021
8de898d
ARROW-12138: [Go][IPC] Update flatbuffers definitions
Mar 31, 2021
cd4379d
ARROW-12121: [Rust] [Parquet] Arrow writer benchmarks
nevi-me Mar 31, 2021
7a0d334
ARROW-7830: [C++][Parquet] Use Arrow version number for parquet
emkornfield Mar 31, 2021
7d664d5
ARROW-12089: [Doc] Fix Sphinx warnings
pitrou Mar 31, 2021
249fa7c
ARROW-12123: [Rust][DataFusion] Use smallvec for indices for better j…
Dandandan Mar 31, 2021
892776f
ARROW-12153: [Rust] [Parquet] Return file stats after writing file
nevi-me Mar 31, 2021
9a37f35
ARROW-12108: [Rust] [DataFusion] Implement SHOW TABLES
alamb Mar 31, 2021
af4d5f4
ARROW-12028 ARROW-11940: [Rust][DataFusion] Add TimestampMillisecond …
Mar 31, 2021
5bfae36
ARROW-12165: [Rust] inline append functions of builders
ritchie46 Mar 31, 2021
ab435da
ARROW-12143: [CI] R builds should timeout and fail after some thresho…
westonpace Mar 31, 2021
5216e04
PARQUET-1990: [C++] Refuse to write ConvertedType::NA
pitrou Apr 1, 2021
971a9d3
ARROW-12110: [Java] Implement ZSTD compression
Apr 1, 2021
223a067
ARROW-11858: [GLib][Gandiva] Add Gandiva::Filter and related functions
kou Apr 1, 2021
cc3bcf8
ARROW-12171: [Rust] clean up clippy lints
alamb Apr 1, 2021
caa8950
ARROW-12107: [Rust][DataFusion] Support `SELECT * from information_sc…
alamb Apr 1, 2021
1757ba2
ARROW-12160: [Rust] Add `into_inner()` to StreamWriter
ericwburden Apr 1, 2021
090f11c
ARROW-10354: [Rust][DataFusion] regexp_extract function to select reg…
sweb Apr 1, 2021
9b8a538
Implement in expression
jvictorhuguenin Mar 18, 2021
6829f71
Update hash function
jvictorhuguenin Mar 19, 2021
bb32b63
Update hash implementation
jvictorhuguenin Mar 19, 2021
0c24b82
Update Decimal type used
jvictorhuguenin Mar 19, 2021
e5438a6
Update test and stub type
jvictorhuguenin Mar 19, 2021
b31a526
Implement overwrite function
jvictorhuguenin Mar 19, 2021
8facda0
Implemented disassembled decimal types at stub functions
jvictorhuguenin Mar 22, 2021
72a6ef7
Add decimalIR to VisitInExpression method
jvictorhuguenin Mar 22, 2021
f8f3fa6
Change decimal type to Arrows' decimal128
jvictorhuguenin Mar 22, 2021
699763e
Correct test for in decimal expressions
jpedroantunes Mar 23, 2021
6fe4c0b
Remove unused llvm decimal type
jvictorhuguenin Mar 23, 2021
1939553
Apply quality changes
jvictorhuguenin Mar 23, 2021
c8ebb44
Implements hash for the class DecimalScalar128 and change type used f…
jvictorhuguenin Mar 23, 2021
6a4762d
Add custom structures to IN expressions looking for decimal numbers
jvictorhuguenin Mar 23, 2021
21b05fe
Add JNI bind for IN expressions for Decimal type
jvictorhuguenin Mar 23, 2021
c9dd98d
Remove unnecessary properties from InExpressionNode
jvictorhuguenin Mar 24, 2021
959d121
Implement support for JNI functions
jvictorhuguenin Mar 24, 2021
63ba5c2
Add BigDecimal support
jvictorhuguenin Mar 25, 2021
31c80ed
Fix JNI support
jvictorhuguenin Mar 26, 2021
26616ba
Fix extern include in gdv_function_stubs.h
jvictorhuguenin Mar 26, 2021
8711ae7
Fix unused const statement from dex.h
jvictorhuguenin Mar 26, 2021
81df39f
Fix unused const statement from dex.h
jvictorhuguenin Mar 26, 2021
73c85fb
Add test cases for -0.0, +inf and -inf
jvictorhuguenin Mar 29, 2021
3fcc629
Fix problems with backward compatibility
jvictorhuguenin Mar 30, 2021
9e2ba58
Implement hash_combine for hash function of gandiva::DecimalScalar128
jvictorhuguenin Mar 31, 2021
006054a
Fix parameters for hash_combine
jvictorhuguenin Mar 31, 2021
89b2172
Fix decimal parameters names at MakeDecimalVector function
jvictorhuguenin Mar 31, 2021
c1a8206
Fix checkstyle problem
jvictorhuguenin Apr 1, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
3 changes: 2 additions & 1 deletion .env
Original file line number Diff line number Diff line change
Expand Up @@ -69,5 +69,6 @@ R_TAG=latest
# -1 does not attempt to install a devtoolset version, any positive integer will install devtoolset-n
DEVTOOLSET_VERSION=-1

# Used for the manylinux and windows wheels
# Used for the manylinux and windows wheels, please update the crossbow configuration on update:
# https://github.com/ursacomputing/crossbow/blob/master/.github/workflows/cache_vcpkg.yml
VCPKG=fced4bef1606260f110d74de1ae1975c2b9ac549
63 changes: 41 additions & 22 deletions .github/workflows/r.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,24 +20,24 @@ name: R
on:
push:
paths:
- '.github/workflows/r.yml'
- 'ci/scripts/r_*.sh'
- 'ci/scripts/cpp_*.sh'
- 'ci/scripts/PKGBUILD'
- 'ci/etc/rprofile'
- 'ci/docker/**'
- 'cpp/**'
- 'r/**'
- ".github/workflows/r.yml"
- "ci/scripts/r_*.sh"
- "ci/scripts/cpp_*.sh"
- "ci/scripts/PKGBUILD"
- "ci/etc/rprofile"
- "ci/docker/**"
- "cpp/**"
- "r/**"
pull_request:
paths:
- '.github/workflows/r.yml'
- 'ci/scripts/r_*.sh'
- 'ci/scripts/cpp_*.sh'
- 'ci/scripts/PKGBUILD'
- 'ci/etc/rprofile'
- 'ci/docker/**'
- 'cpp/**'
- 'r/**'
- ".github/workflows/r.yml"
- "ci/scripts/r_*.sh"
- "ci/scripts/cpp_*.sh"
- "ci/scripts/PKGBUILD"
- "ci/etc/rprofile"
- "ci/docker/**"
- "cpp/**"
- "r/**"

env:
DOCKER_VOLUME_PREFIX: ".docker/"
Expand Down Expand Up @@ -86,6 +86,15 @@ jobs:
- name: Dump install logs
run: cat r/check/arrow.Rcheck/00install.out
if: always()
- name: Dump test logs
run: cat r/check/arrow.Rcheck/tests/testthat.Rout*
if: always()
- name: Save the test output
if: always()
uses: actions/upload-artifact@v2
with:
name: test-output
path: r/check/arrow.Rcheck/tests/testthat.Rout*
- name: Docker Push
if: success() && github.event_name == 'push' && github.repository == 'apache/arrow'
continue-on-error: true
Expand All @@ -99,8 +108,8 @@ jobs:
fail-fast: false
matrix:
config:
- {org: 'rstudio', image: 'r-base', tag: '4.0-centos7'}
- {org: 'rhub', image: 'debian-gcc-devel', tag: 'latest'}
- { org: "rstudio", image: "r-base", tag: "4.0-centos7" }
- { org: "rhub", image: "debian-gcc-devel", tag: "latest" }
env:
R_ORG: ${{ matrix.config.org }}
R_IMAGE: ${{ matrix.config.image }}
Expand Down Expand Up @@ -134,6 +143,15 @@ jobs:
- name: Dump install logs
run: cat r/check/arrow.Rcheck/00install.out
if: always()
- name: Dump test logs
run: cat r/check/arrow.Rcheck/tests/testthat.Rout*
if: always()
- name: Save the test output
if: always()
uses: actions/upload-artifact@v2
with:
name: test-output
path: r/check/arrow.Rcheck/tests/testthat.Rout*
- name: Docker Push
if: success() && github.event_name == 'push' && github.repository == 'apache/arrow'
continue-on-error: true
Expand All @@ -149,7 +167,7 @@ jobs:
rtools: [35, 40]
env:
TEST_R_WITH_ARROW: "TRUE"
ARROW_R_CXXFLAGS: '-Werror'
ARROW_R_CXXFLAGS: "-Werror"
_R_CHECK_TESTS_NLINES_: 0
steps:
- run: git config --global core.autocrlf false
Expand Down Expand Up @@ -187,13 +205,13 @@ jobs:
- uses: r-lib/actions/setup-r@master
with:
rtools-version: 40
r-version: '4.0'
r-version: "4.0"
Ncpus: 2
- uses: r-lib/actions/setup-r@master
if: ${{ matrix.rtools == 35 }}
with:
rtools-version: 35
r-version: '3.6'
r-version: "3.6"
Ncpus: 2
- name: Build Arrow C++
shell: bash
Expand Down Expand Up @@ -221,7 +239,8 @@ jobs:
build_args = '--no-build-vignettes',
args = c('--no-manual', '--as-cran', '--ignore-vignettes', '--run-donttest'),
error_on = 'warning',
check_dir = 'check'
check_dir = 'check',
timeout = 3600
)
- name: Dump install logs
shell: cmd
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/rust.yml
Original file line number Diff line number Diff line change
Expand Up @@ -116,8 +116,8 @@ jobs:
# run tests on all workspace members with default feature list
cargo test
# test datafusion examples
cd datafusion
cargo test --no-default-features --features cli
cd datafusion-examples
cargo test --no-default-features
cargo run --example csv_sql
cargo run --example parquet_sql
cd ..
Expand Down
7 changes: 4 additions & 3 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -40,9 +40,10 @@ repos:
- id: cmake-format
name: CMake Format
language: python
entry: bash -c "pip install cmake-format && python run-cmake-format.py --check"
entry: echo
files: ^(.*/CMakeLists.txt|.*.cmake)$
entry: python run-cmake-format.py
types: [cmake]
additional_dependencies:
- cmake_format==0.5.2
- id: hadolint
name: Docker Format
language: docker_image
Expand Down
Loading