Skip to content

Conversation

@alamb
Copy link
Owner

@alamb alamb commented Mar 25, 2025

This is a PR to test running extended tests from a PR

Initially it has no real changes

irenjj and others added 30 commits March 9, 2025 08:19
* Implement tree explain for PartialSortExec

* simplify

* fix

* remove square brackets
* feat: implement tree explain for ProjectionExec

Signed-off-by: Alan Tang <jmtangcs@gmail.com>

* feat(test): support more tests

Signed-off-by: Alan Tang <jmtangcs@gmail.com>

* chore(explain): Reduce redundant output

Signed-off-by: Alan Tang <jmtangcs@gmail.com>

* Propose a different projection formatting

* feat: add project exec tree rendering for hash join

---------

Signed-off-by: Alan Tang <jmtangcs@gmail.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Implement `tree` explain for `SortExec`

* fix issues

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
…e#15073)

* [branch-46] Update changelog for backports to 46.0.0 (apache#14977)

* Add note about upgrade guide into the release notes (apache#14979)

* Add new crates

---------

Co-authored-by: xudong.w <wxd963996380@gmail.com>
apache#15081)

* Implement tree explain for `NestedLoopJoinExec`, `CrossJoinExec`, `SortMergeJoinExec` and `SymmetricHashJoinExec`

* fix issues

* fix issues

* fix

* fix proj
…c` (apache#15084)

* Implement `tree explain for `BoundedWindowAggExec` and `WindowAggExec`

* fix clippy

* add bounded win agg test

* add test

* remove

* merge

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* feat: support tree rendering for StreamingTableExec

Signed-off-by: Alan Tang <jmtangcs@gmail.com>

* feat: simpler expr for streamingExec

Signed-off-by: Alan Tang <jmtangcs@gmail.com>

chore: Describe more precisely

Signed-off-by: Alan Tang <jmtangcs@gmail.com>

---------

Signed-off-by: Alan Tang <jmtangcs@gmail.com>
Bumps [semver](https://github.com/dtolnay/semver) from 1.0.25 to 1.0.26.
- [Release notes](https://github.com/dtolnay/semver/releases)
- [Commits](dtolnay/semver@1.0.25...1.0.26)

---
updated-dependencies:
- dependency-name: semver
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [clap](https://github.com/clap-rs/clap) from 4.5.30 to 4.5.31.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](clap-rs/clap@clap_complete-v4.5.30...v4.5.31)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* implement tree explain for global limit exec

* optimize output
…cross optimizer runs. (apache#15074)

* refactor(15003): permit any combination of runs desired

* refactor(15003): convert macro to a function call on the TestConfig, and highlight when the same testing setup, but different ordering of optimizer runs, effect the outcome.

* chore: remove unneeded comments

* test: update test harness to use passed ref
* Improve parsing `extra_info` in tree explain

* Improve documentation and CrossJoinDisplay

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Minor: Fix invalid query in test

* other query
* fix: unparse for subqueryalias

* update

* move test
…Rel.filter (apache#14194)

* Propagate filter info from TableScan to ReadRel

Propagate information in datafusion::logical_expr::TableScan.filters
to substrait::proto::ReadRel.best_effort_filter.

* Add test

* cargo fmt

* Fix clippy error

* Use conjunction

* cargo fmt

* Use ReadRel.filter instead of best_effort_filter

* Check filter types in TableScan.filters

Use TableScan.source.supports_filters_pushdown() to determine if each
filter in TableScan.filters should be included in ReadRel.filter or
ReadRel.best_effort_filter

* Propagate Substrait ReadRel filter to consumer

* Address PR comments

* Propagate TableScan filters to ReadRel filter

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* fix build

* try to install clang in ci
* Fix broked `serde` feature

* Test `serde` feature

* consolidate serde test into core_integration, update run

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Do not normalize values

* Fix tests & update docs

* Prettier

* Lowercase config params

* Add snap to CLI & set up AWS mock

* Refactor tests

* Unify transform and parse

* Fix tests

* Setup CLI

* Show minio output

* Format Cargo.toml

* Do not hardcode AWS params

* Test options parsing

* Add allow http

* Fix aws build

* Fix ip

* Remove slash ☠️

* Format cargo toml

* Remove integration_setup.bash

* Update docs

* Do not hardcode test names

* Relock cargo

* Remove aws sdk and set up minio in-place

* Nit: Add missing ready local to the docs

* Fix backslash test

* Add missing backslash

* put integration scripts in a separate folder

* Move s3 tests from extended to rust flow

* Reorganise the docs

* Prettier

* Do not use rust container to get docker

* Add missing protobuf

* revert change to extended.yml

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.17.1 to 3.18.0.
- [Changelog](https://github.com/Stebalien/tempfile/blob/master/CHANGELOG.md)
- [Commits](Stebalien/tempfile@v3.17.1...v3.18.0)

---
updated-dependencies:
- dependency-name: tempfile
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [syn](https://github.com/dtolnay/syn) from 2.0.98 to 2.0.100.
- [Release notes](https://github.com/dtolnay/syn/releases)
- [Commits](dtolnay/syn@2.0.98...2.0.100)

---
updated-dependencies:
- dependency-name: syn
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Implement tree explain for AggregateExec

* Extract expr formatting logic for readability

* fix empty group_by display
…che#15137)

* feat: implement tree rendering for RepartitionExec

Signed-off-by: Alan Tang <jmtangcs@gmail.com>

* feat: implement tree rendering for WorkTableExec

Signed-off-by: Alan Tang <jmtangcs@gmail.com>

* bug: fix clippy error

Signed-off-by: Alan Tang <jmtangcs@gmail.com>

---------

Signed-off-by: Alan Tang <jmtangcs@gmail.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
…he#15090)

* first draft

* fix tests

* cleanup

* assert

* clippy

* fix test

* fix test
* Config: Add support default sql varchar to view types

* Fix test

* fix test

* Address comments

* Address comments

* Fix slt test
* fixed PushDownFilter bug [15047] by adding a new branch to match to prevent this specific situation

* improved syntax as request by CICL process

* moved check empty node logic into LogicalPlan::Extension(extensioon_plan)

* removed unecessary clone

* removed unecessary test
@github-actions github-actions bot added the core label Mar 25, 2025
goldmedal and others added 3 commits March 25, 2025 16:41
* add check for missing join condition

* modify the tests

* handle the cross join case

* remove invald sql case

* fix sqllogictests

* fix for cross join case

* revert the change for limit.slt

* add cross join test
…4`, etc) (apache#15341)

* type coercion fix for uint/int's.

* Refactored common numerical coercion logic into a single function.

* Cargo fmt.
…pache#15354)

* simplify `array_has` UDF to `InList` expr when haystack is constant

* add `.slt` tests, also simplify with `make_array`

* tweak comment

* add test for `make_array` arg simplification
@alamb
Copy link
Owner Author

alamb commented Mar 25, 2025

Ok, all tests have passed initially

Screenshot 2025-03-25 at 4 49 28 PM

I will now try and trigger extended tests

@alamb
Copy link
Owner Author

alamb commented Mar 25, 2025

Run extended tests

@alamb
Copy link
Owner Author

alamb commented Mar 25, 2025

So far so good !

Screenshot 2025-03-25 at 4 50 09 PM

@alamb
Copy link
Owner Author

alamb commented Mar 25, 2025

Now I have merged some commits I think will break extended tests and will try again

@alamb
Copy link
Owner Author

alamb commented Mar 25, 2025

Run extended tests

@alamb
Copy link
Owner Author

alamb commented Mar 26, 2025

And now it has failed as expected ❤️

Screenshot 2025-03-26 at 6 02 13 AM

@github-actions
Copy link

Thank you for your contribution. Unfortunately, this pull request is stale because it has been open 60 days with no activity. Please remove the stale label or comment or this will be closed in 7 days.

@github-actions github-actions bot added the Stale label May 26, 2025
@github-actions github-actions bot closed this Jun 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.