[SPARK-46741][SQL] Cache Table with CTE won't work #44767
Conversation
|
ping @cloud-fan |
AngersZhuuuu
changed the title
|
How about current? @cloud-fan |
| _.containsAnyPattern(CTE, PLAN_EXPRESSION)) { | ||
| case ref: CTERelationRef => | ||
| ref.copy(cteId = defIndex(ref.cteId).toLong) | ||
|
|
There was a problem hiding this comment.
can we make sure there is no nested WithCTE?
There was a problem hiding this comment.
can we make sure there is no nested
WithCTE?
Form the CTESubtitution's code, and it's pr, there won't have nested WithCTE. #37751 cc @maryannxue
There was a problem hiding this comment.
shall we add assert to guarantee this assumption?
There was a problem hiding this comment.
@cloud-fan Found nested WithCTE case, added to cte.sql and here change the method to support nested CTE, pls take a look again.
|
ping @cloud-fan @yaooqinn |
|
what was behaviour before? Would be great to show the result before/after |
For the query in before this pr, cached table |
|
We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. |
What changes were proposed in this pull request?
Cache Table with CTE won't work, there are two reasons
Cause the current case can't be matched.
Why are the changes needed?
Fix bug
Does this PR introduce any user-facing change?
Yea, Cache table with CTE can work after this pr
How was this patch tested?
Added UT
Was this patch authored or co-authored using generative AI tooling?
No