Skip to content

[SPARK-38985][SQL] Add sub error classes #36307

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 7 commits into from

Conversation

srielau
Copy link
Contributor

@srielau srielau commented Apr 21, 2022

What changes were proposed in this pull request?

We support nesting an optional map of "sub error classes" in error-classes.json.
Each sub class has a distinct message and independent parameters.

Why are the changes needed?

A select subset of error classes have a large variety of error messages which cannot be easily tokenized.
But we do not want to split them because the conditions are often temporary. An example is UNSUPPORTED_FEATURE.
Supporting nested error classes allows us to keep the variety of messages without exploding the number of error classes.

Does this PR introduce any user-facing change?

Yes, we will change the error message texts

How was this patch tested?

Run all affected error test suites.

@srielau srielau force-pushed the SPARK-38985-sub-error-classes branch from 33c8d42 to f1bb2f7 Compare April 22, 2022 00:02
@HyukjinKwon HyukjinKwon changed the title [SPARK-38985] sub error classes [SPARK-38985][SQL] Add sub error classes Apr 22, 2022
@srielau srielau force-pushed the SPARK-38985-sub-error-classes branch 2 times, most recently from 53f9637 to ab7b64a Compare April 22, 2022 05:14
@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@srielau srielau force-pushed the SPARK-38985-sub-error-classes branch 3 times, most recently from c5a3736 to 645bcec Compare April 22, 2022 19:05
@srielau srielau force-pushed the SPARK-38985-sub-error-classes branch 3 times, most recently from 6d8f694 to ae80a6f Compare April 23, 2022 02:37
@srielau
Copy link
Contributor Author

srielau commented Apr 23, 2022

@cloud-fan @MaxGekk
Can you lend me a hand here? This last remaining failure seems unrelated to my PR, but it's a new-ish test case. Not sure if the test case is broken or the code behind it.
https://github.com/srielau/spark/runs/6137469861?check_suite_focus=true#step:9:13297

Other than that this is ready to go.

@srielau srielau force-pushed the SPARK-38985-sub-error-classes branch from ae80a6f to c9b723c Compare April 24, 2022 05:06
@srielau srielau force-pushed the SPARK-38985-sub-error-classes branch from c9b723c to a4eb0b6 Compare April 24, 2022 05:24
@srielau
Copy link
Contributor Author

srielau commented Apr 24, 2022

@MaxGekk @cloud-fan All clean now, can you please review and merge it if you agree.

@srielau srielau requested a review from MaxGekk April 25, 2022 14:16
srielau and others added 3 commits April 26, 2022 08:24
Co-authored-by: Wenchen Fan <cloud0fan@gmail.com>
…xecutionErrors.scala

Co-authored-by: Wenchen Fan <cloud0fan@gmail.com>
…xecutionErrors.scala

Co-authored-by: Wenchen Fan <cloud0fan@gmail.com>
@srielau srielau requested a review from cloud-fan April 27, 2022 00:03
@cloud-fan
Copy link
Contributor

thanks, merging to master!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants