-
Notifications
You must be signed in to change notification settings - Fork 28.6k
[SPARK-15543][SQL] Rename DefaultSources to make them more self-describing #13311
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
@@ -107,7 +107,7 @@ private[libsvm] class LibSVMOutputWriter( | |||
* @see [[https://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/ LIBSVM datasets]] | |||
*/ | |||
@Since("1.6.0") | |||
class DefaultSource extends FileFormat with DataSourceRegister { | |||
class LibSVMFileFormat extends FileFormat with DataSourceRegister { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
cc @jkbradley
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we add this to backwardCompatibilityMap
just to be safe?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we can ...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
it won't be type safe though.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i added it
Test build #59308 has finished for PR 13311 at commit
|
LGTM |
Test build #59310 has finished for PR 13311 at commit
|
Test build #59316 has finished for PR 13311 at commit
|
Test build #59318 has finished for PR 13311 at commit
|
Test build #59327 has finished for PR 13311 at commit
|
Test build #59326 has finished for PR 13311 at commit
|
Test build #59343 has finished for PR 13311 at commit
|
Merging in master/2.0. |
…ibing ## What changes were proposed in this pull request? This patch renames various DefaultSources to make their names more self-describing. The choice of "DefaultSource" was from the days when we did not have a good way to specify short names. They are now named: - LibSVMFileFormat - CSVFileFormat - JdbcRelationProvider - JsonFileFormat - ParquetFileFormat - TextFileFormat Backward compatibility is maintained through aliasing. ## How was this patch tested? Updated relevant test cases too. Author: Reynold Xin <rxin@databricks.com> Closes #13311 from rxin/SPARK-15543. (cherry picked from commit 361ebc2) Signed-off-by: Reynold Xin <rxin@databricks.com>
What changes were proposed in this pull request?
This patch renames various DefaultSources to make their names more self-describing. The choice of "DefaultSource" was from the days when we did not have a good way to specify short names.
They are now named:
Backward compatibility is maintained through aliasing.
How was this patch tested?
Updated relevant test cases too.