-
Notifications
You must be signed in to change notification settings - Fork 28.6k
[SPARK-8060] Improve DataFrame Python test coverage and documentation. #6601
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
cc @davies |
Test build #34044 has finished for PR 6601 at commit
|
@@ -196,7 +199,7 @@ def _inferSchema(self, rdd, samplingRatio=None): | |||
"can not infer schema") | |||
if type(first) is dict: | |||
warnings.warn("Using RDD of dict to inferSchema is deprecated," | |||
"please use pyspark.sql.Row instead") | |||
"please use pyspark.sql.Row instead", DeprecationWarning) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
DeprecationWarning is ignored by default.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do you mean we should remove all DeprecationWarning?
Test build #34049 has finished for PR 6601 at commit
|
LGTM |
Test build #34064 has finished for PR 6601 at commit
|
Author: Reynold Xin <rxin@databricks.com> Closes #6601 from rxin/python-read-write-test-and-doc and squashes the following commits: baa8ad5 [Reynold Xin] Code review feedback. f081d47 [Reynold Xin] More documentation updates. c9902fa [Reynold Xin] [SPARK-8060] Improve DataFrame Python reader/writer interface doc and testing. (cherry picked from commit ce320cb) Signed-off-by: Reynold Xin <rxin@databricks.com>
Author: Reynold Xin <rxin@databricks.com> Closes apache#6601 from rxin/python-read-write-test-and-doc and squashes the following commits: baa8ad5 [Reynold Xin] Code review feedback. f081d47 [Reynold Xin] More documentation updates. c9902fa [Reynold Xin] [SPARK-8060] Improve DataFrame Python reader/writer interface doc and testing.
Author: Reynold Xin <rxin@databricks.com> Closes apache#6601 from rxin/python-read-write-test-and-doc and squashes the following commits: baa8ad5 [Reynold Xin] Code review feedback. f081d47 [Reynold Xin] More documentation updates. c9902fa [Reynold Xin] [SPARK-8060] Improve DataFrame Python reader/writer interface doc and testing.
No description provided.