-
Notifications
You must be signed in to change notification settings - Fork 28.8k
[SPARK-13894][SQL] SqlContext.range return type from DataFrame to DataSet #11730
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Test build #53195 has finished for PR 11730 at commit
|
Test build #53199 has finished for PR 11730 at commit
|
def range(start: Long, end: Long, step: Long, numPartitions: Int): DataFrame = { | ||
Dataset.newDataFrame(this, Range(start, end, step, numPartitions)) | ||
def range(start: Long, end: Long, step: Long, numPartitions: Int): Dataset[Long] = { | ||
import this.implicits._ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why is this needed?
Test build #53259 has finished for PR 11730 at commit
|
Test build #53266 has finished for PR 11730 at commit
|
Test build #53305 has finished for PR 11730 at commit
|
Thanks - merging in master. |
…aSet ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-13894 Change the return type of the `SQLContext.range` API from `DataFrame` to `Dataset`. ## How was this patch tested? No additional unit test required. Author: Cheng Hao <hao.cheng@intel.com> Closes apache#11730 from chenghao-intel/range.
What changes were proposed in this pull request?
https://issues.apache.org/jira/browse/SPARK-13894
Change the return type of the
SQLContext.range
API fromDataFrame
toDataset
.How was this patch tested?
No additional unit test required.