Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CARBONDATA-441] Add modules for spark2 integration #344

Merged
merged 1 commit into from
Nov 23, 2016
Merged

[CARBONDATA-441] Add modules for spark2 integration #344

merged 1 commit into from
Nov 23, 2016

Conversation

jackylk
Copy link
Contributor

@jackylk jackylk commented Nov 23, 2016

To start spark2.0 integration with CarbonData, new modules need to be added:

  1. spark-common, which will have all common classes for both spark1 and spark2 integration
  2. spark2, which have carbon-spark2 integration

After the spark2 integration is done, CarbonData master branch should be enable to work with both spark1 and spark2. The target assembling is build by using profile, like:

  • To build integration with spark1.5: use -Pspark-1.5
  • To build integration with spark1.6: use -Pspark-1.6
  • To build integration with spark2.0: use -Pspark-2.0

@asfgit asfgit merged commit 1fd51aa into apache:master Nov 23, 2016
asfgit pushed a commit that referenced this pull request Nov 23, 2016
@chenliang613
[CARBONDATA-441] Add modules for spark2 integration This closes #344
068288d
Beyyes pushed a commit to Beyyes/carbondata that referenced this pull request Jul 12, 2018
@ydye
Fix bug in common packege function. And add ut. (apache#344)
5558822
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jackylk @asfgit