Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CARBONDATA-850] Fix the comment definition issues of CarbonData thrift files #729

Closed
wants to merge 2 commits into from
Closed

Conversation

chenliang613
Copy link
Contributor

Fix the comment definition issues of CarbonData thrift files, for helping users to easier understand CarbonData file format.

@asfbot
Copy link

asfbot commented Apr 4, 2017

Can one of the admins verify this patch?

2 similar comments
@asfbot
Copy link

asfbot commented Apr 4, 2017

Can one of the admins verify this patch?

@asfbot
Copy link

asfbot commented Apr 4, 2017

Can one of the admins verify this patch?

@chenliang613
Copy link
Contributor Author

@ravipesala please review it, and please remember to deploy format jar to snapshot repo.

1: required ChunkCompressionMeta chunk_meta; // the metadata of a chunk
2: required bool rowMajor; // whether this chunk is a row chunk or column chunk ? Decide whether this can be replace with counting od columnIDs
1: required ChunkCompressionMeta chunk_meta; // The metadata of a chunk
2: required bool rowMajor; // Whether this chunk is a row chunk or column chunk, Decide whether this can be replace with counting of columnIDs.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Decide whether this can be replace with counting of columnIDs we can remove this part as we are deciding based on the schema file.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, agree.

@CarbonDataQA
Copy link

Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1415/

*/

/**
* File format description for the carbon file format
* File format description for CarbonData index file, one node one carbonindex file for building driver side's index tree.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess it is not required to mention that one node one carbonindex file for building driver side's index tree as it can change depends up on loading algorithm. In batch sort it creates one index file for one batch. And in the same way for bucket loading it creates one index file for each bucket and node.
We can just say that one index file for btree.

* Represents the data of one dimension one dimension group in one blocklet
*/
// add a innger level placeholder for further I/O granulatity
* Represents the data of one column page or one column page group in one blocklet.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Better phrase as follow.
Represents the data of one column page or one column page group in side blocklet.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

And also we can mention that we are currently not using it, we keep it as for future extend ability.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

agree

@CarbonDataQA
Copy link

Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1420/

@ravipesala
Copy link
Contributor

LGTM

@asfgit asfgit closed this in 5c4868e Apr 4, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants