-
Notifications
You must be signed in to change notification settings - Fork 9.2k
HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... #1829
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
💔 -1 overall
This message was automatically generated. |
392b8f4 to
d2ccfff
Compare
|
💔 -1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
...hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeAttributeProvider.java
Outdated
Show resolved
Hide resolved
...hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeAttributeProvider.java
Outdated
Show resolved
Hide resolved
...hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeAttributeProvider.java
Outdated
Show resolved
Hide resolved
ba59481 to
f5b205e
Compare
|
💔 -1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
The javac warnings are expected since we deprecate the original API and add tests for them. |
|
💔 -1 overall
This message was automatically generated. |
...op-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeAttributeProvider.java
Outdated
Show resolved
Hide resolved
|
The javac warning is because of the deprecation added in the code. The javadoc warning looks like a false positive to me. getter/setter: used Intellij to assist this part |
Change-Id: I1e86ec74e3bc2174a38b00c7731a9e870f87bbd5 (cherry picked from commit 8d76576)
Change-Id: Ib22ef70b26fa6eccbac0dedd10b906cbaa84f47b (cherry picked from commit b92754e)
Change-Id: I4e103e333b980a41214d9c954dfdfced64202ac1
Change-Id: Ice1cc086a748bc8c85a5502fe7382c1ad8cf9f84
Change-Id: I2fc6bf724f21193fb06f6cd9b9c98ef7ba786fa1
Change-Id: I245e000bd1ca41b5a261f60672e9fd4ecfe272b1
(1) Updated INodeAttributeProvider#equals. (2) Added javadoc of checkPermissionWithContext. (3) Removed the unused constructor. Change-Id: I15b4235dd220330072f62c3cfa1954eda0308632
Change-Id: I9e3c673ac8b1091a18ada941c7dfe360a6f2f5ca
Change-Id: Ibf4af2171a86acefa424b96dbfa6dcefc4dbb07d
Change-Id: I83d03a9925c80f220d178cced4bd73045bb7b346
|
💔 -1 overall
This message was automatically generated. |
|
javac and javadoc warnings can be ignored. Unit test failure is unrelated. |
...s-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
Show resolved
Hide resolved
...hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeAttributeProvider.java
Show resolved
Hide resolved
...doop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAuthorizationContext.java
Show resolved
Hide resolved
xiaoyuyao
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the update. LGTM overall, just some minor comments inline.
+1 after that being fixed, pending CI.
Change-Id: Ia2c18eab38e120b634d07dbe807977e72b88ee77
|
💔 -1 overall
This message was automatically generated. |
|
Test failures due to OOM, unrelated. Triggered a rebuild regardless |
|
💔 -1 overall
This message was automatically generated. |
|
+1. Thanks @jojochuang for the update. There are whitespace related checkstyle issue which you can fix at commit. |
Change-Id: I19ba8945b0408e6570d096b23fb50198b4cac362
|
💔 -1 overall
This message was automatically generated. |
|
Thanks @xiaoyuyao for your thorough review. Learned a lot through your review. |
|
After this change... Namenode logs are getting flooded with below logs. |
|
Thanks @vinayakumarb. I am looking into it now. |
…erface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... (apache#1829) Reviewed-by: Xiaoyu Yao <xyao@apache.org>
|
Hi @jojochuang, |
|
Hi @tasanuma do you have RBF? Not familiar with RBF but if each RPC call results in one permission checker object I can see why there are many messages.
}` |
|
@jojochuang When FileSystem API is executed, it seems to generate the logs. |
…nforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... (apache#1829) Reviewed-by: Xiaoyu Yao <xyao@apache.org>
…der/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... (apache#1829)" This reverts commit 680adfa.
…erface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... (apache#1829) Reviewed-by: Xiaoyu Yao <xyao@apache.org>
…erface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... (apache#1829) Reviewed-by: Xiaoyu Yao <xyao@apache.org> (cherry picked from commit 4b95c24) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeAttributeProvider.java Change-Id: Iddf4535605836c3245feaf11686e7b72d3a80c7f
…rcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... (apache#1829)" This reverts commit 66625c4. Reason for revert: <INSERT REASONING HERE> Change-Id: I135a3eca495435b5fae3ce033ae8c222feed9e7c
…trolEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... (apache#1829)"" This reverts commit b700f9b. Reason for revert: Need to merge along with the Ranger side of change. Change-Id: Ib7ae2bff05ba6286587db8103366e628407b59c8
…ccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... (apache#1829)""" This reverts commit 574946d. Reason for revert: <INSERT REASONING HERE> Change-Id: I6de463dbf2636d7c7eb6286ac9ad0c0b2a71fc32
…erface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... (apache#1829) Reviewed-by: Xiaoyu Yao <xyao@apache.org> (cherry picked from commit 4b95c24) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeAttributeProvider.java Change-Id: I549fbdbc7a0a45af058e8b298334b6adf554f055
NOTICE
Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute