Skip to content

RANGER-2128: Implementation of Ranger Spark SQL plugin #26

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 35 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
80b9153
RANGER-2128: Implementation of Spark SQL plugin with hive as external…
yaooqinn Jun 27, 2018
8cde24d
ranger-hive-plugin 0.6.3
yaooqinn Jun 29, 2018
ec2e815
fix conficts / upgrade to the newest spark authorizer
yaooqinn Jan 17, 2019
e973e4e
using hive plugin of project version
yaooqinn Jan 17, 2019
d31a2e3
typo
yaooqinn Jan 17, 2019
8429f64
add the other artifacts versions
yaooqinn Jan 21, 2019
dd1b897
apply row level filter
yaooqinn Mar 30, 2019
41054c1
spark version 2.2.1
yaooqinn Apr 1, 2019
5d0beb7
pom adding spark.hive version
yaooqinn Apr 1, 2019
2a0f586
pom
yaooqinn Apr 1, 2019
c7422d1
policy cache dir
yaooqinn Apr 2, 2019
1ff8c13
shade transformer
yaooqinn Apr 2, 2019
f40623b
test RangerAdminRESTClient
yaooqinn Apr 2, 2019
0b334bb
row filter provides anlyzed
yaooqinn Apr 2, 2019
87de022
typo
yaooqinn Apr 2, 2019
57640f0
fix stack over flow
yaooqinn Apr 2, 2019
6e50e9d
not opt
yaooqinn Apr 2, 2019
f5a799a
spark source for tbl an col
yaooqinn Apr 4, 2019
570faad
typo
yaooqinn Apr 4, 2019
b6232b6
typo
yaooqinn Apr 4, 2019
39fec99
wrong condition check pri
yaooqinn Apr 4, 2019
3812f5f
wrong condition check pri
yaooqinn Apr 4, 2019
7edaf92
add a ranger spark optimizer to do basic logial plan optimization
yaooqinn Apr 4, 2019
273c3b8
add data masking, fix where clasue issue
yaooqinn Apr 9, 2019
05d1787
fix scala.MatchError
yaooqinn Apr 11, 2019
fd911a9
fix scala.MatchError 2
yaooqinn Apr 11, 2019
4d9c2dd
fix Unexpected operator in scalar subquery: RangerSparkMasking
yaooqinn Apr 11, 2019
3b755ec
handling ctas-like commands
yaooqinn Apr 11, 2019
e5a2ce4
add ut for all tpcds queries
yaooqinn Apr 28, 2019
d840508
fix ut
yaooqinn Apr 28, 2019
f60aa08
support debugging in IDE
yaooqinn Apr 29, 2019
688af61
add more uts
yaooqinn Apr 29, 2019
2e1429c
rm spark hive deps
yaooqinn May 18, 2019
5e6c3f5
add profiles
yaooqinn May 18, 2019
5107aec
typo
yaooqinn May 18, 2019
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -9,3 +9,4 @@
winpkg/target
.DS_Store
.idea
/derby.log
5 changes: 5 additions & 0 deletions agents-audit/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -104,4 +104,9 @@
</dependency>

</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
3 changes: 3 additions & 0 deletions agents-common/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,8 @@
<name>Common library for Plugins</name>
<description>Plugins Common</description>
<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
Expand Down Expand Up @@ -86,4 +88,5 @@
<artifactId>mysql-connector-java</artifactId>
</dependency>
</dependencies>

</project>
5 changes: 5 additions & 0 deletions agents-cred/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -51,4 +51,9 @@
<artifactId>junit</artifactId>
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
5 changes: 5 additions & 0 deletions agents-installer/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -34,4 +34,9 @@
<version>${commons.cli.version}</version>
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
5 changes: 5 additions & 0 deletions credentialbuilder/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -78,4 +78,9 @@
<version>${hadoop.version}</version>
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
5 changes: 5 additions & 0 deletions embeddedwebserver/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -84,4 +84,9 @@
<version>${project.version}</version>
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
2 changes: 2 additions & 0 deletions hbase-agent/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -95,6 +95,8 @@

</dependencies>
<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
<testResources>
<testResource>
<directory>src/test/resources</directory>
Expand Down
2 changes: 2 additions & 0 deletions hive-agent/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -84,6 +84,8 @@
</dependency>
</dependencies>
<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
<testResources>
<testResource>
<directory>src/test/resources</directory>
Expand Down
5 changes: 5 additions & 0 deletions jisql/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -34,4 +34,9 @@
<version>3.2</version>
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
2 changes: 2 additions & 0 deletions kms/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -263,6 +263,8 @@
</dependency>
</dependencies>
<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
<pluginManagement>
<plugins>
<plugin>
Expand Down
2 changes: 2 additions & 0 deletions knox-agent/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -155,6 +155,8 @@
</dependency>
</dependencies>
<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
<sourceDirectory>${basedir}/src/main/java</sourceDirectory>
<testSourceDirectory>${basedir}/src/test/java</testSourceDirectory>
<resources>
Expand Down
5 changes: 5 additions & 0 deletions plugin-atlas/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -85,6 +85,11 @@
<version>${google.guava.version}</version>
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>


5 changes: 5 additions & 0 deletions plugin-elasticsearch/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -66,4 +66,9 @@
<version>${httpcomponents.httpcore.version}</version>
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
2 changes: 2 additions & 0 deletions plugin-kafka/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -92,6 +92,8 @@

</dependencies>
<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
<testResources>
<testResource>
<directory>src/test/resources</directory>
Expand Down
2 changes: 2 additions & 0 deletions plugin-kms/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -64,6 +64,8 @@

</dependencies>
<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
<testResources>
<testResource>
<directory>src/test/resources</directory>
Expand Down
4 changes: 4 additions & 0 deletions plugin-kylin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -88,4 +88,8 @@
<version>${httpcomponents.httpcore.version}</version>
</dependency>
</dependencies>
<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
4 changes: 4 additions & 0 deletions plugin-nifi-registry/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -62,4 +62,8 @@
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
5 changes: 5 additions & 0 deletions plugin-nifi/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -59,4 +59,9 @@
<scope>test</scope>
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
5 changes: 5 additions & 0 deletions plugin-solr/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -52,4 +52,9 @@
<version>${solr.version}</version>
</dependency>
</dependencies>

<build>
<outputDirectory>target/classes</outputDirectory>
<testOutputDirectory>target/test-classes</testOutputDirectory>
</build>
</project>
3 changes: 3 additions & 0 deletions plugin-spark/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
target/
dependency-reduced-pom.xml
/derby.log
Loading