Skip to content

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

License

Apache-2.0 and 3 other licenses found

Licenses found

Apache-2.0
LICENSE
Apache-2.0
LICENSE.bin
Apache-2.0
LICENSE.rest
Apache-2.0
LICENSE.trino
Notifications You must be signed in to change notification settings

apache/gravitino

Gravitino

GitHub Actions Build GitHub Actions Integration Test

Introduction

Gravitino is a high-performance, geo-distributed, and federated metadata lake. It manages the metadata directly in different sources, types, and regions. It also provides users with unified metadata access for data and AI assets.

Gravitino Architecture

Gravitino aims to provide several key features:

  • SSOT (Single Source of Truth) for multi-regional data with geo-distributed architecture support.
  • Unified Data and AI asset management for both users and engines.
  • Security in one place, centralizing the security for different sources.
  • Built-in data management and data access management.

Online Documentation

You can find the latest Gravitino documentation here in the doc folder, The README file only contains basic setup instructions.

Building Gravitino

Gravitino is built using Gradle. To build Gravitino, please run:

./gradlew clean build

If you want to build a distribution package, please run:

./gradlew compileDistribution

to build a distribution package.

Or:

./gradlew assembleDistribution

to build a compressed distribution package.

Note:

  1. Gravitino is built against JDK8, please make sure JDK8 is installed in your environment.
  2. Gravitino trino-connector is built against JDK17. Please also make sure JDK17 is installed in your environment.

For the details of building and testing Gravitino, please see How to build Gravitino.

Quick Start

Configure and start the Gravitino server

Gravitino server configuration file gravitino.conf is located under conf and follows the typical property file format. You can change the configuration in this file.

To start the Gravitino server, please run:

./bin/gravitino.sh start

To stop the Gravitino server, please run:

./bin/gravitino.sh stop

Using Trino with Gravitino

Gravitino provides a Trino connector to access the metadata in Gravitino. To use Trino with Gravitino, please follow the trino-gravitino-connector doc.

Development Guide

  1. How to build Gravitino
  2. How to Run Integration Test
  3. How to publish Docker images

License

Gravitino is under the Apache License Version 2.0, See the LICENSE for the details.