Skip to content

Commit

Permalink
[Improve][Project] Code format with spotless plugin.
Browse files Browse the repository at this point in the history
  • Loading branch information
@ashulin
ashulin committed Feb 27, 2023
1 parent 706cb14 commit 423b583
Show file tree
Hide file tree
Showing 1,804 changed files with 38,633 additions and 28,230 deletions.
6 changes: 4 additions & 2 deletions docs/en/Connector-v2-release-state.md
View file
Original file line number Diff line number Diff line change
@@ -1,15 +1,16 @@
# Connector Release Status

SeaTunnel uses a grading system for connectors to help you understand what to expect from a connector:

| | Alpha | Beta | General Availability (GA) |
| | Alpha | Beta | General Availability (GA) |
|----------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Expectations | An alpha connector signifies a connector under development and helps SeaTunnel gather early feedback and issues reported by early adopters. We strongly discourage using alpha releases for production use cases | A beta connector is considered stable and reliable with no backwards incompatible changes but has not been validated by a broader group of users. We expect to find and fix a few issues and bugs in the release before it’s ready for GA. | A generally available connector has been deemed ready for use in a production environment and is officially supported by SeaTunnel. Its documentation is considered sufficient to support widespread adoption. |
| | | | |
| Production Readiness | No | Yes | Yes |

## Connector V2 Health

| Connector Name | Type | Status | Support Version |
| Connector Name | Type | Status | Support Version |
|-------------------------------------------------------------|--------|--------|-----------------|
| [AmazonDynamoDB](connector-v2/sink/AmazonDynamoDB.md) | Sink | Beta | 2.3.0 |
| [AmazonDynamoDB](connector-v2/source/AmazonDynamoDB.md) | Source | Beta | 2.3.0 |
Expand Down Expand Up @@ -82,3 +83,4 @@ SeaTunnel uses a grading system for connectors to help you understand what to ex
| [Socket](connector-v2/source/Socket.md) | Source | Beta | 2.2.0-beta |
| [StarRocks](connector-v2/sink/StarRocks.md) | Sink | Alpha | 2.3.0 |
| [Tablestore](connector-v2/sink/Tablestore.md) | Sink | Alpha | 2.3.0 |

3 changes: 1 addition & 2 deletions docs/en/about.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,6 @@ SeaTunnel is a very easy-to-use ultra-high-performance distributed data integrat
synchronization of massive data. It can synchronize tens of billions of data stably and efficiently every day, and has
been used in the production of nearly 100 companies.


## Why do we need SeaTunnel

SeaTunnel focuses on data integration and data synchronization, and is mainly designed to solve common problems in the field of data integration:
Expand Down Expand Up @@ -49,7 +48,7 @@ The default engine use by SeaTunnel is [SeaTunnel Engine](seatunnel-engine/about

## Connector

- **Source Connectors** SeaTunnel support read data from various relational databases, graph databases, NoSQL databases, document databases, and memory databases. Various distributed file systems such as HDFS. A variety of cloud storage, such as S3 and OSS. At the same time, we also support data reading of many common SaaS services. You can access the detailed list [here](connector-v2/source). If you want, You can develop your own source connector and easily integrate it into seatunnel.
- **Source Connectors** SeaTunnel support read data from various relational databases, graph databases, NoSQL databases, document databases, and memory databases. Various distributed file systems such as HDFS. A variety of cloud storage, such as S3 and OSS. At the same time, we also support data reading of many common SaaS services. You can access the detailed list [here](connector-v2/source). If you want, You can develop your own source connector and easily integrate it into seatunnel.

- **Transform Connector** If the schema is different between source and sink, You can use Transform Connector to change the schema read from source and make it same as the sink schema.

Expand Down
3 changes: 2 additions & 1 deletion docs/en/concept/config.md
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
---

sidebar_position: 2
---
-------------------

# Intro to config file

Expand Down
4 changes: 2 additions & 2 deletions docs/en/concept/connector-v2-features.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ Streaming Job Mode, The data read is unbounded and the job never stop.

### parallelism

Parallelism Source Connector support config `parallelism`, every parallelism will create a task to read the data.
Parallelism Source Connector support config `parallelism`, every parallelism will create a task to read the data.
In the **Parallelism Source Connector**, the source will be split into multiple splits, and then the enumerator will allocate the splits to the SourceReader for processing.

### support user-defined split
Expand All @@ -64,4 +64,4 @@ For sink connector, the sink connector supports exactly-once if any piece of dat

### cdc(change data capture)

If a sink connector supports writing row kinds(INSERT/UPDATE_BEFORE/UPDATE_AFTER/DELETE) based on primary key, we think it supports cdc(change data capture).
If a sink connector supports writing row kinds(INSERT/UPDATE_BEFORE/UPDATE_AFTER/DELETE) based on primary key, we think it supports cdc(change data capture).
38 changes: 19 additions & 19 deletions docs/en/concept/schema-feature.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,25 +6,25 @@ Some NoSQL databases or message queue are not strongly limited schema, so the sc

## What type supported at now

| Data type | Description |
| :-------- | :----------------------------------------------------------- |
| string | string |
| boolean | boolean |
| tinyint | -128 to 127 regular. 0 to 255 unsigned*. Specify the maximum number of digits in parentheses. |
| smallint | -32768 to 32767 General. 0 to 65535 unsigned*. Specify the maximum number of digits in parentheses. |
| int | All numbers from -2,147,483,648 to 2,147,483,647 are allowed. |
| bigint | All numbers between -9,223,372,036,854,775,808 and 9,223,372,036,854,775,807 are allowed. |
| float | Float-precision numeric data from -1.79E+308 to 1.79E+308. |
| double | Double precision floating point. Handle most decimals. |
| decimal | DOUBLE type stored as a string, allowing a fixed decimal point. |
| null | null |
| bytes | bytes. |
| date | Only the date is stored. From January 1, 0001 to December 31, 9999. |
| time | Only store time. Accuracy is 100 nanoseconds. |
| timestamp | Stores a unique number that is updated whenever a row is created or modified. timestamp is based on the internal clock and does not correspond to real time. There can only be one timestamp variable per table. |
| row | Row type,can be nested. |
| Data type | Description |
|:----------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| string | string |
| boolean | boolean |
| tinyint | -128 to 127 regular. 0 to 255 unsigned*. Specify the maximum number of digits in parentheses. |
| smallint | -32768 to 32767 General. 0 to 65535 unsigned*. Specify the maximum number of digits in parentheses. |
| int | All numbers from -2,147,483,648 to 2,147,483,647 are allowed. |
| bigint | All numbers between -9,223,372,036,854,775,808 and 9,223,372,036,854,775,807 are allowed. |
| float | Float-precision numeric data from -1.79E+308 to 1.79E+308. |
| double | Double precision floating point. Handle most decimals. |
| decimal | DOUBLE type stored as a string, allowing a fixed decimal point. |
| null | null |
| bytes | bytes. |
| date | Only the date is stored. From January 1, 0001 to December 31, 9999. |
| time | Only store time. Accuracy is 100 nanoseconds. |
| timestamp | Stores a unique number that is updated whenever a row is created or modified. timestamp is based on the internal clock and does not correspond to real time. There can only be one timestamp variable per table. |
| row | Row type,can be nested. |
| map | A Map is an object that maps keys to values. The key type includes `int` `string` `boolean` `tinyint` `smallint` `bigint` `float` `double` `decimal` `date` `time` `timestamp` `null` , and the value type includes `int` `string` `boolean` `tinyint` `smallint` `bigint` `float` `double` `decimal` `date` `time` `timestamp` `null` `array` `map`. |
| array | A array is a data type that represents a collection of elements. The element type includes `int` `string` `boolean` `tinyint` `smallint` `bigint` `float` `double` `array` `map`. |
| array | A array is a data type that represents a collection of elements. The element type includes `int` `string` `boolean` `tinyint` `smallint` `bigint` `float` `double` `array` `map`. |

## How to use schema

Expand Down Expand Up @@ -61,4 +61,4 @@ source {

## When we should use it or not

If there is a `schema` configuration project in Options,the connector can then customize the schema. Like `Fake` `Pulsar` `Http` source connector etc.
If there is a `schema` configuration project in Options,the connector can then customize the schema. Like `Fake` `Pulsar` `Http` source connector etc.
Loading

0 comments on commit 423b583

Please sign in to comment.