Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Doc][Sqlserver]Add notice into Sqlserver cdc doc #4721

Closed
wants to merge 18 commits into from
Closed

[Doc][Sqlserver]Add notice into Sqlserver cdc doc #4721

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
7091e8c
[Doc][SQLServer] Add SQLServer source and sink doc
zhangchengming601 May 5, 2023
9eb5e4c
[Doc][SQLServer] modify sink/SQLServer
zhangchengming601 May 5, 2023
6f384b6
[Doc][Redshift] Add Sink And Source Of Redshift Doc
zhangchengming601 May 6, 2023
7075a6c
[Doc][Redshift] Modify JDBC sink/redshift Doc
zhangchengming601 May 8, 2023
cad2b47
[Doc][Sqlserver-CDC] ADD notice into Sqlserver-CDC
zhangchengming601 May 8, 2023
863bbb2
[Doc][Sqlserver-CDC] Modify SqlServer-CDC file format
zhangchengming601 May 9, 2023
28f333a
[MODIFY][DOC] Modify sqlserver doc
zhangchengming601 May 16, 2023
06f0b75
[MODIFY][DOC] Modify sqlserver doc
zhangchengming601 May 16, 2023
2482820
Update docs/en/connector-v2/sink/SQLServer.md
EricJoy2048 May 16, 2023
b961eb5
Update docs/en/connector-v2/sink/redshift.md
EricJoy2048 May 16, 2023
ea69deb
Update docs/en/connector-v2/source/redshift.md
EricJoy2048 May 16, 2023
c7980b7
Update docs/en/connector-v2/source/redshift.md
EricJoy2048 May 16, 2023
c9c237c
Update docs/en/connector-v2/source/SQLServer.md
EricJoy2048 May 16, 2023
af4cb56
Update docs/en/connector-v2/sink/redshift.md
EricJoy2048 May 16, 2023
ad0e64c
Update docs/en/connector-v2/sink/SQLServer.md
EricJoy2048 May 16, 2023
82023d4
Update docs/en/connector-v2/source/SQLServer.md
EricJoy2048 May 17, 2023
d582aad
Update docs/en/connector-v2/source/SQLServer.md
EricJoy2048 May 17, 2023
bf6e167
Update docs/en/connector-v2/source/SQLServer.md
EricJoy2048 May 17, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[Doc][Sqlserver-CDC] Modify SqlServer-CDC file format
  • Loading branch information
@zhangchengming601
zhangchengming601 committed May 9, 2023
commit 863bbb2f154da22875bb202706afeaa650360915
61 changes: 31 additions & 30 deletions docs/en/connector-v2/sink/SQLServer.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,8 +24,8 @@ semantics (using XA transaction guarantee).

## Supported DataSource list
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's weird, SQLServer sink only support SQLServer, why use Supported DataSource list?

EricJoy2048 marked this conversation as resolved.
Show resolved Hide resolved

| datasource | supported versions | driver | url | maven |
| ---------- | -------------------------------------------------------- | -------------------------------------------- | ------------------------------- | ------------------------------------------------------------ |
| datasource | supported versions | driver | url | maven |
|------------|----------------------------------------------------------|----------------------------------------------|---------------------------------|-----------------------------------------------------------------------------------|
| SQL Server | Different dependency version has different driver class. | com.microsoft.sqlserver.jdbc.SQLServerDriver | jdbc:sqlserver://localhost:1433 | [Download](https://mvnrepository.com/artifact/com.microsoft.sqlserver/mssql-jdbc) |

## Database dependency
Expand All @@ -35,37 +35,37 @@ semantics (using XA transaction guarantee).

## Data Type Mapping

| SQLserver Data type | Seatunnel Data type |
| ------------------------------------------------------------ | ------------------------------------------------------------ |
| BIT | BOOLEAN |
| TINYINT<br/>SMALLINT | SHORT |
| INTEGER | INT |
| BIGINT | LONG |
| DECIMAL<br />NUMERIC<br />MONEY<br />SMALLMONEY | DECIMAL((Get the designated column's specified column size)+1,<br/>(Gets the designated column's number of digits to right of the <br />decimal point.))) |
| REAL | FLOAT |
| FLOAT | DOUBLE |
| CHAR<br />NCHAR<br />VARCHAR<br />NTEXT<br />NVARCHAR<br />TEXT | STRING |
| DATE | LOCAL_DATE |
| TIME | LOCAL_TIME |
| DATETIME<br />DATETIME2<br />SMALLDATETIME<br />DATETIMEOFFSET | LOCAL_DATE_TIME |
| TIMESTAMP<br />BINARY<br />VARBINARY<br />IMAGE<br />UNKNOWN | Not supported yet |
| SQLserver Data type | Seatunnel Data type |
|-----------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------|
| BIT | BOOLEAN |
| TINYINT<br/>SMALLINT | SHORT |
| INTEGER | INT |
| BIGINT | LONG |
| DECIMAL<br />NUMERIC<br />MONEY<br />SMALLMONEY | DECIMAL((Get the designated column's specified column size)+1,<br/>(Gets the designated column's number of digits to right of the <br />decimal point.))) |
| REAL | FLOAT |
| FLOAT | DOUBLE |
| CHAR<br />NCHAR<br />VARCHAR<br />NTEXT<br />NVARCHAR<br />TEXT | STRING |
| DATE | LOCAL_DATE |
| TIME | LOCAL_TIME |
| DATETIME<br />DATETIME2<br />SMALLDATETIME<br />DATETIMEOFFSET | LOCAL_DATE_TIME |
| TIMESTAMP<br />BINARY<br />VARBINARY<br />IMAGE<br />UNKNOWN | Not supported yet |

## Options
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sink Options


| name | type | required | default | Description |
| ---------------------------- | ------ | -------- | --------------- | ------------------------------------------------------------ |
| url | String | Yes | - | The URL of the JDBC connection. Refer to a case: jdbc:sqlserver://localhost:1433 |
| driver | String | Yes | - | The jdbc class name used to connect to the remote data source,<br/> if you use SQLserver the value is `com.microsoft.sqlserver.jdbc.SQLServerDriver`. |
| user | String | No | - | Connection instance user name |
| password | String | No | - | Connection instance password |
| query | String | Yes | - | Query statement |
| connection_check_timeout_sec | Int | No | 30 | The time in seconds to wait for the database operation used to validate the connection to complete |
| partition_column | String | No | - | The column name for parallelism's partition, only support numeric type. |
| partition_lower_bound | Long | No | - | The partition_column min value for scan, if not set SeaTunnel will query database get min value. |
| partition_upper_bound | Long | No | - | The partition_column max value for scan, if not set SeaTunnel will query database get max value. |
| partition_num | Int | No | job parallelism | The number of partition count, only support positive integer. default value is job parallelism |
| name | type | required | default | Description |
|------------------------------|--------|----------|-----------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
Comment on lines +54 to +55
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

| Name | Type | Required | Default | Description|

| url | String | Yes | - | The URL of the JDBC connection. Refer to a case: jdbc:sqlserver://localhost:1433 |
| driver | String | Yes | - | The jdbc class name used to connect to the remote data source,<br/> if you use SQLserver the value is `com.microsoft.sqlserver.jdbc.SQLServerDriver`. |
| user | String | No | - | Connection instance user name |
| password | String | No | - | Connection instance password |
| query | String | Yes | - | Query statement |
| connection_check_timeout_sec | Int | No | 30 | The time in seconds to wait for the database operation used to validate the connection to complete |
| partition_column | String | No | - | The column name for parallelism's partition, only support numeric type. |
| partition_lower_bound | Long | No | - | The partition_column min value for scan, if not set SeaTunnel will query database get min value. |
| partition_upper_bound | Long | No | - | The partition_column max value for scan, if not set SeaTunnel will query database get max value. |
| partition_num | Int | No | job parallelism | The number of partition count, only support positive integer. default value is job parallelism |
| fetch_size | Int | No | 0 | For queries that return a large number of objects,you can configure<br/> the row fetch size used in the query toimprove performance by<br/> reducing the number database hits required to satisfy the selection criteria.<br/> Zero means use jdbc default value. |
| common-options | | No | - | Source plugin common parameters, please refer to [Source Common Options](common-options.md) for details |
| common-options | | No | - | Source plugin common parameters, please refer to [Source Common Options](common-options.md) for details |

## tips

Expand Down Expand Up @@ -156,4 +156,5 @@ jdbc {
table = sink_table
primary_keys = ["id","name"]
}
```
```

Loading