Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

releases: add TiDB 7.1.0 release notes (stable version) #13896

Merged
merged 102 commits into from
May 31, 2023
Merged
Changes from 6 commits
Commits
Show all changes
102 commits
Select commit Hold shift + click to select a range
5c353ad
releases: add TiDB 7.1.0 release notes (stable version)
Oreoxmt May 9, 2023
b7dfaf7
Update releases/release-7.1.0.md
ran-huang May 9, 2023
cdfe466
rm a cdc note in improvement
ran-huang May 9, 2023
159de19
Update releases/release-7.1.0.md
ran-huang May 9, 2023
1e335c3
Apply suggestions from code review
ran-huang May 9, 2023
1331f16
Update releases/release-7.1.0.md
qiancai May 10, 2023
4903758
Apply suggestions from code review
Oreoxmt May 10, 2023
145f4e4
Apply suggestions from code review
Oreoxmt May 10, 2023
21797ba
Apply suggestions from code review
Oreoxmt May 10, 2023
ce65fba
Apply suggestions from code review
Oreoxmt May 10, 2023
37edeee
include resource control in tidb dashboard
songrijie May 10, 2023
155f133
append additional information to stats cache
songrijie May 10, 2023
746550d
Apply suggestions from code review
hfxsd May 10, 2023
0012ac3
Update releases/release-7.1.0.md
hfxsd May 10, 2023
85a7b79
Update releases/release-7.1.0.md
hfxsd May 10, 2023
bbd4854
Update releases/release-7.1.0.md
hfxsd May 10, 2023
dc14d17
Update releases/release-7.1.0.md
hfxsd May 10, 2023
b26bfdb
Update releases/release-7.1.0.md
hfxsd May 10, 2023
7b3c6ef
keep non-prepared plan cache as experimental
songrijie May 11, 2023
eb5197b
update non-prepared-plan-cache
Oreoxmt May 11, 2023
c90aad5
Apply suggestions from code review
hfxsd May 11, 2023
5de3d47
Update release-7.1.0.md
ljun0712 May 11, 2023
e361186
remove upcoming
Oreoxmt May 11, 2023
bd2ab5b
Update release-7.1.0.md
ljun0712 May 11, 2023
4c92b4f
Update releases/release-7.1.0.md
hfxsd May 12, 2023
585a085
Update release-7.1.0.md
Frank945946 May 12, 2023
c0cf0ef
fix format
Oreoxmt May 12, 2023
d60582b
Apply suggestions from code review
ran-huang May 15, 2023
2a261c0
Apply suggestions from code review
hfxsd May 15, 2023
4a58c7a
Update release-7.1.0.md
hfxsd May 15, 2023
79f1235
Update release-7.1.0.md
hfxsd May 15, 2023
7af6005
Update release-7.1.0.md
hfxsd May 15, 2023
3341c6b
Apply suggestions from code review
hfxsd May 16, 2023
8876fc1
Update releases/release-7.1.0.md
ran-huang May 16, 2023
0eda1ed
Update releases/release-7.1.0.md
D3Hunter May 16, 2023
423f4c9
Update releases/release-7.1.0.md
D3Hunter May 16, 2023
59e890d
Update releases/release-7.1.0.md
D3Hunter May 16, 2023
d6cc40c
fix format, update compatibility changes, add improvements and bug fixes
Oreoxmt May 16, 2023
90fbc26
Apply suggestions from code review
hfxsd May 16, 2023
5d42384
add tidb_enable_row_level_checksum, integrity.corruption-handle-level…
Oreoxmt May 18, 2023
f006148
Merge branch 'master' into v7.1.0-release-notes
Oreoxmt May 18, 2023
80d2519
Apply suggestions from code review
ran-huang May 19, 2023
5a51714
Merge branch 'master' into v7.1.0-release-notes
Oreoxmt May 22, 2023
6b500ed
Apply suggestions from code review
Oreoxmt May 22, 2023
cced237
add audit log
Oreoxmt May 23, 2023
8574e7a
Apply suggestions from code review
Oreoxmt May 24, 2023
fbe502c
Update releases/release-7.1.0.md
hfxsd May 24, 2023
d023530
Update releases/release-7.1.0.md
D3Hunter May 24, 2023
13a3311
Update releases/release-7.1.0.md
D3Hunter May 24, 2023
7329876
Update releases/release-7.1.0.md
D3Hunter May 24, 2023
379093f
Update releases/release-7.1.0.md
D3Hunter May 24, 2023
93a01a9
Update releases/release-7.1.0.md
D3Hunter May 24, 2023
b283f57
Update releases/release-7.1.0.md
D3Hunter May 24, 2023
54de70e
update highlight table
Oreoxmt May 24, 2023
272c773
Apply suggestions from code review
ran-huang May 24, 2023
f0857df
Update releases/release-7.1.0.md
flowbehappy May 24, 2023
06b5646
Update releases/release-7.1.0.md
flowbehappy May 24, 2023
894158c
Update releases/release-7.1.0.md
flowbehappy May 24, 2023
cb42f11
Update releases/release-7.1.0.md
hfxsd May 24, 2023
effa50b
add improvements and bug fixes
Oreoxmt May 25, 2023
1ca422d
improvements and bug fixes: fix format and add dup
Oreoxmt May 25, 2023
a9d76e7
Apply suggestions from code review
Oreoxmt May 25, 2023
760da72
Update releases/release-7.1.0.md
hfxsd May 25, 2023
29890a0
Update releases/release-7.1.0.md
D3Hunter May 25, 2023
51fbdaf
Apply suggestions from code review
Oreoxmt May 25, 2023
9acbae6
Apply suggestions from code review
Oreoxmt May 25, 2023
ac399e1
update Improvements and Bug fixes
Oreoxmt May 25, 2023
a15b95e
Apply suggestions from code review
ran-huang May 25, 2023
b495a75
Apply suggestions from code review
qiancai May 25, 2023
b61209b
Apply suggestions from code review
Oreoxmt May 26, 2023
0649750
update TiKV, PD, TiCDC
Oreoxmt May 26, 2023
b3909ed
Apply suggestions from code review
Oreoxmt May 26, 2023
54fa127
Apply suggestions from code review
hfxsd May 26, 2023
b29a252
Apply suggestions from code review
hfxsd May 26, 2023
176b61c
Update releases/release-7.1.0.md
D3Hunter May 26, 2023
1816bc2
Apply suggestions from code review
Oreoxmt May 26, 2023
8821e01
Apply suggestions from code review
ran-huang May 26, 2023
c8cd7d0
Update releases/release-7.1.0.md
D3Hunter May 26, 2023
5753fb8
Update releases/release-7.1.0.md
D3Hunter May 26, 2023
e867381
Update releases/release-7.1.0.md
D3Hunter May 26, 2023
a33cd17
Apply suggestions from code review
qiancai May 26, 2023
39b86e3
Apply suggestions from code review
qiancai May 26, 2023
428e38a
Apply suggestions from code review
hfxsd May 27, 2023
43395c9
Apply suggestions from code review
hfxsd May 29, 2023
c985038
Apply suggestions from code review
Oreoxmt May 29, 2023
6bdbe94
update contributor list and remove issue 42323
Oreoxmt May 29, 2023
d4bec34
Update releases/release-7.1.0.md
ran-huang May 29, 2023
30be471
sync changes from English comments
qiancai May 29, 2023
dd8ca48
Apply suggestions from code review
ran-huang May 29, 2023
83958e7
Apply suggestions from code review
Oreoxmt May 29, 2023
cf93230
Apply suggestions from code review
hfxsd May 30, 2023
5ef25bf
Apply suggestions from code review
ran-huang May 30, 2023
237ac27
- update links tp v7.1
Oreoxmt May 30, 2023
ee50484
remove deprecated feature
Oreoxmt May 30, 2023
d6c56c1
Apply suggestions from code review
Oreoxmt May 30, 2023
3fdbbfe
Merge branch 'master' into v7.1.0-release-notes
Oreoxmt May 30, 2023
450d250
fix ci
Oreoxmt May 30, 2023
6e89e42
Apply suggestions from code review
Oreoxmt May 30, 2023
224f97b
- update release data
Oreoxmt May 30, 2023
07108e8
update download link
Oreoxmt May 30, 2023
8039311
update release date
Oreoxmt May 31, 2023
727af22
Apply suggestions from code review
Oreoxmt May 31, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
50 changes: 42 additions & 8 deletions releases/release-7.1.0.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,11 @@ summary: 了解 TiDB 7.1.0 版本的新功能、兼容性变更、改进提升

# TiDB 7.1.0 Release Notes

TiDB 版本:7.1.0 (upcoming)
发版日期:xxxx 年 xx 月 xx 日
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

> **注意:**
>
> TiDB v7.1.0 尚未正式发布。此 Release Notes 旨在帮助你提前了解即将发布的版本,但其中内容可能会有所调整。本文列出的功能并不保证会包含在最终发布的版本中。
TiDB 版本:7.1.0 (LTS)

试用链接:[快速体验](https://docs.pingcap.com/zh/tidb/v7.1/quick-start-with-tidb) | [生产部署](https://docs.pingcap.com/zh/tidb/v7.1/production-deployment-using-tiup) | [下载离线包](https://cn.pingcap.com/product-community/?version=v7.1.0#version-list)
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

在 7.1.0 版本中,你可以获得以下关键特性:

Expand Down Expand Up @@ -52,6 +52,12 @@ TiDB 版本:7.1.0 (upcoming)

### 性能

* 下一代 [`Partitioned Raft KV`](/partitioned-raft-kv.md) 存储引擎 [#issue号](链接) @[busyjay](https://github.com/busyjay) @[tonyxuqqi](https://github.com/tonyxuqqi) @[tabokie](https://github.com/tabokie) @[bufferflies](https://github.com/bufferflies) @[5kbpers](https://github.com/5kbpers) @[SpadeA-Tang](https://github.com/SpadeA-Tang) @[nolouch](https://github.com/nolouch) **tw:Oreoxmt**
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

TiDB v7.1.0 的 [`Partitioned Raft KV`](/partitioned-raft-kv.md) 存储引擎使用多个 RocksDB 实例存储 TiKV 的 Region 数据,为每个 Region 提供独立的 RocksDB 实例。该引擎能够更好地管理 RocksDB 实例的文件数和层级,实现 Region 间的数据操作物理隔离,并支持更多数据的平滑扩展。与原 TiKV 存储引擎相比,使用该引擎在相同硬件条件和读写混合场景下,可实现约 2 倍的写入吞吐、3 倍的读取吞吐,并缩短约 4/5 的弹性伸缩时间。该引擎与 TiFlash 引擎兼容,支持 Lightning / BR / TiCDC 等周边工具。该引擎目前仅支持在新集群中使用,暂不支持从原 TiKV 存储引擎直接升级到该引擎。
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

更多信息,请参考[用户文档](/partitioned-raft-kv.md)。

* TiFlash 查询支持延迟物化功能 (GA) [#5829](https://github.com/pingcap/tiflash/issues/5829) @[Lloyd-Pottiger](https://github.com/Lloyd-Pottiger)

在 v7.0.0 中,TiFlash 引入了延迟物化实验特性,用于优化查询性能。该特性默认关闭(系统变量 [`tidb_opt_enable_late_materialization`](/system-variables.md#tidb_opt_enable_late_materialization-从-v700-版本开始引入) 默认为 `OFF`)。当 `SELECT` 语句中包含过滤条件(`WHERE` 子句)时,TiFlash 默认会先读取该查询所需列的全部数据,然后再根据查询条件对数据进行过滤、聚合等计算任务。开启该特性后,TiFlash 支持下推部分过滤条件到 TableScan 算子,即先扫描过滤条件相关的列数据,过滤得到符合条件的行后,再扫描这些行的其他列数据,继续后续计算,从而减少 IO 扫描和数据处理的计算量。
Expand Down Expand Up @@ -84,6 +90,18 @@ TiDB 版本:7.1.0 (upcoming)

更多信息,请参考[用户文档](/sql-non-prepared-plan-cache.md)。

* DDL 支持分布式并行执行框架 [#41495](https://github.com/pingcap/tidb/issues/41495) @[benjamin2037](https://github.com/benjamin2037) **tw:ran-huang**
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

TiDB v7.1.0 之前的版本中,只有一个 TiDB 节点能够担任 DDL Owner 并执行 DDL 任务。但是,从 TiDB v7.1.0 开始,新的分布式并行执行框架支持多个 TiDB 节点并行执行同一项 DDL 任务,从而更好地利用 TiDB 集群的资源,大幅提升 DDL 的性能。此外,你还可以通过增加 TiDB 节点来线性提升 DDL 的性能。需要注意的是,该特性是实验性特性,仅支持 `ADD INDEX` 操作。
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

如果要使用分布式并行执行框架,只需将 [`tidb_enable_dist_task`](/system-variables.md#tidb_enable_dist_task) 的值设置为 `ON`:
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

```sql
SET GLOBAL tidb_enable_dist_task = ON;
```

更多信息,请参考[用户文档](/tidb-distributed-execution-framework.md)。

### 稳定性

* 资源管控成为正式功能 (GA) [#38825](https://github.com/pingcap/tidb/issues/38825) @[nolouch](https://github.com/nolouch) @[BornChanger](https://github.com/BornChanger) @[glorv](https://github.com/glorv) @[tiancaiamao](https://github.com/tiancaiamao) @[Connor1996](https://github.com/Connor1996) @[JmPotato](https://github.com/JmPotato) @[hnes](https://github.com/hnes) @[CabinfeverB](https://github.com/CabinfeverB) @[HuSharp](https://github.com/HuSharp)
Expand Down Expand Up @@ -116,6 +134,18 @@ TiDB 版本:7.1.0 (upcoming)

更多信息,请参考[用户文档](/statistics.md#统计信息的加载)。
hfxsd marked this conversation as resolved.
Show resolved Hide resolved

* TiCDC 支持单行数据正确性校验功能 [#8718](https://github.com/pingcap/tiflow/issues/8718) [#42747](https://github.com/pingcap/tidb/issues/42747) @[3AceShowHand](https://github.com/3AceShowHand) @[zyguan](https://github.com/zyguan) **tw:Oreoxmt**

从 v7.1.0 开始,TiCDC 引入了单行数据正确性校验功能,该功能基于 Checksum 算法对单行数据的正确性进行校验。该功能可以校验一行数据从 TiDB 写入、通过 TiCDC 同步,到写入 Kafka 集群的过程中是否出现错误。TiCDC 数据正确性校验功能仅支持下游是 Kafka 的 Changefeed,目前支持 Avro 协议。
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

更多信息,请参考[用户文档](/ticdc/ticdc-integrity-check.md)。

ran-huang marked this conversation as resolved.
Show resolved Hide resolved
* TiCDC 优化 DDL 同步操作 [#8686](https://github.com/pingcap/tiflow/issues/8686) @[hi-rustin](https://github.com/hi-rustin) **tw:ran-huang**

在 v7.1.0 之前,当用户在一个大表上进行 DDL 操作时,如果 DDL 操作影响该表中的所有行(例如添加或删除列),TiCDC 的同步延迟会显著增加。从 v7.1.0 开始,TiCDC 对此进行了优化,减轻 DDL 操作对下游延迟的影响。

更多信息,请参考[用户文档](/ticdc/ticdc-faq.md#ticdc-是否会将有损-ddl-产生的数据变更同步到下游)。

### SQL 功能

* 支持通过 `INSERT INTO SELECT` 语句保存 TiFlash 查询结果 (GA) [#37515](https://github.com/pingcap/tidb/issues/37515) @[gengliqi](https://github.com/gengliqi)
Expand Down Expand Up @@ -195,6 +225,14 @@ TiDB 版本:7.1.0 (upcoming)

更多信息,请参考[用户文档](/ddl-introduction.md#ddl-相关的命令介绍)。

* 支持无需手动取消 DDL 的平滑集群升级功能 [#39751](https://github.com/pingcap/tidb/issues/39751) @[zimulala](https://github.com/zimulala) @[hawkingrei](https://github.com/hawkingrei) **tw:ran-huang**
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

在 TiDB v7.1.0 之前的版本中,升级集群时需要先手动取消正在运行或排队的 DDL 任务,并在升级完成后再手动添加这些任务。

为了提供更平滑的升级体验,TiDB v7.1.0 引入了自动暂停和恢复 DDL 任务的功能。从 v7.1.0 开始,你在升级集群时无需手动取消 DDL 任务。系统会自动暂停正在执行或排队的 DDL 任务,等待整个集群完成滚动升级后再自动恢复这些任务,让你可以更加轻松地升级 TiDB 集群。
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

更多信息,请参考[用户文档](to be added)。
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved
ran-huang marked this conversation as resolved.
Show resolved Hide resolved

Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved
### 可观测性

* 增加优化器诊断信息 [#43122](https://github.com/pingcap/tidb/issues/43122) @[time-and-fate](https://github.com/time-and-fate)
Expand Down Expand Up @@ -263,10 +301,6 @@ TiDB 版本:7.1.0 (upcoming)
- 提升 TiFlash 在存算分离架构下的性能和稳定性 [#6882](https://github.com/pingcap/tiflash/issues/6882) @[JaySon-Huang](https://github.com/JaySon-Huang) @[breezewish](https://github.com/breezewish) @[JinheLin](https://github.com/JinheLin)
- 支持在 Semi Join 或 Anti Semi Join 中,通过选择较小的表作为 Build 端来优化查询性能 [#7280](https://github.com/pingcap/tiflash/issues/7280) @[yibin87](https://github.com/yibin87)

+ TiCDC

- TiCDC 过滤了由有损 DDL 语句导致的数据变更,避免发送无效数据变更 [#43227](https://github.com/pingcap/tidb/issues/43227) @[hi-rustin](https://github.com/hi-rustin)

## 贡献者

感谢来自 TiDB 社区的贡献者们:
Expand Down