From 5bd00626be94f7e29c156469d83ec264ca98a604 Mon Sep 17 00:00:00 2001 From: Luzhijing <82810928+luzhijing@users.noreply.github.com> Date: Sun, 19 Mar 2023 15:01:29 +0800 Subject: [PATCH] [doc](releasenote) 1.2.3 release note (#17926) --- README.md | 2 +- docs/en/docs/releasenotes/release-1.2.3.md | 109 +++++++++++++++++ docs/sidebars.json | 1 + docs/zh-CN/docs/releasenotes/release-1.2.3.md | 111 ++++++++++++++++++ 4 files changed, 222 insertions(+), 1 deletion(-) create mode 100644 docs/en/docs/releasenotes/release-1.2.3.md create mode 100644 docs/zh-CN/docs/releasenotes/release-1.2.3.md diff --git a/README.md b/README.md index ab9a4ea668875b..9e1c5ff8e7f6a4 100644 --- a/README.md +++ b/README.md @@ -37,7 +37,7 @@ Apache Doris is an easy-to-use, high-performance and real-time analytical databa All this makes Apache Doris an ideal tool for scenarios including report analysis, ad-hoc query, unified data warehouse, and data lake query acceleration. On Apache Doris, users can build various applications, such as user behavior analysis, AB test platform, log retrieval analysis, user portrait analysis, and order analysis. -🎉 Version 1.2.2 released now! It is fully evolved release and all users are encouraged to upgrade to this release. Check out the 🔗[Release Notes](https://doris.apache.org/docs/releasenotes/release-1.2.2) here. +🎉 Version 1.2.3 released now! It is fully evolved release and all users are encouraged to upgrade to this release. Check out the 🔗[Release Notes](https://doris.apache.org/docs/releasenotes/release-1.2.2) here. 🎉 Version 1.1.5 released now. It is a LTS(Long-term Support) release based on version 1.1. Check out the 🔗[Release Notes](https://doris.apache.org/docs/dev/releasenotes/release-1.1.5) here. diff --git a/docs/en/docs/releasenotes/release-1.2.3.md b/docs/en/docs/releasenotes/release-1.2.3.md new file mode 100644 index 00000000000000..cd9226b15e14fa --- /dev/null +++ b/docs/en/docs/releasenotes/release-1.2.3.md @@ -0,0 +1,109 @@ +--- +{ + "title": "Release 1.2.3", + "language": "en" +} +--- + + + +# Improvement + +### JDBC Catalog + +- Support connecting to Doris clusters through JDBC Catalog. + +Currently, Jdbc Catalog only support to use 5.x version of JDBC jar package to connect another Doris database. If you use 8.x version of JDBC jar package, the data type of column may not be matched. + +Reference: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris) + +- Support to synchronize only the specified database through the `only_specified_database` attribute. + +- Support synchronizing table names in the form of lowercase through `lower_case_table_names` to solve the problem of case sensitivity of table names. + +Reference: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc) + +- Optimize the read performance of JDBC Catalog. + +### Elasticsearch Catalog + +- Support Array type mapping. + +- Support whether to push down the like expression through the `like_push_down` attribute to control the CPU overhead of the ES cluster. + +Reference: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es) + +### Hive Catalog + +- Support Hive table default partition `_HIVE_DEFAULT_PARTITION_`. + +- Hive Metastore metadata automatic synchronization supports notification event in compressed format. + +### Dynamic Partition Improvement + +- Dynamic partition supports specifying the `storage_medium` parameter to control the storage medium of the newly added partition. + +Reference: [https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition](https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition) + + +### Optimize BE's Threading Model + +- Optimize BE's threading model to avoid stability problems caused by frequent thread creation and destroy. + +# Bugfix + +- Fixed issues with Merge-On-Write Unique Key tables. + +- Fixed compaction related issues. + +- Fixed some delete statement issues causing data errors. + +- Fixed several query execution errors. + +- Fixed the problem of using JDBC catalog to cause BE crash on some operating system. + +- Fixed Multi-Catalog issues. + +- Fixed memory statistics and optimization issues. + +- Fixed decimalV3 and date/datetimev2 related issues. + +- Fixed load transaction stability issues. + +- Fixed light-weight schema change issues. + +- Fixed the issue of using `datetime` type for batch partition creation. + +- Fixed the problem that a large number of failed broker loads would cause the FE memory usage to be too high. + +- Fixed the problem that stream load cannot be canceled after dropping the table. + +- Fixed querying `information_schema` timeout in some cases. + +- Fixed the problem of BE crash caused by concurrent data export using `select outfile`. + +- Fixed transactional insert operation memory leak. + +- Fixed several query/load profile issues, and supports direct download of profiles through FE web ui. + +- Fixed the problem that the BE tablet GC thread caused the IO util to be too high. + +- Fixed the problem that the commit offset is inaccurate in Kafka routine load. + diff --git a/docs/sidebars.json b/docs/sidebars.json index 98800abe109505..2438022749a555 100644 --- a/docs/sidebars.json +++ b/docs/sidebars.json @@ -1195,6 +1195,7 @@ "type": "category", "label": "Release notes", "items": [ + "releasenotes/release-1.2.3", "releasenotes/release-1.2.2", "releasenotes/release-1.2.1", "releasenotes/release-1.2.0", diff --git a/docs/zh-CN/docs/releasenotes/release-1.2.3.md b/docs/zh-CN/docs/releasenotes/release-1.2.3.md new file mode 100644 index 00000000000000..2747b358c61c83 --- /dev/null +++ b/docs/zh-CN/docs/releasenotes/release-1.2.3.md @@ -0,0 +1,111 @@ +--- +{ + "title": "Release 1.2.3", + "language": "zh-CN" +} +--- + + + +在 1.2.3 版本中，Doris 团队已经修复了自 1.2.2 版本发布以来超过 200 个问题或性能改进项。同时，1.2.3 版本也作为 1.2 LTS 的迭代版本，具备更高的稳定性，建议所有用户升级到这个版本。 + + +# Improvement + +### JDBC Catalog + +- 支持通过 JDBC Catalog 连接到另一个 Doris 数据库。 + +目前 JDBC Catalog 连接 Doris 只支持用 5.x 版本的 JDBC jar 包。如果使用 8.x JDBC jar 包可能会出现列类型无法匹配问题。 + +参考文档：[https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris) + +- 支持通过参数 `only_specified_database` 来同步指定的数据库。 + +- 支持通过 `lower_case_table_names` 参数控制是否以小写形式同步表名，解决表名区分大小写的问题。 + +参考文档：[https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc) + +- 优化 JDBC Catalog 的读取性能。 + +### Elasticsearch Catalog + +- 支持 Array 类型映射。 + +- 支持通过 `like_push_down` 属性下推 like 表达式来控制 ES 集群的 CPU 开销。 + +参考文档：[https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es) + +### Hive Catalog + +- 支持 Hive 表默认分区 `__Hive_default_partition__`。 + +- Hive Metastore 元数据自动同步支持压缩格式的通知事件。 + +### 动态分区优化 + +- 支持通过 storage_medium 参数来控制创建动态分区的默认存储介质。 + +参考文档：[https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition](https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition) + + +### 优化 BE 的线程模型 + +- 优化 BE 的线程模型，以避免频繁创建和销毁线程所带来的稳定性问题。 + +# Bug 修复 + +- 修复了部分 Unique Key 模型 Merge-on-Write 表的问题； + +- 修复了部分 Compaction 相关问题； + +- 修复了部分 Delete 语句导致的数据问题； + +- 修复了部分 Query 执行问题； + +- 修复了在某些操作系统上使用 JDBC Catalog 导致 BE 宕机的问题； + +- 修复了部分 Multi-Catalog 的问题； + +- 修复了部分内存统计和优化问题； + +- 修复了部分 DecimalV3 和 date/datetimev2 的相关问题。 + +- 修复了部分导入过程中的稳定性问题； + +- 修复了部分 Light Schema Change 的问题； + +- 修复了使用 `datetime` 类型创建批处理分区的问题； + +- 修复了 Broker Load 大数据量导入失败而导致的 FE 内存使用过高的问题； + +- 修复了删除表后无法取消 Stream Load 的问题； + +- 修复了某些情况下查询 `information_schema` 超时的问题； + +- 修复了使用 `select outfile` 并发数据导出导致 BE 宕机的问题； + +- 修复了事务性插入操作导致内存泄漏的问题； + +- 修复了部分查询和导入 Profile 的问题，并支持通过 FE web ui 直接下载 Profile 文件； + +- 修复了 BE Tablet GC 线程导致 IO 负载过高的问题； + +- 修复了 Kafka Routine Load 中提交 Offset 不准确的问题。 \ No newline at end of file