Skip to content

Commit

Permalink
[doc](releasenote) 1.2.3 release note (apache#17926)
Browse files Browse the repository at this point in the history
  • Loading branch information
luzhijing authored Mar 19, 2023
1 parent 295b26d commit 5bd0062
Show file tree
Hide file tree
Showing 4 changed files with 222 additions and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ Apache Doris is an easy-to-use, high-performance and real-time analytical databa
All this makes Apache Doris an ideal tool for scenarios including report analysis, ad-hoc query, unified data warehouse, and data lake query acceleration. On Apache Doris, users can build various applications, such as user behavior analysis, AB test platform, log retrieval analysis, user portrait analysis, and order analysis.


🎉 Version 1.2.2 released now! It is fully evolved release and all users are encouraged to upgrade to this release. Check out the 🔗[Release Notes](https://doris.apache.org/docs/releasenotes/release-1.2.2) here.
🎉 Version 1.2.3 released now! It is fully evolved release and all users are encouraged to upgrade to this release. Check out the 🔗[Release Notes](https://doris.apache.org/docs/releasenotes/release-1.2.2) here.

🎉 Version 1.1.5 released now. It is a LTS(Long-term Support) release based on version 1.1. Check out the 🔗[Release Notes](https://doris.apache.org/docs/dev/releasenotes/release-1.1.5) here.

Expand Down
109 changes: 109 additions & 0 deletions docs/en/docs/releasenotes/release-1.2.3.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,109 @@
---
{
"title": "Release 1.2.3",
"language": "en"
}
---

<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->

# Improvement

### JDBC Catalog

- Support connecting to Doris clusters through JDBC Catalog.

Currently, Jdbc Catalog only support to use 5.x version of JDBC jar package to connect another Doris database. If you use 8.x version of JDBC jar package, the data type of column may not be matched.

Reference: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris)

- Support to synchronize only the specified database through the `only_specified_database` attribute.

- Support synchronizing table names in the form of lowercase through `lower_case_table_names` to solve the problem of case sensitivity of table names.

Reference: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc)

- Optimize the read performance of JDBC Catalog.

### Elasticsearch Catalog

- Support Array type mapping.

- Support whether to push down the like expression through the `like_push_down` attribute to control the CPU overhead of the ES cluster.

Reference: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es)

### Hive Catalog

- Support Hive table default partition `_HIVE_DEFAULT_PARTITION_`.

- Hive Metastore metadata automatic synchronization supports notification event in compressed format.

### Dynamic Partition Improvement

- Dynamic partition supports specifying the `storage_medium` parameter to control the storage medium of the newly added partition.

Reference: [https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition](https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition)


### Optimize BE's Threading Model

- Optimize BE's threading model to avoid stability problems caused by frequent thread creation and destroy.

# Bugfix

- Fixed issues with Merge-On-Write Unique Key tables.

- Fixed compaction related issues.

- Fixed some delete statement issues causing data errors.

- Fixed several query execution errors.

- Fixed the problem of using JDBC catalog to cause BE crash on some operating system.

- Fixed Multi-Catalog issues.

- Fixed memory statistics and optimization issues.

- Fixed decimalV3 and date/datetimev2 related issues.

- Fixed load transaction stability issues.

- Fixed light-weight schema change issues.

- Fixed the issue of using `datetime` type for batch partition creation.

- Fixed the problem that a large number of failed broker loads would cause the FE memory usage to be too high.

- Fixed the problem that stream load cannot be canceled after dropping the table.

- Fixed querying `information_schema` timeout in some cases.

- Fixed the problem of BE crash caused by concurrent data export using `select outfile`.

- Fixed transactional insert operation memory leak.

- Fixed several query/load profile issues, and supports direct download of profiles through FE web ui.

- Fixed the problem that the BE tablet GC thread caused the IO util to be too high.

- Fixed the problem that the commit offset is inaccurate in Kafka routine load.

1 change: 1 addition & 0 deletions docs/sidebars.json
Original file line number Diff line number Diff line change
Expand Up @@ -1195,6 +1195,7 @@
"type": "category",
"label": "Release notes",
"items": [
"releasenotes/release-1.2.3",
"releasenotes/release-1.2.2",
"releasenotes/release-1.2.1",
"releasenotes/release-1.2.0",
Expand Down
111 changes: 111 additions & 0 deletions docs/zh-CN/docs/releasenotes/release-1.2.3.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,111 @@
---
{
"title": "Release 1.2.3",
"language": "zh-CN"
}
---

<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->

在 1.2.3 版本中,Doris 团队已经修复了自 1.2.2 版本发布以来超过 200 个问题或性能改进项。同时,1.2.3 版本也作为 1.2 LTS 的迭代版本,具备更高的稳定性,建议所有用户升级到这个版本。


# Improvement

### JDBC Catalog

- 支持通过 JDBC Catalog 连接到另一个 Doris 数据库。

目前 JDBC Catalog 连接 Doris 只支持用 5.x 版本的 JDBC jar 包。如果使用 8.x JDBC jar 包可能会出现列类型无法匹配问题。

参考文档:[https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris)

- 支持通过参数 `only_specified_database` 来同步指定的数据库。

- 支持通过 `lower_case_table_names` 参数控制是否以小写形式同步表名,解决表名区分大小写的问题。

参考文档:[https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc)

- 优化 JDBC Catalog 的读取性能。

### Elasticsearch Catalog

- 支持 Array 类型映射。

- 支持通过 `like_push_down` 属性下推 like 表达式来控制 ES 集群的 CPU 开销。

参考文档:[https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es)

### Hive Catalog

- 支持 Hive 表默认分区 `__Hive_default_partition__`

- Hive Metastore 元数据自动同步支持压缩格式的通知事件。

### 动态分区优化

- 支持通过 storage_medium 参数来控制创建动态分区的默认存储介质。

参考文档:[https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition](https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition)


### 优化 BE 的线程模型

- 优化 BE 的线程模型,以避免频繁创建和销毁线程所带来的稳定性问题。

# Bug 修复

- 修复了部分 Unique Key 模型 Merge-on-Write 表的问题;

- 修复了部分 Compaction 相关问题;

- 修复了部分 Delete 语句导致的数据问题;

- 修复了部分 Query 执行问题;

- 修复了在某些操作系统上使用 JDBC Catalog 导致 BE 宕机的问题;

- 修复了部分 Multi-Catalog 的问题;

- 修复了部分内存统计和优化问题;

- 修复了部分 DecimalV3 和 date/datetimev2 的相关问题。

- 修复了部分导入过程中的稳定性问题;

- 修复了部分 Light Schema Change 的问题;

- 修复了使用 `datetime` 类型创建批处理分区的问题;

- 修复了 Broker Load 大数据量导入失败而导致的 FE 内存使用过高的问题;

- 修复了删除表后无法取消 Stream Load 的问题;

- 修复了某些情况下查询 `information_schema` 超时的问题;

- 修复了使用 `select outfile` 并发数据导出导致 BE 宕机的问题;

- 修复了事务性插入操作导致内存泄漏的问题;

- 修复了部分查询和导入 Profile 的问题,并支持通过 FE web ui 直接下载 Profile 文件;

- 修复了 BE Tablet GC 线程导致 IO 负载过高的问题;

- 修复了 Kafka Routine Load 中提交 Offset 不准确的问题。

0 comments on commit 5bd0062

Please sign in to comment.