v1.0.0-alpha02

Major features

• Table Partition
  • Support key partition(MySQL-like syntax).
  • Implement PartitionTable to support query and write for partitioned tables.
• Improve query performance
  • Add disk based object store cache. (unstable)
  • Implement parallel get_byte_ranges for ObjectStoreReader.
  • Scan row groups in one sst file parallelly.
  • Support bloom filter in hybrid format.
  • Support MergeIterator to pull data concurrently.
• Support auto query forwarding for grpc.
• Normalize the case of SQL and make clear that all SQL cases are sensitive.
• Chore
  • Migrate current harness tests to sqlness. by @dust1
  • Support memory usage limit on background compaction.
  • Make the bloom filter optional in sst meta.
• Bug fix
  • Fix wrong primary key when define tsid and timestamp key as primary key.
  • Fix wrong path in the result from StoreWithPrefix.
  • Fix lru-weighted-cache` memory leak.
  • Fix some bugs in background compaction.
  • Fix wrong profile output os path for heap profiling.

What's Changed

• feat: convert table name to lowercase when not quoted by @jiacai2050 in #444
• fix: object_store config by @jiacai2050 in #443
• feat: add disk based object store cache by @jiacai2050 in #420
• feat: add dynamic setting log level by @ZuLiangWang in #445
• feat: add disk cache value crc by @jiacai2050 in #447
• refactor: make http max body size configurable and modify default value by @Rachelint in #451
• chore: use default value for StorageOptions by @jiacai2050 in #455
• chore: modify some config in workflows by @chunshao90 in #457
• fix: wrong primary key when define tsid and timestamp key as primary key by @ShiKaiWi in #453
• feat: impl parallel get_byte_ranges for ObjectStoreReader by @chunshao90 in #450
• feat: convert table name to quoted style by @Rachelint in #454
• refactor: remove enable_tsid_primary_key by @ShiKaiWi in #459
• chore: bump oss sdk by @jiacai2050 in #458
• feat: make rocksdb wal compatible with other distributed implementation by @Rachelint in #460
• fix: kill ceresdb-server if run harness failed by @ShiKaiWi in #461
• feat: support prefix for object store by @ShiKaiWi in #463
• fix: wrong path in the result from StoreWithPrefix by @ShiKaiWi in #465
• feat: make initializing of buffered streams in MergeIterator concurrent by @Rachelint in #466
• chore: add metrics oss by @chunshao90 in #478
• chore: bump oss sdk by @ZuLiangWang in #475
• feat: support memory usage limit on background compaction by @ShiKaiWi in #476
• fix: lru-weighted-cache mem leak by @jiacai2050 in #480
• chore: support Cargo.toml format check by @ShiKaiWi in #481
• feat: support bloom filter in hybrid format by @Rachelint in #479
• fix: compact table in background scheduler by @jiacai2050 in #482
• fix: wrong profile output os path for heap profiling by @ShiKaiWi in #484
• feat: add max_input_sstable_size by @jiacai2050 in #483
• feat: scan row groups in one sst file parallelly by @Rachelint in #474
• feat: migrate current harness tests to sqlness by @dust1 in #473
• feat: make the bloom filter optional in sst meta by @ShiKaiWi in #488
• feat: support store with readonly cache by @ShiKaiWi in #490
• feat: support ignore bloomfilter when compaction by @ShiKaiWi in #491
• fix: remove EncodingWriter by @jiacai2050 in #493
• feat: support create partition table by @chunshao90 in #485
• feat: support parsing partition table creating by @Rachelint in #487
• feat: support query limit by rule by @ShiKaiWi in #494
• chore: adjust usage of sst type by @ShiKaiWi in #499
• feat: introduce ObjectStorePicker to replace the two object stores by @ShiKaiWi in #496
• feat: define remote table engine trait by @Rachelint in #502
• feat: define partition rule trait by @Rachelint in #501
• refactor: separate object store from parquet sst async reader by @ShiKaiWi in #503
• refactor: recovery in standalone mode by @Rachelint in #414
• feat: support parse key partition by @ShiKaiWi in #506
• chore: define remote_engine grpc service by @chunshao90 in #505
• feat: impl key partition rule by @Rachelint in #507
• feat: auto forward query for grpc by @ShiKaiWi in #511
• feat: impl remote_engine grpc service by @chunshao90 in #508
• feat: Impl remote sdk by @Rachelint in #509
• feat: upgrade sqlness to latest version by @jiacai2050 in #517
• feat: update ceresdb proto & adapter to partition info by @ZuLiangWang in #515
• fix: fix conversion by avro by @Rachelint in #519
• fix: fix convert record batch by @ZuLiangWang in #521
• feat: impl PartitionTable by @chunshao90 in #512
• fix: fix partition table affected_rows by @chunshao90 in #522
• chore: add more context for query log by @jiacai2050 in #523
• chore: bump sqlness to 0.1.1 by @jiacai2050 in #524
• fix: fix integration test's bad case by @Rachelint in #527

Full Changelog: v1.0.0-alpha01...v1.0.0-alpha02