[Roadmap] RisingLight v0.1

[skyzh]

We plan to release RisingLight and RisingLight tutorial in late February.

RisingLight Tutorial

RisingLight Tutorial is a step-by-step tutorial to build a RisingLight-like OLAP database. It will be in Chinese. We plan to release 3 parts:

• Intro (Basic framework of a database)
• Query (How to run a query on a database)
• Storage (A merge-tree-based column storage)

RisingLight

RisingLight is an OLAP educational database. We plan to implement new features and fix bugs before RisingLight's release.

Able to execute TPC-H 1, 3, 6 with optimal plans

Tracking issue:

• feat: support TPC-H Q3 #227
• feat: support TPC-H Q1 and Q6 #325

• Support related executors
  • TopN executor: support TopN #404
  • FilterScan
  • HashJoin
• Optimizer
  • Rust-flavor visitor framework
  • Join-related rules
• Data types
  • Decimal
  • Date
• Better user interface
  • Add column name for query results binder: show column name in query result #231
  • INSERT INTO ... SELECT ... binder: insert into .. select .. from .. support #102

Able to store and query ~20GB ~10GB of data in storage

• Support RLE encoding for efficient data representation storage: support run-length encoding #255
• Support filter scan in storage layer storage: predicate pushdown #189
• executor: refactor executors to split chunks using DataChunkBuilder #348

Docs

• Design docs about optimizer, storage, ...

[skyzh]

Some updates on RisingLight Tutorial -- we have finished about 50% of code and 20% of tutorial docs. It's still in a private repo, and will be made public later this month (if possible).

[MingjiHan99]

INSERT INTO ... SELECT ...
I could have a try.

[evanxg852000]

@skyzh Please what's the status of the tutorial docs?
Been waiting on this as I would like to start working through them.

[skyzh]

@skyzh Please what's the status of the tutorial docs?

Been waiting on this as I would like to start working through them.

It is delayed to next month :)