tikv: store WAL and Level 0 on SSD, offload higher levels to object store such as S3 #14507
Labels
feature/reviewing
This feature request is reviewing by product managers
type/enhancement
The issue or PR belongs to an enhancement.
type/feature-request
Categorizes issue or PR as related to a new feature.
Feature Request
Log data such as transaction details, browse history, may reach many TB or PB, and they must be query online. Store them on S3 may be much cheaper than SSD. Although S3 has much higher latency than SSD, it is acceptable if people just search their logs.
Consider RocksDB, where TiKV is based on: Is it possible that level 0 WAL files still be written into SSD, while level 1 and higher level SST files written into S3?
An open source project RocksDB-Cloud can set up RocksDB on S3, but there is no such an SQL database support it.
The text was updated successfully, but these errors were encountered: