Skip to content

Latest commit

 

History

History
 
 

datanode

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
allocator
allocator
 
 
broker
broker
 
 
importv2
importv2
 
 
io
io
 
 
iterators
iterators
 
 
metacache
metacache
 
 
syncmgr
syncmgr
 
 
writebuffer
writebuffer
 
 
OWNERS
OWNERS
 
 
README.md
README.md
 
 
binlog_io.go
binlog_io.go
 
 
binlog_io_test.go
binlog_io_test.go
 
 
cache.go
cache.go
 
 
cache_test.go
cache_test.go
 
 
channel_checkpoint_updater.go
channel_checkpoint_updater.go
 
 
channel_checkpoint_updater_test.go
channel_checkpoint_updater_test.go
 
 
channel_manager.go
channel_manager.go
 
 
channel_manager_test.go
channel_manager_test.go
 
 
compaction_executor.go
compaction_executor.go
 
 
compaction_executor_test.go
compaction_executor_test.go
 
 
compactor.go
compactor.go
 
 
compactor_test.go
compactor_test.go
 
 
data_node.go
data_node.go
 
 
data_node_test.go
data_node_test.go
 
 
data_sync_service.go
data_sync_service.go
 
 
data_sync_service_test.go
data_sync_service_test.go
 
 
event_manager.go
event_manager.go
 
 
event_manager_test.go
event_manager_test.go
 
 
flow_graph_dd_node.go
flow_graph_dd_node.go
 
 
flow_graph_dd_node_test.go
flow_graph_dd_node_test.go
 
 
flow_graph_dmstream_input_node.go
flow_graph_dmstream_input_node.go
 
 
flow_graph_dmstream_input_node_test.go
flow_graph_dmstream_input_node_test.go
 
 
flow_graph_manager.go
flow_graph_manager.go
 
 
flow_graph_manager_test.go
flow_graph_manager_test.go
 
 
flow_graph_message.go
flow_graph_message.go
 
 
flow_graph_message_test.go
flow_graph_message_test.go
 
 
flow_graph_node.go
flow_graph_node.go
 
 
flow_graph_time_tick_node.go
flow_graph_time_tick_node.go
 
 
flow_graph_time_ticker.go
flow_graph_time_ticker.go
 
 
flow_graph_write_node.go
flow_graph_write_node.go
 
 
flush_task_counter.go
flush_task_counter.go
 
 
flush_task_counter_test.go
flush_task_counter_test.go
 
 
io_pool.go
io_pool.go
 
 
io_pool_test.go
io_pool_test.go
 
 
l0_compactor.go
l0_compactor.go
 
 
l0_compactor_test.go
l0_compactor_test.go
 
 
meta_service.go
meta_service.go
 
 
meta_service_test.go
meta_service_test.go
 
 
meta_util.go
meta_util.go
 
 
metrics_info.go
metrics_info.go
 
 
mock_channelmanager.go
mock_channelmanager.go
 
 
mock_fgmanager.go
mock_fgmanager.go
 
 
mock_test.go
mock_test.go
 
 
rate_collector.go
rate_collector.go
 
 
rate_collector_test.go
rate_collector_test.go
 
 
services.go
services.go
 
 
services_test.go
services_test.go
 
 
stats_updater.go
stats_updater.go
 
 
stats_updater_test.go
stats_updater_test.go
 
 
timetick_sender.go
timetick_sender.go
 
 
timetick_sender_test.go
timetick_sender_test.go
 
 
util.go
util.go
 
 

README.md

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

  • KV store: a kv store that persists messages into blob storage.
  • Message stream: receive messages and publish imformation
  • Root Coordinator: get the latest unique IDs.
  • Data Coordinator: get the flush information and which message stream to subscribe.