Skip to content

Commit

Permalink
update danube_pubsub with partitioned topic
Browse files Browse the repository at this point in the history
  • Loading branch information
danrusei committed Aug 15, 2024
1 parent 7f88a26 commit 09fd75d
Show file tree
Hide file tree
Showing 3 changed files with 13 additions and 5 deletions.
2 changes: 1 addition & 1 deletion docs/architecture/topics.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ Example: **/default/markets** (where *default* is the namespace and *markets* th

## Partitioned Topics

Danube support both **partitioned and non-partitioned topics**. The non-partitioned topics are served by a single broker, which limits the maximum throughput of the topic. The partitioned topic has partitiones that are handled by multiple brokers within the cluster, thus allowing for higher throughput.
Danube support both **partitioned and non-partitioned topics**. The non-partitioned topics are served by a single broker, while the partitioned topic has partitiones that are served by multiple brokers within the cluster, thus allowing for higher throughput.

A partitioned topic is implemented as N internal topics, where N is the number of partitions. When publishing messages to a partitioned topic, each message is routed to one of several brokers. The distribution of partitions across brokers is handled automatically.

Expand Down
4 changes: 2 additions & 2 deletions docs/danube_clis/danube_pubsub/consumer.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,11 +16,11 @@ danube-pubsub consume [OPTIONS] --service-addr <SERVICE_ADDR> --subscription <SU

- `-t, --topic <TOPIC>`
Description: The topic to consume messages from.
Default: `/default/test_topic`
If not specified: `/default/test_topic`

- `-c, --consumer <CONSUMER>`
Description: The consumer name.
Default: `consumer_pubsub`
If not specified: `consumer_pubsub`

- `-m, --subscription <SUBSCRIPTION>`
Description: The subscription name.
Expand Down
12 changes: 10 additions & 2 deletions docs/danube_clis/danube_pubsub/producer.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,11 +14,19 @@ danube-pubsub produce [OPTIONS] --service-addr <SERVICE_ADDR> --message <MESSAGE
Description: The service URL for the Danube broker.
Example: `http://127.0.0.1:6650`

- `-n, --producer-name <PRODUCER_NAME>`
Description: The producer name .
If not specified: `test_producer`

- `-t, --topic <TOPIC>`
Description: The topic to produce messages to.
Default: `/default/test_topic`
If not specified: `/default/test_topic`

- `-p, --partitions <number>`
Description: The number of topic partitions.
Default: `None`

- `-p, --schema <SCHEMA>`
- `-y, --schema <SCHEMA>`
Description: The schema type of the message.
Possible values: `bytes`, `string`, `int64`, `json`

Expand Down

0 comments on commit 09fd75d

Please sign in to comment.