Skip to content
This repository has been archived by the owner on Jun 16, 2023. It is now read-only.

jstorm 是否支持kafka-spout的动态增删? #500

Open
unclebob2013 opened this issue Apr 27, 2017 · 3 comments
Open

jstorm 是否支持kafka-spout的动态增删? #500

unclebob2013 opened this issue Apr 27, 2017 · 3 comments

Comments

@unclebob2013
Copy link

想实现不重启topology的情况下,通过重新加载配置,实现动态增删spout,读取不同的kafka-topic,请问目前版本的jstorm是否支持这样实现?

@tongh-qtl
Copy link

你不是用storm-kafka的么,这个一个spout只能订阅一个topic,处理其他topic需要重新提交toplogy,不知道你是怎么做的

@unclebob2013
Copy link
Author

发现storm1.0.x版本中支持了topic wildcard功能,通过配置正则来匹配topic名实现自动添加url

conf.put("kafka.topic.wildcard.match",true);
SpoutConfig spoutconfig = new SpoutConfig(hosts, GlobalConfig.TOPIC_PATTERNS, GlobalConfig.ZKROOT, GlobalConfig.SPOUT_ID);

目前jstorm支持这个功能么?

@vipsql
Copy link

vipsql commented May 14, 2017

kafka的consumer支持同时订阅多个Topic, 可在外部增加动态变量去控制订阅topic的数目

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants