Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use sarama built in support for consumer groups #6172

Merged
merged 7 commits into from
Jul 30, 2019

Conversation

danielnelson
Copy link
Contributor

Use sarama built in support for consumer groups instead of the, now deprecated, sarama-cluster library. Hoping this will help with #6136

Required for all PRs:

  • Signed CLA.
  • Associated README.md updated.
  • Has appropriate unit tests.

@danielnelson danielnelson added this to the 1.12.0 milestone Jul 26, 2019
@danielnelson danielnelson added area/kafka fix pr to fix corresponding bug labels Jul 26, 2019
log.Printf("I! WARNING: Kafka consumer invalid offset '%s', using 'oldest'",
k.Offset)
config.Consumer.Offsets.Initial = sarama.OffsetOldest
return fmt.Errorf("invalid offset %q", k.Offset)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this something that will need to be documented upfront, as previously bad values would be set to a default?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this change is okay, we always warned and the value was never valid.

@danielnelson danielnelson force-pushed the sarama-consumer-groups branch 3 times, most recently from 4a2d3c6 to a215be7 Compare July 30, 2019 01:47
VERSION := $(shell git describe --exact-match --tags 2>nil)
HOME := $(HOMEPATH)
CGO_ENABLED ?= 0
export CGO_ENABLED
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Switched over to disabling CGO in Windows unless explicitly enabled. Not entirely sure this is a good idea but I'm trying to avoid the confusion of suddenly needing gcc to build.

@danielnelson danielnelson merged commit aea09b3 into master Jul 30, 2019
@danielnelson danielnelson deleted the sarama-consumer-groups branch July 30, 2019 03:41
bitcharmer pushed a commit to bitcharmer/telegraf that referenced this pull request Oct 18, 2019
athoune pushed a commit to bearstech/telegraf that referenced this pull request Apr 17, 2020
idohalevi pushed a commit to idohalevi/telegraf that referenced this pull request Sep 29, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/kafka fix pr to fix corresponding bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants