We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the problem you faced
When running the Hudi streamer with the https://hudi.apache.org/releases/release-0.14.0#dynamic-configuration-updates feature configured, the streamer restarted after a configuration change as expected; however, metrics reporting stopped.
I believe the sequence of events are as follows:
Hudi calls streamSync.close() which ends up shutting down metrics reporting. Since the metrics instances are all cached in a static field, when a new StreamSync instance is created, it creates a new HoodieMetrics instance which reuses the stopped Metrics instance.
StreamSync
Metrics
#10132 is a fix for a similar issue, but not related to the streamer. (That patch is already in hudi 0.14.)
To Reproduce
Steps to reproduce the behavior:
--config-hot-update-strategy-class
ConfigurationHotUpdateStrategy.updateProperties
Expected behavior
After the streamer re-initializes metrics reporting continues to work.
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Describe the problem you faced
When running the Hudi streamer with the https://hudi.apache.org/releases/release-0.14.0#dynamic-configuration-updates feature configured, the streamer restarted after a configuration change as expected; however, metrics reporting stopped.
I believe the sequence of events are as follows:
Hudi calls streamSync.close() which ends up shutting down metrics reporting. Since the metrics instances are all cached in a static field, when a new
StreamSync
instance is created, it creates a new HoodieMetrics instance which reuses the stoppedMetrics
instance.#10132 is a fix for a similar issue, but not related to the streamer. (That patch is already in hudi 0.14.)
To Reproduce
Steps to reproduce the behavior:
--config-hot-update-strategy-class
option configure with your hot update strategy classConfigurationHotUpdateStrategy.updateProperties
method returns updated propertiesExpected behavior
After the streamer re-initializes metrics reporting continues to work.
The text was updated successfully, but these errors were encountered: