Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SUPPORT] DataDog Metrics Reporter using outdated DataDog API endpoint #8785

Open
bradleybonitatibus opened this issue May 23, 2023 · 1 comment
Labels
metrics priority:minor everything else; usability gaps; questions; feature reqs

Comments

@bradleybonitatibus
Copy link

bradleybonitatibus commented May 23, 2023

Describe the problem you faced

I'm trying to configure DataDogMetricsReporter for many DeltaStreamer jobs and getting the following issue when using the 0.13.0 documentation for metrics (https://hudi.apache.org/docs/metrics/#datadogmetricsreporter):

Caused by: javax.net.ssl.SSLPeerUnverifiedException: Host name 'app.us.datadoghq.com' 
does not match the certificate subject provided by
the peer (CN=*.datadoghq.com, O="Datadog, Inc.", L=New York, ST=New York, C=US)

To Reproduce

Steps to reproduce the behavior:

  1. Follow Metrics documentation for DataDogMetricsReporter
  2. Add API Key and turn metrics on
  3. Deploy delta streamer job with the appropriate properties

Expected behavior

I expected to see the hoodie. prefixed metrics in DataDog.

Environment Description

  • Hudi version : 0.13.0

  • Spark version : 3.1

  • Hive version : 2.3.1

  • Hadoop version : 2.10.1

  • Storage (HDFS/S3/GCS..) : S3

  • Running on Docker? (yes/no) : No

Additional context

I've reached out to DataDog Support and they seem to say something similar regarding the outdated endpoint being the possible cause of this failure to write metrics to DataDog.

The Metrics Writer uses "app.us.datadoghq"
but the official documentation says the API needs to be api.datadoghq.com.

@codope codope added priority:minor everything else; usability gaps; questions; feature reqs metrics labels May 24, 2023
@github-project-automation github-project-automation bot moved this to ⏳ Awaiting Triage in Hudi Issue Support May 24, 2023
@codope codope moved this from ⏳ Awaiting Triage to 🚧 Needs Repro in Hudi Issue Support May 24, 2023
@parisni
Copy link
Contributor

parisni commented Dec 26, 2023

the api has changed, this is true. but as a workaround you can turn:

                    {"hoodie.metrics.datadog.metric.host", "api.datadoghq"},

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
metrics priority:minor everything else; usability gaps; questions; feature reqs
Projects
Status: 🚧 Needs Repro
Development

No branches or pull requests

3 participants