Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[receiver:awsfirehosereceiver] added support for OTLP v1.0.0 format #34982

Conversation

vihangvk
Copy link
Contributor

@vihangvk vihangvk commented Sep 3, 2024

Description: Added support for OpenTelemetry 1.0.0 format

Current implementation for awsfirehosereceiver supports only JSON format.
Added support to handle OpenTelemetry 1.0.0 format.
Standard OpenTelemetry receiver does not work as AWS Cloudwatch metrics are streamed via AWS Firehose stream. So the actual OpenTelemetry data is embedded in AWS Firehose records.

This can be enabled in configuration by setting record_type to otlp_v1. (Added suffix v1 as AWS CloudWatch metrics streaming also supports OpenTelemetry 0.7.0 format).

  • Added new Unmarshaler under new package otlpmetricstream.
  • Updated defaultMetricsUnmarshalers in factory.go to create instance of new Unmarshaler.
  • Added new record type in availableRecordTypes to support the OpenTelemetry 1.0.0 format.

Testing: Added test cases to test new Unmarshler to test record unmarshaling.

Documentation: Updated readme to document new record_type.

@vihangvk vihangvk requested review from a team and mx-psi September 3, 2024 15:26
Copy link

linux-foundation-easycla bot commented Sep 3, 2024

CLA Signed

The committers listed above are authorized under a signed CLA.

  • ✅ login: vihangvk / name: Vihang (f3fb95c)

@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch 7 times, most recently from 1cfd813 to ec9b6fc Compare September 6, 2024 11:25
@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch 2 times, most recently from 842dbe7 to c910564 Compare September 10, 2024 11:36
@vihangvk vihangvk changed the title [receiver:awsfirehosereceiver] added support for Otel format [receiver:awsfirehosereceiver] added support for OTLP v1.0.0 format Sep 10, 2024
@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch 7 times, most recently from de3e1b3 to 12aedd1 Compare September 13, 2024 12:41
@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch from 12aedd1 to a197824 Compare October 1, 2024 10:29
@vihangvk vihangvk requested a review from a team as a code owner October 1, 2024 10:29
@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch 2 times, most recently from e8a6e7a to 9fcb7aa Compare October 1, 2024 11:14
@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch 4 times, most recently from fa0ec51 to a5ddedd Compare October 7, 2024 09:29
@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch from a5ddedd to bb3fcd1 Compare October 9, 2024 07:20
@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch from bb3fcd1 to a84f79d Compare October 10, 2024 10:43
@vihangvk
Copy link
Contributor Author

vihangvk commented Oct 10, 2024

@Aneurysm9 Thanks for approving the PR but had to rebase due to conflicting upstream changes.
@Aneurysm9, @jpkrohling could you please approve and help merge these changes?

@vihangvk
Copy link
Contributor Author

@mx-psi could you please help approve and merge this PR?

@mx-psi
Copy link
Member

mx-psi commented Oct 10, 2024

Looks like you need to regenerate the code by running make generate

@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch from a84f79d to c8b3a58 Compare October 10, 2024 14:11
@vihangvk vihangvk force-pushed the feature/awsfirehosereceiver_otelformat_support branch from c8b3a58 to f3fb95c Compare October 10, 2024 14:13
@vihangvk
Copy link
Contributor Author

Looks like you need to regenerate the code by running make generate

@mx-psi Thanks! Ran make generate and pushed changes.

@vihangvk
Copy link
Contributor Author

@mx-psi Checks are passed, could you please help merge the PR? Thanks!

@mx-psi mx-psi merged commit cc95389 into open-telemetry:main Oct 10, 2024
158 checks passed
@github-actions github-actions bot added this to the next release milestone Oct 10, 2024
@vihangvk vihangvk deleted the feature/awsfirehosereceiver_otelformat_support branch October 11, 2024 07:42
@vihangvk vihangvk restored the feature/awsfirehosereceiver_otelformat_support branch October 15, 2024 08:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants