OTTL additional converters

[michalpristas]

Component(s)

pkg/ottl

Is your feature request related to a problem? Please describe.

as we discussed with @evan-bradley at KubeCon we'd like to contribute to OTTL and identified some features which are missing from our point of view and we'd like to contribute them.

i'm bringing here (hopefully) a descriptive task list with these items to discuss and find agreement which of these fit and which do not fit upstream

for those we agree to work on upstream I'd create a separate issues where we can talk specifics

Describe the solution you'd like

*checked are things we agreed on

Converters

• Support for timezone, format and locale for Time converter
  • [pkg/ottl] [Time] Add support for format and timezone #32140
• Add Append converter appending one or more items into an array
  • [pkg/ottl] [Append] Support for appending items into an array #32141
• Add new ottl functions for renaming fields in one step:
  • [pkg/ottl] Add rename function #31901
• Allow specifying conflict strategy for set:
  • [pkg/ottl] Add conflict resolution strategies for set #31808
• Missing support for loops:
  • [pkg/ottl] Determine approach to looping #29289
• Consider ExtractGrokPatterns alternative to ExtractPatterns for better user experience
• Consider fail conflict strategy for merge_maps (fail fails with error in case target field is present)
• Missing converter for MurmurHash3
• Missing converter for SHA-512
• Missing converter for MD5
• Add option to convert uri string into uri object/map
  • [pkg/ottl] Parse uri string to url.* SemConv attributes #32433
• ParseKeyValue Allow regex for delimiters
• Add user agent converter (extracts details from the user agent string and adds this information by default under the - user_agent)
  • [pkg/ottl] Support for extracting UserAgent string #32434
• Add a registered domain converter that will extract subdomain, registered_domain, top_level_domain and domain from FQDN
• Add converter for decoding URL (if field is an array handle each element)
• Support for join: Accept field array for Concat or provide ConcatField
• Missing HtmlStrip converter stripping HTML tags
• Add NetworkDirection converter providing inbound/outbound direction based on source, dest and internal network fields
• Add Sort converter sorting array value asc or desc
• OTTL converter for trimming whitespaces and other symbols specified
• Translate converter that converts a field to a string value based on a predefined mapping
• Filter converter to parse the PRI field from the front of a Syslog (RFC3164) message
• Converter to non-ASCII characters with an ASCII approximation
• Add ExtractGrokPattern converter returning a map of values fitting parsed patterns
  • [pkg/ottl] Support for grok patterns #32593

Processors

• Introduce GeoIp processor
  • adds information about the geographical location of an IPv4 or IPv6 address by quering specified geoip databse (e.g GeoLite2)
  • New component: GeoIP processor #32663
• Introduce DNS processor
  • performs a lookup (either an A record/CNAME record lookup or a reverse lookup at the PTR record)

Describe alternatives you've considered

No response

Additional context

No response

[github-actions]

Pinging code owners:

• pkg/ottl: @TylerHelmuth @kentquirk @bogdandrutu @evan-bradley

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

• pkg/ottl: @TylerHelmuth @kentquirk @bogdandrutu @evan-bradley

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

• pkg/ottl: @TylerHelmuth @kentquirk @bogdandrutu @evan-bradley

See Adding Labels via Comments if you do not have permissions to add labels yourself.