support dissect feature to convert plain text to structured data

[newly12]

Is your feature request related to a problem? Please describe.
In elastic ecosystem, filebeat, logstash, elasticsearch all support dissect processor to convert plain text to structured data, which is pretty useful, given already exists filelogreceiver for log file ingestion, it seems to make sense to support this in otel collector as well.

Describe the solution you'd like
Support dissect processer.

Describe alternatives you've considered
Dissect operator in filelogreceiver

Additional context

[dmitryax]

Hey @newly12 , what data you want to process with this? traces, metrics, logs or some attributes?

[newly12]

@dmitryax in my use case, it's log line.

[dmitryax]

@TylerHelmuth this is something that will be possible to do with transform processor, right?

[newly12]

If we implement an in house processor that does dissect or something similar in a processor, a typical use case is that we want to parse the "log"(event) timestamp from a "dissected" field and set it as the log record's time, similar to what's currently in filelog receiver, the json_parser and then the timestamp operator. However currently time parsing can only be done by timestamp operator in this receiver, does it make sense to have this capability in a processor? would it be OTTL or a different processor? cc @linjunzhe

[newly12]

If we implement an in house processor that does dissect or something similar in a processor, a typical use case is that we want to parse the "log"(event) timestamp from a "dissected" field and set it as the log record's time, similar to what's currently in filelog receiver, the json_parser and then the timestamp operator. However currently time parsing can only be done by timestamp operator in this receiver, does it make sense to have this capability in a processor? would it be OTTL or a different processor? cc @linjunzhe

Hi @TylerHelmuth any comment on this?

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

[TylerHelmuth]

IDK how I missed this for so long but thanks Stale Bot for the last ditch effort haha

I think this is definitely appropriate for the transformprocessor. There are some open issues for improving how OTTL/transformprocessor interact with time: #16067 and we just made a ParseJSON function.

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

[github-actions]

Pinging code owners for pkg/ottl: @TylerHelmuth @kentquirk @bogdandrutu @evan-bradley. See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

• pkg/ottl: @TylerHelmuth @kentquirk @bogdandrutu @evan-bradley

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions]

This issue has been closed as inactive because it has been stale for 120 days with no activity.