Skip to content

Haproxy filebeat TCP log format#8526

Closed
sayden wants to merge 2 commits intoelastic:masterfrom
sayden:haproxy-filebeat-tcplog-format
Closed

Haproxy filebeat TCP log format#8526
sayden wants to merge 2 commits intoelastic:masterfrom
sayden:haproxy-filebeat-tcplog-format

Conversation

@sayden
Copy link
Copy Markdown
Contributor

@sayden sayden commented Oct 1, 2018

Refer to this Issue for more details elastic/integrations#3250

WIP of the TCP log format that requires #8428 to be merged first

@sayden sayden added enhancement in progress Pull request is currently in progress. module review Filebeat Filebeat needs_backport PR is waiting to be backported to other branches. v6.5.0 labels Oct 1, 2018
Comment thread filebeat/docs/fields.asciidoc Outdated
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We may want to make use of ECS here https://github.com/elastic/ecs#-destination-fields

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have given it a try but I got quite a lot of small blocking issues so I'm gonna continue with the old naming yet.

Copy link
Copy Markdown
Member

@jsoriano jsoriano Oct 17, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you use ECS names under haproxy namespace in any case? (it'd be haproxy.destination.port and haproxy.destination.ip here)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Other fields in this file start with the name of the metric, we should probably open another PR to rephrase them for consistency, @sayden can you take care of this?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wouldn't namespace these common fields under default.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, I guess this comes from #8428

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Client IP could be a public one, so geoip data is filled.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess this is that no server name was provided in the config? I guess that for this case we could leave this field empty, or even remove it.
It'd be nice to have also an example of a log line with a proper server name.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In other modules, message is removed after it is parsed, we may want to do the same on this module.

@sayden sayden force-pushed the haproxy-filebeat-tcplog-format branch from 5120f9f to 3e82444 Compare October 17, 2018 18:03
@sayden
Copy link
Copy Markdown
Contributor Author

sayden commented Oct 17, 2018

Continues here #8637

@sayden sayden closed this Oct 17, 2018
@sayden sayden deleted the haproxy-filebeat-tcplog-format branch October 18, 2018 11:09
@urso urso removed the needs_backport PR is waiting to be backported to other branches. label Oct 24, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement Filebeat Filebeat in progress Pull request is currently in progress. module review v6.5.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants