Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Dynamic URI in HTTP Output #9786

Open
mohamdkh opened this issue Jan 2, 2025 · 1 comment
Open

Support for Dynamic URI in HTTP Output #9786

mohamdkh opened this issue Jan 2, 2025 · 1 comment

Comments

@mohamdkh
Copy link

mohamdkh commented Jan 2, 2025

Bug Report

Describe the bug
I am currently using the Fluent Bit HTTP output plugin to send data to an OpenSearch endpoint. The configuration for the HTTP output includes a static URI as shown below:
[OUTPUT]
Name http
Match *
host opensearch
Port 9200
URI /test/_doc?routing=$routing
tls On
tls.verify Off
http_User admin
http_Passwd pwd
header Content-Type application/json; charset=utf-8
allow_duplicated_headers false
Format json_stream
In this setup, I need the routing value in the URI to be dynamically replaced based on the data being processed (i.e., extracted from each record). However, it seems that the URI field does not support dynamic placeholders, as the value remains empty or unchangeable at runtime.

Could you clarify:

Is it currently possible to use dynamic placeholders in the URI field?
If not, could this feature be considered for future releases?

@edsiper
Copy link
Member

edsiper commented Jan 7, 2025

this is not supported. Note that the plugin receives a chunk that contains N records, if each recond have a different value for $routing you will need to do X number of HTTP requests. Maybe is easier to implement by using the Tag ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants