Skip to content

[BUG] Data Stream tries to connect to opensearch during dry-run #104

Closed
@Jakob3xD

Description

(check apply)

  • read the contribution guideline
  • (optional) already reported 3rd party upstream repository or mailing list if you use k8s addon or helm charts.

Steps to replicate

Create a fluentd config with following content:

<match **>
  @type opensearch_data_stream
  hosts "#{ENV['FLUENT_OS_HOSTS']}"
  port 443
  scheme https
  user "#{ENV['FLUENT_OS_USER']}"
  password "#{ENV['FLUENT_OS_PASS']}"
  reconnect_on_error true
  request_timeout 25s
  ssl_version TLSv1_2
  ssl_verify true
  log_os_400_reason true
  suppress_type_name true
  data_stream_name test
  data_stream_template_name test
  include_tag_key true
</match>

Execute fluentd with the dry-run flag:

fluentd --config test.conf --dry-run

You will get the following error:

2023-06-23 07:01:47 +0000 [error]: config error file="test.conf" error_class=Fluent::ConfigError error="Failed to create data stream: <test> Cannot get new connection from pool."

Expected Behavior or What you need to ask

With the normal opensearch type, dry-run does not try to connect to any opensearch. I would expect the same behavior with the opensearch_data_stream type.

Using Fluentd and OpenSearch plugin versions

  • Ubuntu 22.04
  • Bare Metal with a systemd service
  • fluentd 1.16.1
  • gem 'fluent-plugin-opensearch' version '1.1.0'

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions