Skip to content

Auto create table in BigQuery #13033

Open
@Hipska

Description

@Hipska

Use Case

With some input plugins the metric names and formats are unknown on beforehand, the number of tags and fields can vary over time. Therefore it would be nice if the outputs.bigquery plugin could handle this in a way similar to the outputs.sql plugin.

Expected behavior

Telegraf creates the required table in BigQuery with all the corresponding metric fields and tags just as the sql

Actual behavior

Tables for metrics need to be created on beforehand in BigQuery.

Additional info

Here is a PoC which adds a new BigQuery field on the fly, proving it should be possible.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/gcpGoogle Cloud plugins including cloud_pubsub, cloud_pubsub_push, stackdriverfeature requestRequests for new plugin and for new features to existing pluginshelp wantedRequest for community participation, code, contributionplugin/output1. Request for new output plugins 2. Issues/PRs that are related to out plugins

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions