Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds support for templates index pattern #102

Merged
merged 11 commits into from
Jan 18, 2021

Conversation

jalvz
Copy link
Contributor

@jalvz jalvz commented Jan 6, 2021

See motivation in #64 (comment)

It will require Kibana support, basically if this new property is true, the index pattern generated for the templates should be <type>-<dataset>.*-*
I will open a ticket in Kibana if this is accepted.

@elasticmachine
Copy link

elasticmachine commented Jan 6, 2021

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #102 updated

    • Start Time: 2021-01-18T14:00:19.763+0000
  • Duration: 3 min 51 sec

  • Commit: 09954e6

@ruflin
Copy link
Member

ruflin commented Jan 6, 2021

@jalvz Can you share a bit more details on how this will be used?

@jalvz
Copy link
Contributor Author

jalvz commented Jan 6, 2021

@ruflin you have been too fast :)
Backlink in description now

Copy link
Contributor

@mtojek mtojek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please modify the "good" test package, so we can be sure that the change works as intended.

versions/1/data_stream/manifest.spec.yml Outdated Show resolved Hide resolved
versions/1/data_stream/manifest.spec.yml Outdated Show resolved Hide resolved
@mtojek mtojek requested a review from ruflin January 7, 2021 08:56
Copy link
Member

@ruflin ruflin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm currently blocking this PR as we should first complete the discussion in #64 (comment)

I like the simplicity of this change but I worry it has many side effects. On the Stack side we loose the knowledge if the templates / mappings / index patterns for a data stream are all aligned or if a dev might have just introduced an invalide index pattern.

@jalvz
Copy link
Contributor Author

jalvz commented Jan 12, 2021

Updated as per #64 (comment)

@jalvz jalvz requested review from ruflin and mtojek January 12, 2021 12:41
@ruflin
Copy link
Member

ruflin commented Jan 13, 2021

@skh @jfsiii @jen-huang Could you chime in from the Kibana side if this is feasible?
@mtojek @ycombinator Not happy with the name yet (see conversation in the linked issue), so if you have ideas for better names ...
@jalvz LGTM but lets wait on the feedback from the Kibana side to not merge this too soon.

@jalvz
Copy link
Contributor Author

jalvz commented Jan 14, 2021

Filed Kibana issue: elastic/kibana#88307

@@ -111,6 +111,10 @@ spec:
type: string
examples:
- diagnostics
dataset_is_prefix:
description: if true, the generated index pattern will contain the dataset as a prefix only
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this only about the field index_patterns in an ES index template (this is what I guessed from the discussions), or also about Kibana index patterns (this is how this line reads without context)?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is only about the ES index patterns. It should not affect the Kibana ones as these are based on the types and include all datasets anyways.

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then this description should be changed accordingly.

@jalvz
Copy link
Contributor Author

jalvz commented Jan 18, 2021

Hey all, are there any more objections to this?

Copy link

@simitt simitt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@mtojek mtojek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, but let's leave the final decision to @ruflin .

EDIT:

please rebase the branch against master and update the changelog.

Copy link
Member

@ruflin ruflin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mtojek @ycombinator Side discussion: Should this go into https://github.com/elastic/package-spec/blob/master/versions/1/changelog.yml or where is the right place for this?

@mtojek
Copy link
Contributor

mtojek commented Jan 18, 2021

@mtojek @ycombinator Side discussion: Should this go into https://github.com/elastic/package-spec/blob/master/versions/1/changelog.yml or where is the right place for this?

Yes, this is the right place.

@jalvz jalvz merged commit 6435a2f into elastic:master Jan 18, 2021
@jalvz jalvz deleted the support-custom-index-pattern branch January 18, 2021 14:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants