[O11y][Kafka] Lens Migration

[harnish-crest-data]

Manually migrate Kafka visualizations to lens in kibana version 8.8.0.

Preparation of data for testing

• Use sample_event.json / setup live instance using docker / mock data using mock server to populate dashboards

Migration stats

Kafka Dashboards	Before Migration			After Migration
	Search	Lens	Visualization	Search	Lens	Visualization
[Logs Kafka] Overview	2	0	2	2	2	0
[Metrics Kafka] Overview	0	0	9	0	13	0
	2	0	11	2	15	0

Data stream : Broker

• Migrate 6 visualizations to the lens
  • [O11y][Kafka] Migration for visualizations to lens in kibana 8.8.0 #5594

Data stream : Consumer Group

• Migrate 3 visualizations to the lens
  • [O11y][Kafka] Migration for visualizations to lens in kibana 8.8.0 #5594

Data stream : Log

• Migrate 2 visualizations to the lens
  • [O11y][Kafka] Migration for visualizations to lens in kibana 8.8.0 #5594

Data stream : Partition

• Migrate 4 visualizations to the lens
  • [O11y][Kafka] Migration for visualizations to lens in kibana 8.8.0 #5594

Verification and Validation

• Verification of functionality remains the same after migration in kibana
• Verification of data count of after-migrated visualization with before-migrated visualization in kibana
• Verification of Dashboard are not distorted in supported kibana version (8.8.0)

Note

• Kafka Metric visualization split to 4 lens metrics charts.

[agithomas]

Are the issues reported applicable for all dashboards? Are these blockers? Or, there exist a workaround?

[agithomas]

Are the impacted panels kept in the old vis ?

[harnish-crest-data]

Are the issues reported applicable for all dashboards? Are these blockers? Or, there exist a workaround?
Are the impacted panels kept in the old vis ?

For the Support multiple metrics in one chart using lens issue, we have workaround.
For the Not having feature to set last bucket value issue, we are blocked.

We have already mentioned these things in PR description itself. Could you please take a look? #5594

[agithomas]

Are the issues reported applicable for all dashboards? Are these blockers? Or, there exist a workaround?
Are the impacted panels kept in the old vis ?

For the Support multiple metrics in one chart using lens issue, we have workaround. For the Not having feature to set last bucket value issue, we are blocked.

We have already mentioned these things in PR description itself. Could you please take a look? #5594

Can you document here - the names of the dashboard panels that are not migrated?

[harnish-crest-data]

@agithomas The kafka lens migration is 100% completed now after discuss with Subhrata. FYI, we have split Kafka Metric visualization to 4 individual lens metrics charts which I have mentioned in the issue.

[rameshelastic]

What is pending here?

[rajvi-patel-22]

What is pending here?

@rameshelastic, We are waiting for the confirmation as this integration has large version change. [Reference]