[O11y][Apache Spark] Lens Migration

[harnish-crest-data]

Manually migrate Apache Spark visualizations to lens in current kibana version 8.1.0 itself.

Preparation of data for testing

• Use sample_event.json / setup live instance using docker / mock data using mock server to populate dashboards

Migration stats

Apache Spark dashboard	Before Migration		After Migration
	Lens	Visualization	Lens	Visualization
[Metrics Apache Spark] Overview	2	18	20	0

Data stream: Driver

• Migrate 8 visualizations to the lens
  • [O11y][Apache Spark] Lens migration for visualizations to kibana version 8.1.0  #5492

Data stream : Executor

• Migrate 5 visualizations to the lens
  • [O11y][Apache Spark] Lens migration for visualizations to kibana version 8.1.0  #5492

Data stream : Node

• Migrate 6 visualizations to the lens
  • [O11y][Apache Spark] Lens migration for visualizations to kibana version 8.1.0  #5492

Data stream : Application

• Migrate 1 visualization to the lens
  • [O11y][Apache Spark] Lens migration for visualizations to kibana version 8.1.0  #5492

Verification and Validation

• Verification of functionality remains the same after migration in kibana
• Verification of data count of after-migrated visualization with before-migrated visualization in kibana
• Verification of Dashboard are not distorted in supported kibana version (8.1.0)

Issues Identified

• Facing issue related to aggregation based gauge chart to lens gauge chart while migrating. [Lens Gauge chart] Gauge chart is not showing value if it exceeds than the provided limit like aggregation based gauge chart kibana#153010

[harnish-crest-data]

PR is approved and merged, hence closing this issue. #5492