Skip to content

Adds AutoOps and Stack Monitoring comparison #1711

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added deploy-manage/images/cloud-autoops-setup.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
6 changes: 5 additions & 1 deletion deploy-manage/monitor/_snippets/autoops.md
Original file line number Diff line number Diff line change
@@ -1 +1,5 @@
If you’re using {{ech}}, then you can use AutoOps to monitor your cluster. AutoOps significantly simplifies cluster management with performance recommendations, resource utilization visibility, real-time issue detection and resolution paths. AutoOps is [rolling out](/deploy-manage/monitor/autoops/ec-autoops-regions.md) in phases across {{ech}} regions and cloud service providers. It will be automatically activated for your deployment, with no installation required. For more information, refer to [Monitor with AutoOps](/deploy-manage/monitor/autoops.md).
If you’re using {{ech}}, then you can use [AutoOps](/deploy-manage/monitor/autoops.md) to monitor your cluster.

AutoOps significantly simplifies cluster management with performance recommendations, resource utilization visibility, real-time issue detection, and resolution paths. AutoOps is [rolling out](/deploy-manage/monitor/autoops/ec-autoops-regions.md) in phases across {{ech}} regions and cloud service providers. It will be automatically activated for your deployment with no installation required.

To help you make your decision, refer to [AutoOps and Stack Monitoring comparison](/deploy-manage/monitor/autoops/autoops-stack-monitoring-comparison.md).
154 changes: 154 additions & 0 deletions deploy-manage/monitor/autoops/autoops-stack-monitoring-comparison.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,154 @@
---
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

strongly suggest that this page is brought up a level instead of nested under AutoOps.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That makes sense! The comparison should be a level above both products' pages

applies_to:
deployment:
ess: all
ece: all
eck: all
self: all
navigation_title: AutoOps and Stack Monitoring comparison
---

# AutoOps and Stack Monitoring comparison

This page provides a detailed comparison of AutoOps and Stack Monitoring to help you decide which solution is better suited to your needs.

## Review the main differences
Review how these tools differ in their provisioning, set up procedure, method of access, and capabilities.

### Resource provisioning and billing

#### AutoOps [ao-resource]
AutoOps stores and backs up your monitoring data internally on {{ecloud}} infrastructure so you don’t need to think about provisioning, sizing, and availability. The data is retained for four days by default. Using AutoOps is free for {{ecloud}} customers and is offered to [all subscription tiers](https://www.elastic.co/subscriptions/cloud).

#### Stack Monitoring [sm-resource]
With Stack Monitoring, you are responsible for storing your monitoring data. This requires provisioning the necessary resources based on your performance and retention needs as well as paying for the allocated resources. The default retention period is six days.

### Setup

#### AutoOps [ao-setup]
On {{ech}} (ECH), AutoOps is set up and enabled automatically in all [supported regions](ec-autoops-regions.md), with no action required from you.

:::{note}
AutoOps is planned to be available in self-managed environments in the future.
:::

:::{image} /deploy-manage/images/cloud-autoops-setup.png
:alt: Diagram showing AutoOps setup in Elastic Cloud
:::

#### Stack Monitoring [sm-setup]
Stack Monitoring is a {{kib}} application that can be enabled on self-managed clusters on your premises, ECH deployments, {{eck}} (ECK), and {{ece}} (ECE). Stack Monitoring is not available on {{serverless-full}} since Elastic takes care of monitoring and managing your Serverless projects.

Depending on your deployment model, there is [some setting up](/deploy-manage/monitor/stack-monitoring.md#configure-and-use-stack-monitoring) involved to enable Stack Monitoring. You need to configure an agent, specify which logs and metrics you want to collect from all your {{stack}} components, and where to send them.

You can store your Stack Monitoring logs and metrics in the following ways:

* Within the monitored cluster itself:

:::{image} /deploy-manage/images/stack-monitoring-self-monitoring-cluster-setup.png
:alt: Diagram showing Stack Monitoring setup on a self-monitoring cluster in Elastic Cloud
:::

* Within a dedicated monitoring cluster, if you are concerned about resiliency and availability:

:::{image} /deploy-manage/images/stack-monitoring-dedicated-cluster-setup.png
:alt: Diagram showing Stack Monitoring setup on a dedicated monitoring cluster in Elastic Cloud
:::

### Availability

#### AutoOps [ao-availability]
AutoOps lives in {{ecloud}}, so you need to have an {{ecloud}} account to access it. Once logged in, you can [access](ec-autoops-how-to-access.md) AutoOps from your hosted deployments.

#### Stack Monitoring [sm-availability]
Once setup is complete, you can access the Stack Monitoring UI inside {{kib}}, where you can monitor all your {{stack}} components.

### Investigations and root cause analysis

#### AutoOps [ao-investigations]
The AutoOps agent captures a pre-defined set of {{es}} metrics, but doesn’t fetch any logs. AutoOps then performs multi-metrics analysis and correlations to identify issues and potential root causes. When issues are detected, AutoOps raises [events](ec-autoops-events.md) and [notifies](ec-autoops-notifications-settings.md) you accordingly. When the issue is resolved, AutoOps automatically closes the event.

For each raised event, AutoOps provides insights into the affected resources (cluster, node, index, shard, etc.), background information on the detected problem, and step-by-step guides to help you diagnose and remediate the identified issues. Most detection rules can be [customized](ec-autoops-event-settings.md) by adjusting thresholds, durations, index patterns, data tiers, and more.

#### Stack Monitoring [sm-investigations]
The Stack Monitoring UI displays the [metrics](/deploy-manage/monitor/monitoring-data/elasticsearch-metrics.md) of your monitored {{stack}} components over time. Logs can be viewed, searched, and filtered in Discover. You can enable a pre-defined set of alerts that are triggered when specific thresholds are crossed. You can also configure your own [alerts](/deploy-manage/monitor/monitoring-data/configure-stack-monitoring-alerts.md) on any collected metrics or log messages. However, Stack Monitoring does not offer any further investigation, correlations, or root cause analyses.

## Compare capabilities
The following tables provide a detailed comparison of AutoOps and Stack Monitoring features.

### AutoOps-only features
The following features are only available in AutoOps.

| Features | AutoOps | Stack Monitoring | Description |
|---|---|---|---|
| **Elasticsearch** | | | |
| Pre-built customizable alerts | ✅ | ❌ | AutoOps offers hundreds of multi-metric customizable alerts on {{es}} specific issues. Stack Monitoring supports some pre-built alerts, but you can build more if needed. |
| Multi metrics analysis | ✅ | ❌ | Advanced detection rules built on multiple metrics. |
| Performance tuning insights | ✅ | ❌ | Insights on tuning configurations and data structures for better {{es}} performance. |
| Root cause analysis | ✅ | ❌ | Identification of what went wrong including identifying the affected resources (clusters, nodes, indices, shards). |
| Resolution paths | ✅ | ❌ | Recommendations and suggestions to mitigate detected problems. |
| Knowledge base | ✅ | ❌ | Embedded knowledge base including links to articles and more information. |
| Multi-cluster dashboard | ✅ | ❌ | AutoOps dashboard is better equipped to handle a large number of clusters compared to the Clusters listing page in Stack Monitoring. |
| Events timeline | ✅ | ❌ | Comprehensive timeline of all raised events, organized by severity. |
| Data-tier specific insights | ✅ | ❌ | Visibility into data-tier resource utilization and performance insights per data tier. |
| Node-to-node comparison | ✅ | ❌ | Nodes listing and details combined into the same view for easier node-to-node resource and performance comparison. |
| Index-to-index comparison | ✅ | ❌ | Index listing and details combined into the same view for easier index-to-index resource and performance comparison. |
| Shards load heatmap | ✅ | ❌ | Node/index matrix showing shard activity on different selectable metrics. |
| Template optimizer | ✅ | ❌ | Template/mapping analysis. |
| Slow DSL query analysis | ✅ | ❌ | Identification of reasons for increased latency for DSL queries. |
| Advanced customizations | ✅ | ❌ | Customization and dismissal of detection rules on specific deployments. |
| Notification history | ✅ | ❌ | Comprehensive and curated notification history and reports. |

### Common features
The following features are common between AutoOps and Stack Monitoring, sometimes with slight variations.

| Features | AutoOps | Stack Monitoring | Description |
|---|---|---|---|
| **Elasticsearch** | | | |
| Clusters listing | ✅ | ✅ | Listing of all monitored clusters. |
| Cluster overview | ✅ | ✅ | Overview of each monitored cluster. |
| ES overview | ✅ | ✅ | Cluster-level performance metrics. |
| ES nodes list | ✅ | ✅ | Listing of all Elasticsearch nodes. |
| ES node details | ✅ | ✅ | Details on a specific node. |
| ES indices list | ✅ | ✅ | Listing of all {{es}} indices. AutoOps allows sorting indices by search and indexing latency metrics, but Stack Monitoring doesn’t, making it difficult to identify slow indices. |
| ES index details | ✅ | ✅ | Details on a specific index. |
| Single metric detection | ✅ | ✅ | Basic single-metric detection rules. |
| Simple alert customization | ✅ | ✅ | Basic customization of alerts. |
| Alerts and notifications | ✅ | ✅ | Stack Monitoring provides [27 configurable connectors](kibana://reference/connectors-kibana.md) for alerts and notifications. AutoOps supports [7 of them](/deploy-manage/monitor/autoops/ec-autoops-notifications-settings.md#ec-built-in-connectors) and the email connector doesn’t require setting up an email server. |

### Stack Monitoring-only features (coming soon to AutoOps)
The following features are currently only available in Stack Monitoring. These features will be available in AutoOps over time and any new features will primarily be added to AutoOps.

| Features | AutoOps | Stack Monitoring | Description |
|---|---|---|---|
| **Elasticsearch** | | | |
| Ingest pipeline | ❌ | ✅ | Stack Monitoring supports ingest pipeline monitoring via a link to ad hoc dashboards. These are provided by the {{agent}} {{es}} integration which needs to be installed. |
| CCR | ❌ | ✅ | Insights into CCR metrics. |
| Machine Learning jobs | ❌ | ✅ | Insights into ML job statistics. |
| Raw monitoring data | ❌ | ✅ | Availability of raw monitoring data. |
| **Other Stack components** | | | |
| Basic {{kib}} monitoring | ❌ | ✅ | More advanced {{kib}} monitoring is coming soon to AutoOps. |
| Basic Logstash monitoring | ❌ | ✅ | Logstash monitoring in the Stack Monitoring UI has been [superseded](logstash://reference/monitoring-logstash-with-elastic-agent.md) by the ad hoc dashboards shipped via the {{agent}} Logstash integration. |
| Basic APM server monitoring | ❌ | ✅ | Standard monitoring of APM servers |
| Basic integration server monitoring | ❌ | ✅ | Standard monitoring of integration servers |

## Choose between AutoOps and Stack Monitoring

Keep using Stack Monitoring if you:

* are running the {{stack}} on-premise, air-gapped or otherwise
* need to control monitoring data retention
* need monitoring coverage for {{stack}} components other than {{es}}
* have deployments in a region where AutoOps is not available yet

Start using AutoOps if you want:

* easier monitoring of your {{ecloud}} deployments
* clear guidance and troubleshooting advice when issues arise
* to efficiently monitor a large number of deployments
* a comprehensive picture of the historical health of your deployments
* your events and alerts to be highly customizable
* an advanced notification system tailored for specific clusters and alert conditions
* simplified interactions with Elastic Support


24 changes: 12 additions & 12 deletions deploy-manage/monitor/autoops/ec-autoops-faq.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,35 +10,35 @@ products:

# AutoOps FAQ [ec-autoops-faq]

This frequently-asked-questions list answers some of your more common questions about AutoOps.
Here are answers to some common questions about AutoOps.

$$$faq-what-is-autoops$$$What is AutoOps? What does it do?
$$$faq-what-is-autoops$$$What does AutoOps do?
: AutoOps for {{es}} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {{es}} metrics, your configuration, and usage patterns, AutoOps recommends operational and monitoring insights that deliver savings in administration time and hardware costs.

$$$faq-autoops-availability$$$When will AutoOps be available for Self-hosted and Serverless users?
: AutoOps will be available for Self-hosted and Serverless customers with a different set of capabilities in the future.
$$$faq-autoops-availability$$$Will AutoOps be available for {{serverless-full}} and self-hosted users?
: AutoOps will be available for {{serverless-full}} and self-hosted customers with a different set of capabilities in the future.

$$$faq-autoops-monitoring$$$Does AutoOps monitor the entire {{stack}}?
: AutoOps is currently limited to {{es}} (not {{kib}}, Logstash and Beats).
: AutoOps is currently limited to {{es}} (not {{kib}}, Logstash, and Beats).

$$$faq-autoops-supported-versions$$$What versions of {{es}} are supported for {{ech}}?
: AutoOps supports {{es}} versions according to the [supported {{stack}} versions](https://www.elastic.co/support/eol).

$$$faq-autoops-license$$$How is AutoOps currently licensed?
: AutoOps current feature set is available to {{ech}} customers at all subscription tiers. For more information refer to the [subscription page](https://www.elastic.co/subscriptions/cloud).
: AutoOps' current feature set is available to {{ech}} customers at all subscription tiers. For more information, refer to the [subscription page](https://www.elastic.co/subscriptions/cloud).

$$$faq-autoops-installation$$$How does AutoOps get installed and why may I not see AutoOps available on specific deployments?
: AutoOps is automatically applied to {{es}} clusters on {{ecloud}}, rolling out in phases across CSPs and regions. Read more about AutoOps [roll out](ec-autoops-regions.md) status.
: AutoOps is automatically applied to {{es}} clusters on {{ecloud}}, rolling out in phases across CSPs and regions. Read more about AutoOps [regions](ec-autoops-regions.md).

$$$faq-autoops-issue-resolution$$$Can AutoOps currently automatically resolve issues?
: AutoOps only analyzes metrics, and is a read-only solution.
: AutoOps only analyzes metrics, and is a read-only solution.

$$$faq-autoops-data-retention$$$How long does Elastic retain AutoOps data?
: Currently, AutoOps has a four-day retention period for all Hosted customers.
: Currently, AutoOps has a four-day retention period for all {{ech}} customers.

$$$faq-autoops-metrics-storage$$$Where are AutoOps metrics stored, and does AutoOps affect customer ECU usage?
: AutoOps metrics are stored internally within the Elastic infrastructure, not on customer deployments. Therefore, using AutoOps does not consume customer ECU).
: AutoOps metrics are stored internally within the Elastic infrastructure, not on customer deployments. So using AutoOps does not consume customer ECU.

$$$faq-autoops-vs-stack-monitoring$$$Does AutoOps replace Stack Monitoring now?
: As of now, AutoOps provides insights on {{es}} (not {{kib}}, Logstash and Beats) and analyzes metrics, but not logs. Stack Monitoring covers the entire stack and with it you can analyze logs.
$$$faq-autoops-vs-stack-monitoring$$$Has AutoOps replaced Stack Monitoring?
: Currently, AutoOps has many of the same features as Stack Monitoring as well as several new ones. However, it only provides insights on {{es}} and analyzes metrics, but not logs. Read more in [AutoOps and Stack Monitoring comparison](/deploy-manage/monitor/autoops/autoops-stack-monitoring-comparison.md).

1 change: 1 addition & 0 deletions deploy-manage/toc.yml
Original file line number Diff line number Diff line change
Expand Up @@ -662,6 +662,7 @@ toc:
- file: monitor/autoops/ec-autoops-dismiss-event.md
- file: monitor/autoops/ec-autoops-regions.md
- file: monitor/autoops/ec-autoops-faq.md
- file: monitor/autoops/autoops-stack-monitoring-comparison.md
- file: monitor/stack-monitoring.md
children:
- file: monitor/stack-monitoring/ece-ech-stack-monitoring.md
Expand Down
Loading