Creates a page summarizing all Elastic's AI-powered features

[benironside]

Fixes elastic/docs-content-internal/issues/455 by creating a new page that lists all our AI-powered features.

This PR also:

• Creates an AI-powered features section in the explore-analyze book (new home for the new doc and IMO improved IA for the AI pages in the book).
• Makes some related small edits to the pages describing those features in detail.

Also, reviewers, this is a minor point but what do you think of adding "AI" to our glossary and linking to this PR's new page?

[github-actions]

🔍 Preview links for changed docs

• explore-analyze/ai-features.md
• deploy-manage/reference-architectures/hotfrozen-high-availability.md
• solutions/observability/observability-ai-assistant.md
• solutions/security/ai/ai-assistant.md
• solutions/security/ai/attack-discovery.md
• solutions/security/manage-elastic-defend/automatic-troubleshooting.md
• explore-analyze/ai-features/ai-assistant.md
• explore-analyze/ai-features/manage-access-to-ai-assistant.md

[florent-leborgne]

This is a super nice start. I'd like this page (or set of pages) to do the following:

• List the AI features themselves (AI Assistants, Agent Builder) and clarify the link between these and AI connectors (and with EIS for the Elastic Managed LLM)
• List other features that rely on these AI features, and specify if this is optional, by default, etc -> This is important for users to make conscious choices about their config and about permissions of their own users, especially as they'll likely want to control pricing/token usage under control.
• Links to pricing pages for our default Elastic Managed LLM (at least) or to a page that focuses on AI features-related pricing impact

So that this inventory also becomes a source of understanding of how all of these relate to each other. We can chat about this at our sync :)

[mdbirnstiehl]

One comment, but otherwise looks great!

[leemthompo]

On the ES/platform side, might be good to mention:

• the Search AI Lake
• ES' vector database functionalities, which enables AI-powered search, and powers all of these features in one way or another at the platform level

This would align with the PMM page: https://www.elastic.co/generative-ai

Also we definitely need to mention:

• the Elastic Inference Service
• ML nodes, i.e.Trained models deployed in your cluster
• The inference API: integrate with Elastic's built-in models or a range of third-party services
• Elastic's built-in NLP models, particularly the proprietary ELSER model
• the Elastic managed LLM (runs on GPUs on EIS)

@szabosteve will probably have additions :)

[szabosteve]

I left two small nits and a suggestion to drop some technical details that I think are too low-level for this overview. I really like the clarity and the structure of this page! It's great to see these features listed in one place. Everything that is on the page right now is LGTM. I think it would still be nice to add some more pieces to the page. Basically, all that Liam mentioned above. Some suggestions regarding the structure for the new content:

• I would suggest adding two or three new sections:
  • Elastic inference or something similar (before AI-powered search), which could link to this page with a description like this: "Inference is a process of using a machine learning trained model to make predictions or operations - such as text embedding, or reranking - on your data." This subsection could mention EIS and the Inference API as the two main ways to use Elastic Inference.
  • NLP models: this section could contain the built-in NLP models with ELSER highlighted, and the trained models deployed in your cluster.
  • I think Elastic Managed LLM could have its own section. If you think it's too much, I would add it to the Elastic Inference section.

@leemthompo WDYT?

[leemthompo]

I pushed a commit to clarify ES solution versus platform and some minor edits: ad81ecb

The diff isn't great because GitHub is trying to be too smart 😄

[florent-leborgne]

Thanks everyone that's a good first version for this page - let's move on to other tasks