[Obs AI Assistant] Add documentation for "user instructions" feature

[sorenlouv]

User instructions were added in 8.16 (elastic/kibana#187607). They allow end users to append instruction to the system prompt. This way they can get the LLM to consistently behave in a specific way.

One user instruction can be created per user. It can be modified by going to Knowledge Base -> "Edit user-specific prompt".

[sorenlouv]

@mdbirnstiehl Is this something you can help with?

[mdbirnstiehl]

@mdbirnstiehl Is this something you can help with?

Hi @sorenlouv, sorry for the delayed response. We are in the middle of a docs migration which is taking up a lot of our time, so we can help, but it might take a little time. I'll mention @bmorelli25 here just so it's on our radar and we can prioritize it if need be.

[colleenmcginnis]

👋 @sorenlouv I have capacity to work on this now. I'm clicking through the chain of linked PRs/issues, but I still don't have a good sense of why someone would use this feature.

This way they can get the LLM to consistently behave in a specific way.

Is there a concrete example of this that you can share so I can understand the full context before documenting the feature?

[viduni94]

Hi @colleenmcginnis
Commenting on behalf of @sorenlouv as he is out this week..

This way they can get the LLM to consistently behave in a specific way

What's meant by this is you can ask the LLM to apply a certain instruction across all user prompts.
For example: If I add a user instruction saying "Always reply in French", the LLM will take this into account and always respond in French for all questions asked by that user.

Here is another example:
Here I'm asking the user to always preprend field names with parsed. before returning an answer.

adding-a-user-instruction.mov

These examples might not be well refined to document. But I hope you get the idea. Let me know if you have any more questions.

[mdbirnstiehl]

@sorenlouv @viduni94 When we say this feature is space-aware, do we mean that user-specific prompt will apply to any users in the space, or will it apply only to the specific user that sets it?

[viduni94]

@sorenlouv @viduni94 When we say this feature is space-aware, do we mean that user-specific prompt will apply to any users in the space, or will it apply only to the specific user that sets it?

It will only apply to the specific user that sets it.

do we mean that user-specific prompt will apply to any users in the space

This is an upcoming feature (to apply the instruction to all users in the space), but that's not available yet.