Cannot specify the number of shards or replicas when using OpenSearch vector store

[github-anis-snoussi]

Issue

• Currently it's not possible to specify the number of shards/replicas when working with OpenSerach vector store.
• This is problematic when using Langchain with OpenSearch in a multi-tenant setting, where we want to have data segregation but still use the same OpenSearch cluster => one tenant per index.
• This setting hits rapidly the max_shards_per_node limit of OpenSearch cluster.
• PS: it is possible to modify the max_shards_per_node for an OpenSearch cluster, but having the flexibility when using Langchain is also necessary (+ in our case number of documents per tenant is quite low, so one shard is more than enough).

Pull request made for this :

• Already made a simple PR to allow for this modification :
  community[patch]: allow to modify OpenSerach number of shards/replicas #4372

[dosubot]

🤖

That's great to hear that you've already made a pull request for this issue! Your contribution to the repository is much appreciated. Keep up the good work and thank you for your efforts in improving the project.

About Dosu

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.

[jacoblee93]

PR merged, will be live in the next community release!