Skip to content

Conversation

@vinaykpud
Copy link
Contributor

Description

Adding documentation for Reader Writer separation changes.

META: opensearch-project/OpenSearch#15306
Design: opensearch-project/OpenSearch#15237
RFC: opensearch-project/OpenSearch#7258

Issues Resolved

Closes #9670

Version

List the OpenSearch version to which this PR applies, e.g. 2.14, 2.12--2.14, or all.

3.0

Frontend features

If you're submitting documentation for an OpenSearch Dashboards feature, add a video that shows how a user will interact with the UI step by step. A voiceover is optional.
NA

Checklist

  • By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
@github-actions
Copy link

Thank you for submitting your PR. The PR states are In progress (or Draft) -> Tech review -> Doc review -> Editorial review -> Merged.

Before you submit your PR for doc review, make sure the content is technically accurate. If you need help finding a tech reviewer, tag a maintainer.

When you're ready for doc review, tag the assignee of this PR. The doc reviewer may push edits to the PR directly or leave comments and editorial suggestions for you to address (let us know in a comment if you have a preference). The doc reviewer will arrange for an editorial review.

By using `_scale` API user can choose to turn off primary shards and write-replicas in case they don’t expect any writing to that index.
In write-once, read-many scenarios (like log analytics), you can scale down primary and write replicas, leaving only search replicas active. This will free up the resources.

Turn Off Writers:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @vinaykpud I already have this scale API added to the API section #9762.

For Turn Off Writers: section should we just talk about the process of scale to zero and point this doc to scale API?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, we can add a 2 line description and link to API doc from here.

@Naarcha-AWS Naarcha-AWS added Tech review PR: Tech review in progress v3.0.0 release-notes PR: Include this PR in the automated release notes labels Apr 30, 2025
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
@Naarcha-AWS
Copy link
Contributor

@vinaykpud and @prudhvigodithi: Let me know if my changes work for you.

…rkloads.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
@Naarcha-AWS
Copy link
Contributor

@vinaykpud or @prudhvigodithi: Are the any additional adjustments we should make to this one?

@Naarcha-AWS Naarcha-AWS added Doc review PR: Doc review in progress and removed Tech review PR: Tech review in progress labels May 2, 2025

You can use the `_scale` API to turn off primary shards and write replicas if you don't expect any writes to an index. In write-once, read-many scenarios (like log analytics), you can scale down primary and write replicas, leaving only search replicas active to free up resources.

The following request turns off writers:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As @prudhvigodithi mentioned earlier do we need API example here or should we just give link to the API doc for _scale?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can add the link once the scale PR gets merged in.

@Naarcha-AWS Naarcha-AWS added Editorial review PR: Editorial review in progress and removed Doc review PR: Doc review in progress labels May 2, 2025
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
@Naarcha-AWS
Copy link
Contributor

@natebower: This is ready for editorial review.

Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Naarcha-AWS @vinaykpud Please see my comment and changes and let me know if you have any questions. Thanks!

```
{% include copy-curl.html %}

- `true` (default): Route only to search replicas.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These bullet points appear to be floating (not connected to anything). Should they be introduced by a brief sentence ending in a colon?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll add that.

Naarcha-AWS and others added 2 commits May 5, 2025 09:04
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
@Naarcha-AWS Naarcha-AWS merged commit 236aadb into opensearch-project:main May 5, 2025
5 checks passed
KishoreKicha14 pushed a commit to KishoreKicha14/documentation-website that referenced this pull request Jun 13, 2025
* Adding reader writer separation doc page

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Add technical writer edits

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update segregating-indexing-search.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Rename segregating-indexing-search.md to seperate-index-and-search-workloads.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update _tuning-your-cluster/seperate-index-and-search-workloads.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update seperate-index-and-search-workloads.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update seperate-index-and-search-workloads.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
epugh pushed a commit to o19s/documentation-website that referenced this pull request Jul 2, 2025
* Adding reader writer separation doc page

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Add technical writer edits

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update segregating-indexing-search.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Rename segregating-indexing-search.md to seperate-index-and-search-workloads.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update _tuning-your-cluster/seperate-index-and-search-workloads.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update seperate-index-and-search-workloads.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update seperate-index-and-search-workloads.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Editorial review PR: Editorial review in progress release-notes PR: Include this PR in the automated release notes v3.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DOC] Add documentation about Reader Writer Separation

5 participants