[FEATURE] Object Storage FrozenTier / UltraWarm equivalent

[michaelandrepearce]

Is your feature request related to a problem? Please describe.
In Elastic 7.12 it is possible to directly search object storage such as AWS S3, Microsoft Azure Storage, and Google Cloud.
Like wise in AWS's as a Service offering a similar feature named UltraWarm exists, this allows decoupling from compute and storage, and enables to reduce costs significantly.

Describe the solution you'd like
Ability to directly search object storage, so that we can tier down data and keep it searchable to reduce operational cost.
An initial MVP could be a single object storage api such as S3.
In longer term should really support at least the big main cloud vendors object storage api's.

Describe alternatives you've considered
Switch back to Elastic :( :( :(

Additional context
ref:

• https://www.elastic.co/blog/introducing-elasticsearch-frozen-tier-searchbox-on-s3
• https://docs.aws.amazon.com/elasticsearch-service/latest/developerguide/ultrawarm.html

[frotsch]

https://discuss.opendistrocommunity.dev/t/any-plans-to-backport-ultrawarm-for-amazon-elasticsearch-service/2075/4

[tlfeng]

Related issue #740 #1052

[juanpi-meli]

Hi team! Any update regarding this thread?

[tlfeng]

Include @andrross (the author of issue #1599) for visibility.

[pmarjou22]

Has anyone tried a setup including s3fs-fuse for this ?

[oded-dd]

Is there a plan to make UltraWarm part of the community, or should we abandon the project.

What is in opensearch without S3 support?

[dblock]

Is there a plan to make UltraWarm part of the community, or should we abandon the project.

What is in opensearch without S3 support?

There's an open issue to track this ask, #740 and this comment from @nirajjetly is still the best I have to offer.

[andrross]

Closing this issue as this work is being tracked in the storage roadmap (#3739). Please feel free to comment there or reopen if there are additional questions.