[META] Client Side Encryption in OpenSearch

[vikasvb90]

We have discussed about feature proposal of enhancement of repository plugin in #6353 and design proposal for the same in #6633. Based on this we have come up with the following tasks :

1. Define a new plugin interface for crypto plugin and management of crypto clients and their metadata.
2. Changes in remote store to provide encryption or decryption of content.
3. Common extensible plugin implementation to provide support for crypto abstractions.

This issue is a meta-issue for tracking the progress of client side encryption.

• Crypto plugin abstractions, encrypted repositories and metadata mgmt #7284
• crypto plugin integration changes #7337
• Initial commit of crypto plugin #8465
• Core crypto library to perform encryption and decryption of source content #8466
• Add encryption support for repository  #9289
• Removing ESDK changes from core #9833
• Crypto esdk 1.7 #9823 (Will be merged after approval from ESDK team on custom changes)
• Moved encryption-sdk from lib to modules to resolve dependency issues #9812 (Deprecated)

API Changes in OpenSearch

PUT _snapshot/vikasvb-repository-test-1
{
  "type": "s3",
  "settings": {
    "bucket": "vikasvb-repository-test",
    "region": "us-west-2"
  },    
  "encrypted": true,
  "crypto_settings": {
      "key_provider_name": "first-mock-1",
      "key_provider_type": "sample-key-provider-extension",
      "settings": {
          "key-1": "sample value"
      }
  }
}

[anasalkouz]

@vikasvb90 is this tracking green for 2.9?

[vikasvb90]

@anasalkouz It was earlier but reviews couldn't start on this so it is not being planned for 2.9 anymore.

[anasalkouz]

Moving this to 2.10

[hdhalter]

Is this going out in 2.10? If so, can someone please review the PR for technical accuracy? Thanks. opensearch-project/documentation-website#4389 @vikasvb90 , @anasalkouz

[vikasvb90]

Is this going out in 2.10? If so, can someone please review the PR for technical accuracy? Thanks. opensearch-project/documentation-website#4389 @vikasvb90 , @anasalkouz

@hdhalter Yes, this is going in 2.10. I will take a look. Thanks!