Skip to content

Commit

Permalink
data storage
Browse files Browse the repository at this point in the history
  • Loading branch information
wojcik-dorota committed Sep 30, 2024
1 parent 90a38b9 commit 8bde5ec
Show file tree
Hide file tree
Showing 3 changed files with 39 additions and 18 deletions.
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: Create an AWS-integrated custom cloud
sidebar_label: AWS
sidebar_label: Amazon Web Services
keywords: [AWS, Amazon Web Services, byoc, bring your own cloud, custom cloud]
---

Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
title: Create a Google-integrated custom cloud
sidebar_label: Google Cloud
keywords: [Google Cloud, byoc, bring your own cloud, custom cloud]
keywords: [Google Cloud, GCP, Google Cloud Platform, byoc, bring your own cloud, custom cloud]
---

import ConsoleLabel from "@site/src/components/ConsoleIcons";
Expand Down
53 changes: 37 additions & 16 deletions docs/platform/howto/byoc/store-data.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,34 +6,51 @@ keywords: [bring your own cloud, byoc, custom cloud, BYOC cloud, object storage,

import ConsoleLabel from "@site/src/components/ConsoleIcons";

Store data in your custom cloud using tiered storage, a data allocation mechanism for improved efficiency and cost optimization.
Bring your own cloud (BYOC) allows you to use object storage in your own remote cloud account to store [cold data](/docs/platform/howto/byoc/store-data#tiered-storage) and [backups](/docs/platform/howto/byoc/store-data#user-owned-backups).

To use tiered storage in bring your own cloud (BYOC) environments, both custom clouds and
services operating within those clouds need to have tiered storage activated.
## Tiered storage

Each custom cloud you create has tiered storage enabled by default. For existing custom
clouds created in the past with no tiered storage support, you can
[activate tiered storage](/docs/platform/howto/byoc/store-data#activate-tiered-storage-on-a-custom-cloud)
in the [Aiven Console](https://console.aiven.io/).
You can store data hosted in your custom cloud using tiered storage, a data allocation
mechanism for improved efficiency and cost optimization. When enabled, tiered storage
allows moving data automatically between hot storage (for frequently accessed, critical,
and often updated data) and cold storage (for rarely accessed, static, or archived data).

## Prerequisites
Cold storage for BYOC-hosted services uses object storage in your own remote cloud account.
For purposes of the cold storage:

- In AWS BYOC, one S3 bucket is created per custom cloud.
- In Google Cloud BYOC, one S3 bucket is created per BYOC-hosted service.

To use tiered storage in a BYOC-hosted service, tiered storage needs to be enabled both
[in your custom cloud](/docs/platform/howto/byoc/store-data#enable-in-a-custom-cloud) and
[in the BYOC-hosted service](/docs/platform/howto/byoc/store-data#enable-on-a-service).

### Enable in a custom cloud

- Each custom cloud you create has tiered storage enabled by default.
- For existing custom clouds created in the past with no tiered storage support,
[contact the Aiven support team](mailto:support@aiven.io) to request enabling tiered storage.

### Enable on a service

#### Prerequisites

- At least one [custom cloud](/docs/platform/howto/byoc/create-custom-cloud)
- At least one [Aiven-manged service](/docs/platform/howto/create_new_service) hosted in
the custom cloud
- At least one [Aiven-manged service](/docs/platform/howto/create_new_service), either
Aiven for Apache Kafka® or Aiven for ClickHouse®, hosted in the custom cloud

## Limitation
#### Limitations

- BYOC supports
[tiered storage for Aiven for Apache Kafka®](/docs/products/kafka/howto/kafka-tiered-storage-get-started)
only.
- BYOC supports tiered storage for the following service types:
- [Aiven for Apache Kafka](/docs/products/kafka/howto/kafka-tiered-storage-get-started)
- [Aiven for ClickHouse](/docs/products/clickhouse/concepts/clickhouse-tiered-storage)
- You cannot deactivate tiered storage on your custom cloud once it's activated.

## Activate tiered storage on a service
#### Activate tiered storage on a service

[Enable tiered storage for Aiven for Apache Kafka®](/docs/products/kafka/howto/enable-kafka-tiered-storage).

## Activate tiered storage on a custom cloud
#### Activate tiered storage on a custom cloud

1. Log in to the [Aiven Console](https://console.aiven.io/), and go to your organization.
1. Click **Admin** in the top navigation, and click <ConsoleLabel name="bringyourowncloud"/>
Expand All @@ -49,6 +66,10 @@ only.
1. Copy or download the template and re-deploy it in your remote cloud account using the
variables provided in the variables file.

## User-owned backups

Data backups for services hosted in custom clouds are stored in your remote cloud account.

## Related pages

- [About bring your own cloud](/docs/platform/concepts/byoc)
Expand Down

0 comments on commit 8bde5ec

Please sign in to comment.