Azure Blob Storage SDK + Azurite for local blob storage emulation

[jankrepl]

Description

AFAIK our current backend is cloud agnostic except for S3 (MinIO) and the boto3 code we wrote.

Azure has an official storage local emulator here: https://hub.docker.com/r/microsoft/azure-storage-azurite . The Python SDK is described here: https://learn.microsoft.com/en-us/azure/storage/blobs/storage-quickstart-blobs-python

Now, since it is very likely we will need to support both Azure and AWS for some time I think we will have to resort to maintaining both.

TODO

• 1. Write all the necessary Python logic using the blob-storage SDK that we have for boto3 (e.g. save_to_storage, delete_from_storage) + make sure one can nicely swap between the two
• 2. Introduce an env variable (or some autoinference logic) that will allow us to swap between the two clouds/local emulators
• 3. Introduce docker compose profiles (https://docs.docker.com/compose/how-tos/profiles/) so that we can easily spin up either MinIO or Azurite