[Clusters][Azure] Custom ARM template for Azure Clusters

[mmmaillot]

Description

Following the guidance in this comment from an old closed issue, I successfully deployed a Ray cluster on Azure. However, the process feels quite hacky and is challenging to reproduce and share with my team. Specifically, I had to:

1. pip install ray
2. Locate the template files stored locally
3. Modify the templates in place

While this approach works on my machine, it is difficult to replicate and share these modifications with others.

Instead of using the CLI in this manner and manually hacking the template in the source code:

ray up example-full.yaml

It would be great if we could do something like this:

ray up example-full.yaml -t arm-template.json

This would allow us to replace the template at the command launch time, making the process more streamlined and reproducible.

If you think this feature is worthwhile, I'm willing to dedicate some time to it and potentially even make a pull request.

Use case

As a developer deploying Ray clusters on Azure, I need a more streamlined and reproducible way to manage and share deployment templates.

[jjyao]

Hi @mmmaillot could you tell me what -t will do exactly?

[mmmaillot]

I was thinking -t as in template (but --template would have been more precise) would allow the user to specify its own ARM template json file, instead of relying on the default one located here : https://github.com/ray-project/ray/blob/master/python/ray/autoscaler/_private/_azure/azure-config-template.json