|
1 | 1 | # Self-Evolving AI/ML Workflow
|
2 | 2 |
|
3 |
| -**TODO** |
4 |
| - |
5 |
| -If running on a different VM, IPs are currently hardcoded in example flyte workflow and need to be changed: `flyte-projects/mnist/workflows/*` |
6 | 3 |
|
7 | 4 | ### Minimal requirements:
|
8 | 5 | 12 CPUs
|
9 | 6 | 32GB RAM
|
10 | 7 |
|
11 |
| -### To recreate our system: |
12 |
| -- Use at least one node with Ubuntu installed (Tested with 22.04.1-Ubuntu). |
13 |
| -- Clone the repo. |
14 |
| -- Run install script `./scripts/system-install.sh` which installs microk8s and argocd and automatically deploys all our apps on the cluster. |
| 8 | +### Deployment: |
| 9 | +- Run install script `./scripts/system-install.sh` which installs microk8s and addons. |
15 | 10 | - (Optional) Run install script `scripts/rasp-install.sh` on any raspberry pi node you want to join to the cluster.
|
16 |
| -- Run config script `./scripts/env-prepare.sh` on VM to install requirements and connect flytectl to the cluster for running pipelines. This can be run from a different machine (Not tested). |
17 |
| - |
18 |
| -> Scripts should be run from root of repository. |
19 |
| -> For scripts to work entire conf/ folder needs to be included |
20 |
| -> If any of the scripts fail, they should be run line by line to debug the problem. |
21 | 11 |
|
22 |
| -- Adjust ray resources and replicas in `conf/kube_conf/ray/ray-serve.yaml` if needed and apply it to the cluster using kubectl. |
23 |
| -- Adjust IPs in Flyte workflow files. |
| 12 | +- Deploy with helm, adjust configs in `values_example.yaml`: |
24 | 13 |
|
25 |
| -### In short: |
26 | 14 | ```bash
|
27 |
| -git clone https://github.com/copandrej/IJS-AI_orchestration.git && cd IJS-AI_orchestration/ |
28 |
| -./scripts/system-install.sh |
29 |
| -./scripts/env-prepare.sh |
| 15 | +helm add repo semr_charts https://copandrej.github.io/SEMR_charts/ |
| 16 | +helm install semr semr_charts/SEMR --values values_example.yaml |
30 | 17 | ```
|
| 18 | +- Run config script `./scripts/env-prepare.sh` on VM to install requirements and connect flytectl to the cluster for running AI/ML workflows. |
| 19 | + |
| 20 | + |
| 21 | +### Usage: |
| 22 | + |
| 23 | + |
| 24 | + |
31 | 25 |
|
32 | 26 | ## Project
|
33 | 27 |
|
|
0 commit comments