Skip to content
This repository was archived by the owner on Mar 31, 2023. It is now read-only.

[K8s Deployment] Improve deployment configuration and scripts #693

Merged
xieus merged 19 commits into from
Oct 22, 2021
Merged

[K8s Deployment] Improve deployment configuration and scripts #693

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
d309157
update ignite deployment process
yanmo96 Oct 16, 2021
7523eaa
Create ym_try
yanmo96 Oct 16, 2021
29ec7c3
Add files via upload
yanmo96 Oct 16, 2021
f5902ae
Delete ym_try
yanmo96 Oct 16, 2021
fe8d57b
update ignite xml config urls
yanmo96 Oct 16, 2021
be68ad0
update file locations
yanmo96 Oct 18, 2021
6fd93fa
Create ignite
yanmo96 Oct 18, 2021
b137cf7
Delete ignite
yanmo96 Oct 18, 2021
d8c3914
Create try
yanmo96 Oct 18, 2021
d7a4ea0
Add files via upload
yanmo96 Oct 18, 2021
99fa420
Delete try
yanmo96 Oct 18, 2021
14b33b1
Update the k8s deployment script
yanmo96 Oct 19, 2021
d6ade64
Merge branch 'new_ignite_deployment' of https://github.com/yanmo96/al…
yanmo96 Oct 19, 2021
c5604e2
Update ignite_alcor.yaml
yanmo96 Oct 19, 2021
b26d6fc
Update ignite_alcor_ip.yaml
yanmo96 Oct 19, 2021
8e0d822
Update ignite_alcor_mac.yaml
yanmo96 Oct 19, 2021
fd3e990
Update ignite_alcor_port.yaml
yanmo96 Oct 19, 2021
81a908d
delete namesapce while deleting db
yanmo96 Oct 20, 2021
0b2a2d0
Merge branch 'new_ignite_deployment' of https://github.com/yanmo96/al…
yanmo96 Oct 20, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 0 additions & 23 deletions kubernetes/app/controller-deployment.yaml
View file
Open in desktop

This file was deleted.

16 changes: 0 additions & 16 deletions kubernetes/app/controller-service.yaml
View file
Open in desktop

This file was deleted.

13 changes: 10 additions & 3 deletions kubernetes/services/createYaml.sh → kubernetes/createYaml.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,12 +18,12 @@
# Install prerequisites
if [[ "$OSTYPE" == "linux-gnu" ]]; then

echo "Create yaml files"
echo "Create ignite yaml files"

for d in *;
for d in db/ignite/*.yaml;
do
kubectl create -f $d
echo "Create yaml - $d completed"
echo "Create ignite yaml - $d completed"
done

echo "Create yaml files done"
Expand All @@ -45,6 +45,13 @@ if [[ "$OSTYPE" == "linux-gnu" ]]; then
kubectl exec -it ignite-alcor-port-0 -n ignite-alcor-port -c ignite-alcor-port-node -- /opt/ignite/apache-ignite/bin/control.sh --activate
#cd apache-ignite/bin/
#./control.sh --activate


for d in services/*.yaml;
do
kubectl create -f $d
echo "Create ignite yaml - $d completed"
done

echo "ignite cluster has been activated"

Expand Down
12 changes: 0 additions & 12 deletions kubernetes/db/ignite/ignite-cluster-role-binding.yaml
View file
Open in desktop

This file was deleted.

15 changes: 0 additions & 15 deletions kubernetes/db/ignite/ignite-cluster-role.yaml
View file
Open in desktop

This file was deleted.

38 changes: 0 additions & 38 deletions kubernetes/db/ignite/ignite-deployment.yaml
View file
Open in desktop

This file was deleted.

4 changes: 0 additions & 4 deletions kubernetes/db/ignite/ignite-namespace.yaml
View file
Open in desktop

This file was deleted.

5 changes: 0 additions & 5 deletions kubernetes/db/ignite/ignite-service-account.yaml
View file
Open in desktop

This file was deleted.

13 changes: 0 additions & 13 deletions kubernetes/db/ignite/ignite-service.yaml
View file
Open in desktop

This file was deleted.

0 kubernetes/services/ignite_alcor.yaml → kubernetes/db/ignite/ignite_alcor.yaml
View file
Open in desktop
File renamed without changes.
0 kubernetes/services/ignite_alcor_ip.yaml → kubernetes/db/ignite/ignite_alcor_ip.yaml
View file
Open in desktop
File renamed without changes.
0 kubernetes/services/ignite_alcor_mac.yaml → kubernetes/db/ignite/ignite_alcor_mac.yaml
View file
Open in desktop
File renamed without changes.
0 kubernetes/services/ignite_alcor_port.yaml → kubernetes/db/ignite/ignite_alcor_port.yaml
View file
Open in desktop
File renamed without changes.
0 kubernetes/services/ignite_config.xml → kubernetes/db/ignite/ignite_config.xml
View file
Open in desktop
File renamed without changes.
0 kubernetes/services/ignite_ip_config.xml → kubernetes/db/ignite/ignite_ip_config.xml
View file
Open in desktop
File renamed without changes.
0 kubernetes/services/ignite_mac_config.xml → kubernetes/db/ignite/ignite_mac_config.xml
View file
Open in desktop
File renamed without changes.
0 kubernetes/services/ignite_port_config.xml → kubernetes/db/ignite/ignite_port_config.xml
View file
Open in desktop
File renamed without changes.
29 changes: 0 additions & 29 deletions kubernetes/db/redis/redis-deployment.yaml
View file
Open in desktop

This file was deleted.

16 changes: 0 additions & 16 deletions kubernetes/db/redis/redis-service.yaml
View file
Open in desktop

This file was deleted.

8 changes: 4 additions & 4 deletions kubernetes/services/deleteYaml.sh → kubernetes/deleteYaml.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,31 +22,31 @@ if [[ "$OSTYPE" == "linux-gnu" ]]; then

kubectl delete clusterrolebinding ignite-alcor
kubectl delete clusterrole ignite-alcor
#kubectl delete namespaces ignite-alcor
kubectl delete serviceaccounts ignite-alcor -n ignite-alcor
kubectl delete services ignite-alcor-service -n ignite-alcor
kubectl delete StatefulSet ignite-alcor -n ignite-alcor
kubectl delete namespaces ignite-alcor

kubectl delete clusterrolebinding ignite-alcor-ip
kubectl delete clusterrole ignite-alcor-ip
#kubectl delete namespaces ignite-alcor-ip
kubectl delete serviceaccounts ignite-alcor-ip -n ignite-alcor-ip
kubectl delete services ignite-alcor-ip-service -n ignite-alcor-ip
kubectl delete StatefulSet ignite-alcor-ip -n ignite-alcor-ip
kubectl delete namespaces ignite-alcor-ip

kubectl delete clusterrolebinding ignite-alcor-port
kubectl delete clusterrole ignite-alcor-port
#kubectl delete namespaces ignite-alcor-port
kubectl delete serviceaccounts ignite-alcor-port -n ignite-alcor-port
kubectl delete services ignite-alcor-port-service -n ignite-alcor-port
kubectl delete StatefulSet ignite-alcor-port -n ignite-alcor-port
kubectl delete namespaces ignite-alcor-port

kubectl delete clusterrolebinding ignite-alcor-mac
kubectl delete clusterrole ignite-alcor-mac
#kubectl delete namespaces ignite-alcor-mac
kubectl delete serviceaccounts ignite-alcor-mac -n ignite-alcor-mac
kubectl delete services ignite-alcor-mac-service -n ignite-alcor-mac
kubectl delete StatefulSet ignite-alcor-mac -n ignite-alcor-mac
kubectl delete namespaces ignite-alcor-mac

kubectl delete configmap sg-configmap
kubectl delete services sgmanager-service
Expand Down
36 changes: 28 additions & 8 deletions scripts/deployK8sClusterService.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,13 +14,33 @@

#!/bin/bash

#Clean up
kubectl delete svc alcor
kubectl delete deployment alcor
if [ ! -d ~/alcor_logs ]; then
mkdir -p ~/alcor_logs
fi

kubectl apply -f kubernetes/app/controller-deployment.yaml
kubectl get deployments -o wide
export KUBECONFIG=/etc/kubernetes/admin.conf

kubectl expose deployment alcor --type=LoadBalancer --name=alcor
kubectl get svc -o wide
kubectl get po -A
echo "***** Delete Alcor Microservices *****" 2>&1 | tee ~/alcor_logs/alcor.log
chmod +x /root/alcor/kubernetes/deleteYaml.sh
/root/alcor/kubernetes/deleteYaml.sh 2>&1 | tee -a ~/alcor_logs/alcor.log

cd /root
echo "***** Download and build images on each Node *****" 2>&1 | tee -a ~/alcor_logs/alcor.log
./deploy-alcor-nodes.sh update-alcor4.sh alcor-nodes-ips
Copy link
Contributor

@cj-chung cj-chung Oct 19, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@yanmo96 If you put this sh file under script folder, these 3 files (deploy-alcor-nodes.sh, update-alcor4.sh and alcor-nodes-ips) also need to be included in this folder.

Copy link
Contributor Author

@yanmo96 yanmo96 Oct 19, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will do!

Copy link
Contributor

@cj-chung cj-chung Oct 19, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

alcor-nodes-ips is a little bit tricky, don't put our ips in the file and push to public repository.
I will recommend rewrite this line of code (line 29) to accept filename as parameters, so that we can flexibly run the script with 2 arguments (filename) - update-alcor.sh and alcor-nodes-ips in another folder with their path.


echo "***** Deploy Aclor Cluster *****" 2>&1 | tee -a ~/alcor_logs/alcor.log
cd /root/alcor/kubernetes/
chmod +x /root/alcor/kubernetes/createYaml.sh
/root/alcor/kubernetes/createYaml.sh 2>&1 | tee -a ~/alcor_logs/alcor.log
cd /root

sleep 30s

echo "***** Alcor Microservices Status *****" 2>&1 | tee -a ~/alcor_logs/alcor.log
kubectl get pods -A 2>&1 | tee -a ~/alcor_logs/alcor.log

echo "***** Create Segments *****" 2>&1 | tee -a ~/alcor_logs/alcor.log
curl -X POST -H "Content-Type: application/json" -H "Accept: */*" "http://localhost:30001/segments/createDefaultTable" 2>&1 | tee -a ~/alcor_logs/alcor.log

echo "***** Register Nodes *****" 2>&1 | tee -a ~/alcor_logs/alcor.log
curl -X POST -H "Content-Type: multipart/form-data" -F "file=@medina-nodes.json" "http://localhost:30007/nodes/upload" 2>&1 | tee -a ~/alcor_logs/alcor.log