Skip to content

Latest commit

 

History

History
142 lines (108 loc) · 7.82 KB

README.md

File metadata and controls

142 lines (108 loc) · 7.82 KB
Raw

terraform-helm-eks-addons

Requirements

Name Version
terraform >= 1.0.0
aws >= 4.23

Providers

Name Version
aws >= 4.23
kubernetes >= 2.13
helm >= 2.6
kubectl >= 1.7.0

Modules

Name Source Version
k8s_addons ./addons/helm 0.0.1

Resources

Name Use
helm_release A terraform resource to deploy helm charts on kubernetes cluster

Inputs

Name Description Default Required
metrics_server To install metrics-server helmchart on eks cluster False Yes
metrics_server_helm_config option to provide path to override-values.yaml {values = "addons/metrics-server/config/metrics_server.yaml"} No
cluster_autoscaler To install cluster-autoscaler helmchart on eks cluster False Yes
cluster_autoscaler_helm_config option to provide path to override-values.yaml {values = "addons/cluster-autoscaler/config/cluster_autoscaler.yaml"} No
aws_load_balancer_controller To install aws-load-balancer-controller helmchart on eks cluster False Yes
aws_load_balancer_controller_helm_config option to provide path to override-values.yaml {values = "addons/aws-load-balancer-controller/config/aws_load_balancer_controller.yaml"} No
aws_node_termination_handler To install aws-node-termination-handler helmchart on eks cluster False Yes
aws_node_termination_handler_helm_config option to provide path to override-values.yaml {values = "addons/aws-node-termination-handler/config/aws_node_termination_handler.yaml"} No
aws_efs_csi_driver To install aws-efs-csi-driver helmchart on eks cluster False Yes
aws_efs_csi_driver_helm_config option to provide path to override-values.yaml {values = "addons/aws-efs-csi-driver/config/aws_efs_csi_driver.yaml"} No
aws_ebs_csi_driver To install aws-ebs-csi-driver helmchart on eks cluster False Yes
aws_ebs_csi_driver_helm_config option to provide path to override-values.yaml {values = "addons/aws-ebs-csi-driver/config/aws_ebs_csi_driver.yaml"} No
karpenter To install karpenter helmchart on eks cluster False Yes
karpenter_helm_config option to provide path to override-values.yaml {values = "addons/karpenter/config/karpenter.yaml"} No
calico_tigera To install Calico helmchart on eks cluster False Yes
calico_tigera_helm_config option to provide path to override-values.yaml {values = "addons/calico-tigera/config/calico-tigera-values.yaml"} No
istio_ingress To install Istio-ingress helmchart on eks cluster False Yes
istio_manifests Kubernetes yaml manifests to create ingress and gateway with specified host addons/istio-ingress/config/manifest/*.yaml Yes
istio_ingress_helm_config option to provide path to override-values.yaml {values = "addons/istio-ingress/config/override-values.yaml"} No
kiali_server To install Kiali Dashboard helmchart on eks cluster False Yes
kiali_manifests Includes VirtualService manifest file path and flag to install prometheus, grafana & jaeger kiali_manifests {
kiali_virtualservice_file_path = addons/kiali-server/config/kiali_vs.yaml
enable_monitoring = true
}		 Yes
kiali_server_helm_config option to provide path to override-values.yaml {values = "addons/kiali-server/config/kiali_server.yaml"} No

Outputs

No outputs.

How to Use

  • A complete documentation to use Calico with AWS EKS is present here

  • An example of usage is given here and below also.

  • Use below terraform module in your infrastructure's terraform script.

module "addons" {
  source  = "clouddrove/eks-addons/aws"
  version = "0.0.1"

  depends_on       = [module.eks.cluster_id]
  eks_cluster_name = module.eks.cluster_name

  metrics_server               = true
  cluster_autoscaler           = true
  aws_load_balancer_controller = true
  aws_node_termination_handler = true
  aws_efs_csi_driver           = true
  aws_ebs_csi_driver           = true

  kiali_server    = true
  kiali_manifests = var.kiali_manifests

  istio_ingress   = true
  istio_manifests = var.istio_manifests
}

Known Issues

  • Istio Ingress

    • Our istio-ingress addon creates an Application Load Balancer on AWS by using aws-load-balancer-controller.
    • aws-load-balancer-controller adds a finalizer field in ingress resource to prevent its manual deletion.
    • Another case is that, this ingress will be non-deletable if aws-load-balancer-controller gets deleted before deletion of ingress
    • Terraform does not controlls order of destructure which is sometimes causing aws-load-balancer-controller helmchart uninstallation before istio-ingress deletion.
    • The same issue will come when an appliaction uses ingress of type ALB; In this case we need to delete istio-ingress & ALB of applications manually by following some extra steps as shown below.
      1. Set istio_ingress to false in your terraform addon module.
      2. Run terraform apply, this will delete all the resource created by istio-ingress addon including istio-load-balancer.
      3. To delete ingress created by application run below command 
         kubectl patch ingress ingressName -n namespace -p '{"metadata":{"finalizers":[]}}' --type=merge
      4. Now you can run terraform destroy for complete destruction.

  • Calico CNI

    Our calico-tigera addon creates trigera-operator and calico-node out of which calico-node is being created using a manifest (calico-deployment.yaml). This manifest create two serviceAccounts (calico-cni-plugin & calico-node) which needs to be delete manually as shown below -

    1. Run kubectl edit serviceAccount calico-cni-plugin -n calico-system and delete finalizer block, then save and exit.
    2. Run kubectl edit serviceAccount calico-node -n calico-system and delete finalizer block, then save and exit.
    3. If both seriveAccount aren't deleted then run below command to delete them
    kubectl delete seriveAccount calico-cni-plugin calico-node -n calico-system

Feedback

If you come accross a bug or have any feedback, please log it in our issue tracker, or feel free to drop us an email at hello@clouddrove.com.

If you have found it worth your time, go ahead and give us a ★ on our GitHub!

About us

At CloudDrove, we offer expert guidance, implementation support and services to help organisations accelerate their journey to the cloud. Our services include docker and container orchestration, cloud migration and adoption, infrastructure automation, application modernisation and remediation, and performance engineering.

We are The Cloud Experts!

We ❤️ Open Source and you can check out our other modules to get help with your new Cloud ideas.