Auto scaling fleet of GitLab CI runners

This repo contains infrastructure definitions and configuration for a fleet of GitLab CI runners. Provided tools allow to scale the number of runner instances up and down (to zero) as demand changes.

I decided not to use GitLab's suggested docker-machine approach because:

• docker-machine is mostly abandoned, life support from GitLab is barely enough to keep it alive. GitLab themselves are looking for an alternative solution.
• I want to be able to choose from a wider set of cloud providers than docker-machine supports. Coding new bindings for docker-machine seems to be a pointless endeavor.
• I wanted a project to learn Terraform/Pulumi. Previous two iterations of this project were created with Pulumi and Pulumi Automation API. Pulumi stopped developing bindings for the cloud I use (Yandex Cloud) and my Python code was not as clean as I would like, hence this (third) rewrite to Terraform & Go.

I intend to deploy the runners only for personal use and I aim to architect my infra to incur (next to) zero costs when no CI jobs are running.

Project status

Under construction (again). Being rewritten to Terraform after Pulumi Automation API and plain Pulumi.

Installation and usage

Documentation is not written yet. See Makefiles for pointers, make will yell at you until you provide all required environment variables :)

Infrastructure overview

• Persistent resources
  • S3 bucket that holds base image for cloud VMs
• Scaling down to zero on demand
  • 0 to N runner hosts: Debian hosts with GitLab runner daemon + Docker executor
  • 0 to 1 gateway: a simple cloud VM which has a public IPv4 and acts as a router, firewall and a reverse proxy for HTTP API
  • Other required resources (networks, IP addresses, VM images)

License and copyright

Copyright 2021-2023 Vitaly Potyarkin

   Licensed under the Apache License, Version 2.0 (the "License");
   you may not use this file except in compliance with the License.
   You may obtain a copy of the License at

       http://www.apache.org/licenses/LICENSE-2.0

   Unless required by applicable law or agreed to in writing, software
   distributed under the License is distributed on an "AS IS" BASIS,
   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
   See the License for the specific language governing permissions and
   limitations under the License.