WIP: use ansible provisioner for packer

[sttlr]

I wrote ansible playbook to provision barebones image using packer.

It works and successfully builds an image which I can init and then use.

It's still a work in progress - because you have to manually install ansible, collections, passlib on control host. Plus I installed the latest version of packer and changed ubuntu to 24.04. So my ansible provisioner is not a drop in replacement right now.

But I think it's where ax project should move forward: stop relying on unpredictable bash scripts and use ansible for provisioning.

I run ax build ansible-barebones

Build log:

digitalocean.packer: output will be in this color.

==> digitalocean.packer: Creating temporary RSA SSH key for instance...
==> digitalocean.packer: Importing SSH public key...
==> digitalocean.packer: Creating droplet...
==> digitalocean.packer: Waiting for droplet to become active...
==> digitalocean.packer: Using SSH communicator to connect: <IP>
==> digitalocean.packer: Waiting for SSH to become available...
==> digitalocean.packer: Connected to SSH!
==> digitalocean.packer: Uploading ./configs => /tmp/configs
==> digitalocean.packer: Provisioning with Ansible...
==> digitalocean.packer: Setting up proxy adapter for Ansible....
==> digitalocean.packer: Executing Ansible: ansible-playbook -e packer_build_name="packer" -e packer_builder_type=digitalocean --ssh-extra-args '-o IdentitiesOnly=yes' -e ansible_ssh_private_key_file=/tmp/ansible-key1512631560 -i /tmp/packer-provisioner-ansible3975269112 /root/.axiom/images/ansible/playbooks/barebones.yml
==> digitalocean.packer:
==> digitalocean.packer: PLAY [AX Barebones Image] ******************************************************
==> digitalocean.packer:
==> digitalocean.packer: TASK [Gathering Facts] *********************************************************
==> digitalocean.packer: [WARNING]: Host 'default' is using the discovered Python interpreter at '/usr/bin/python3.12', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.19/reference_appendices/interpreter_discovery.html for more information.
==> digitalocean.packer: ok: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Wait for cloud-init] ********************************************
==> digitalocean.packer: ok: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Create swap] ****************************************************
==> digitalocean.packer: included: /root/.axiom/images/ansible/roles/common/tasks/swap.yml for default
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : command] ********************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : file] ***********************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : command] ********************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : command] ********************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : lineinfile] *****************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Update & upgrade] ***********************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Install required packages] **************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Allow SSH and custom port in UFW] *******************************
==> digitalocean.packer: changed: [default] => (item=22)
==> digitalocean.packer: changed: [default] => (item=2266)
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Enable UFW] *****************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Create op user] *************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Create op directories] ******************************************
==> digitalocean.packer: changed: [default] => (item=.ssh)
==> digitalocean.packer: changed: [default] => (item=c2)
==> digitalocean.packer: changed: [default] => (item=recon)
==> digitalocean.packer: changed: [default] => (item=lists)
==> digitalocean.packer: changed: [default] => (item=go)
==> digitalocean.packer: changed: [default] => (item=bin)
==> digitalocean.packer: changed: [default] => (item=.config)
==> digitalocean.packer: changed: [default] => (item=.cache)
==> digitalocean.packer: changed: [default] => (item=work)
==> digitalocean.packer: changed: [default] => (item=.config/amass)
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Remove default MOTD files] **************************************
==> digitalocean.packer: changed: [default] => (item=/etc/update-motd.d/10-help-text)
==> digitalocean.packer: changed: [default] => (item=/etc/update-motd.d/50-motd-news)
==> digitalocean.packer: ok: [default] => (item=/etc/update-motd.d/60-unminimize)
==> digitalocean.packer: changed: [default] => (item=/etc/update-motd.d/00-header)
==> digitalocean.packer: changed: [default] => (item=/etc/update-motd.d/92-unattended-upgrades)
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Install Oh My Zsh (non-interactively)] **************************
==> digitalocean.packer: [WARNING]: Module remote_tmp /home/op/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Create sudo_as_admin_successful] ********************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Create legal MOTD cache] ****************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Set passwords] **************************************************
==> digitalocean.packer: changed: [default] => (item={'name': 'op'})
==> digitalocean.packer: changed: [default] => (item={'name': 'ubuntu'})
==> digitalocean.packer: changed: [default] => (item={'name': 'root'})
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Copy config files from tmp (matching original Packer)] **********
==> digitalocean.packer: changed: [default] => (item={'src': 'sudoers', 'dest': '/etc/sudoers', 'owner': 'root', 'group': 'root', 'mode': '0440'})
==> digitalocean.packer: changed: [default] => (item={'src': 'bashrc', 'dest': '/home/op/.bashrc', 'owner': 'op', 'group': 'users', 'mode': '0644'})
==> digitalocean.packer: changed: [default] => (item={'src': 'zshrc', 'dest': '/home/op/.zshrc', 'owner': 'op', 'group': 'users', 'mode': '0644'})
==> digitalocean.packer: changed: [default] => (item={'src': 'sshd_config', 'dest': '/etc/ssh/sshd_config', 'owner': 'root', 'group': 'root', 'mode': '0600'})
==> digitalocean.packer: changed: [default] => (item={'src': '00-header', 'dest': '/etc/update-motd.d/00-header', 'owner': 'root', 'group': 'root', 'mode': '0755'})
==> digitalocean.packer: changed: [default] => (item={'src': 'authorized_keys', 'dest': '/home/op/.ssh/authorized_keys', 'owner': 'op', 'group': 'users', 'mode': '0600'})
==> digitalocean.packer: changed: [default] => (item={'src': 'tmux-splash.sh', 'dest': '/home/op/bin/tmux-splash.sh', 'owner': 'op', 'group': 'users', 'mode': '0755'})
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Set op user file ownership] *************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Restart SSH] ****************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Install Golang] *************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Install Docker] *************************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Add op user to docker group] ************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Install uv system-wide using installer script] ******************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Install Interlace using uv tool for user op] ********************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Optimize SSH config] ********************************************
==> digitalocean.packer: changed: [default] => (item={'key': 'ClientAliveInterval', 'value': '60'})
==> digitalocean.packer: changed: [default] => (item={'key': 'ClientAliveCountMax', 'value': '60'})
==> digitalocean.packer: changed: [default] => (item={'key': 'MaxSessions', 'value': '100'})
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Tune sysctl for high concurrency] *******************************
==> digitalocean.packer: changed: [default] => (item={'name': 'net.nf_conntrack_max', 'value': '1048576'})
==> digitalocean.packer: changed: [default] => (item={'name': 'net.core.somaxconn', 'value': '1048576'})
==> digitalocean.packer: changed: [default] => (item={'name': 'net.ipv4.ip_local_port_range', 'value': '1024 65535'})
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Clean apt] ******************************************************
==> digitalocean.packer: ok: [default]
==> digitalocean.packer:
==> digitalocean.packer: TASK [common : Print completion message (base64 decoded)] **********************
==> digitalocean.packer: ok: [default] => {
==> digitalocean.packer:     "msg": "\nCongratulations, your build is almost done!\n\n █████╗ ██╗  ██╗    ██████╗ ██╗   ██╗██╗██╗     ██████╗\n██╔══██╗╚██╗██╔╝    ██╔══██╗██║   ██║██║██║     ██╔══██╗\n███████║ ╚███╔╝     ██████╔╝██║   ██║██║██║     ██║  ██║\n██╔══██║ ██╔██╗     ██╔══██╗██║   ██║██║██║     ██║  ██║\n██║  ██║██╔╝ ██╗    ██████╔╝╚██████╔╝██║██████╗██████╔╝\n╚═╝  ╚═╝╚═╝  ╚═╝    ╚═════╝  ╚═════╝ ╚═╝╚═════╝╚═════╝\n\nMaintainer: 0xtavian\n\n𝓲𝓷𝓼𝓹𝓲𝓻𝓮𝓭 𝓫𝔂 𝓪𝔁𝓲𝓸𝓶: 𝓽𝓱𝓮 𝓭𝔂𝓷𝓪𝓶𝓲𝓬 𝓲𝓷𝓯𝓻𝓪𝓼𝓽𝓻𝓾𝓬𝓽𝓾𝓻𝓮 𝓯𝓻𝓪𝓶𝓮𝔀𝓸𝓻𝓴 𝓯𝓸𝓻 𝓮𝓿𝓮𝓻𝔂𝓫𝓸𝓭𝔂! - @𝓹𝓻𝔂0𝓬𝓬 @0𝔁𝓽𝓪𝓿𝓲𝓪𝓷\n\nRead these while you're waiting to get started :)\n\n    - New Wiki: https://ax-framework.gitbook.io/wiki/\n    - Existing Users: https://ax-framework.gitbook.io/wiki/overview/existing-users\n    - Bring Your Own Provisioner: https://ax-framework.gitbook.io/wiki/fundamentals/bring-your-own-provisioner \n    - Filesystem Utilities: https://ax-framework.gitbook.io/wiki/fundamentals/filesystem-utilities\n    - Fleets: https://ax-framework.gitbook.io/wiki/fundamentals/fleets\n    - Scans: https://ax-framework.gitbook.io/wiki/fundamentals/scan"
==> digitalocean.packer: }
==> digitalocean.packer:
==> digitalocean.packer: RUNNING HANDLER [common : restart ssh] *****************************************
==> digitalocean.packer: changed: [default]
==> digitalocean.packer:
==> digitalocean.packer: PLAY RECAP *********************************************************************
==> digitalocean.packer: default                    : ok=32   changed=27   unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
==> digitalocean.packer:
==> digitalocean.packer: Gracefully shutting down droplet...
==> digitalocean.packer: Creating snapshot: axiom-ansible-1762160337
==> digitalocean.packer: Waiting for snapshot to complete...
==> digitalocean.packer: Destroying droplet...
==> digitalocean.packer: Deleting temporary ssh key...
Build 'digitalocean.packer' finished after 6 minutes 25 seconds.

==> Wait completed after 6 minutes 25 seconds

==> Builds finished. The artifacts of successful builds are:
--> digitalocean.packer: A snapshot was created: 'axiom-ansible-1762160337' (ID: 205341330) in regions 'fra1'
Your build completed successfully in 6 minutes! You should run axiom-update && axiom-build weekly to get the latest and greatest updates!
To initialize an instance, run axiom-init```

[0xtavian]

Hey @sttlr!

interesting addition! Have you noticed any issues with the current provisioning process that were resolved with ansible? Feel free to join us on our discord. Would like to discuss more. :)

https://discord.gg/nGqfRh9tdT