Proxmox and KVM related Virtual Machines using Hashicorp's Packer

• Proxmox and KVM related Virtual Machines using Hashicorp's Packer
  • Proxmox
    • Proxmox requirements
    • Usage
    • Provisioning
    • Updates
  • KVM
    • KVM Requirements
    • Cloud-init support
      • RHEL
      • Ubuntu
    • KVM scripts usage
      • Prerequisites
      • Parameters
      • Basic usage
    • KVM building scripts, by OS with cloud parameters
      • AlmaLinux
      • Oracle Linux
      • Rocky Linux
      • Migration from Legacy Scripts
      • Old vs New Command Examples
  • Default credentials
  • Known Issues
    • Windows UEFI boot and 'Press any key to boot from CD or DVD' issue
    • OpenSuse Leap stage 2 sshd fix
  • To DO
  • Q & A

Consider buying me a coffee if you like my work. All donations are appreciated. All donations will be used to pay for pipeline running costs

Proxmox

Proxmox requirements

• Packer in version >= 1.10.0
• Proxmox in version >= 8.0 with any storage (tested with CEPH and ZFS)
• [Ansible] in version >= 2.10.0
• tested with AMD Ryzen 9 5950X, Intel(R) Core(TM) i3-7100T
• at least 2GB of free RAM for virtual machines (4GB recommended)
• at least 100GB of free disk space for virtual machines (200GB recommended) on fast storage (SSD/NVME with LVM thinpool, Ceph or ZFS)
• virtio iso file in at least 1.271 version https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/archive-virtio/virtio-win-0.1.271-1/virtio-win.iso

Usage

• Init packer by running packer init config.pkr.hcl or packer init -upgrade config.pkr.hcl

• Init your ansible by running ansible-galaxy collection install --upgrade -r ./extra/playbooks/requirements.yml

• Generate new user or token for existing user in Proxmox - Datacenter/Pemissions/API Tokens

  Do not mark Privilege separation checkbox, unless you have dedicated role prepared.

  Example token:

  

• create and use env variables for secrets /secrets/proxmox.sh with content similar to:

  export PROXMOX_URL="https://someproxmoxserver:8006/api2/json"
  export PROXMOX_USERNAME="root@pam!packer"
  export PROXMOX_TOKEN="xxxxxxxxxxxxxxxxx"

• adjust required variables in proxmox/variables*.pkvars.hcl files especially datastore names (storage_pool, iso_file, iso_storage_pool) in:

      disks = {
          cache_mode              = "writeback"
          disk_size               = "50G"
          format                  = "raw"
          type                    = "sata"
          storage_pool            = "zfs"
      }

  Replace storage_pool variable with your storage pool name.

  iso_file                    = "images:iso/20348.169.210806-2348.fe_release_svc_refresh_SERVER_EVAL_x64FRE_en-us.iso"
  iso_storage_pool            = "local"
  proxmox_node                = "proxmox5"
  virtio_iso_file             = "images:iso/virtio-win.iso"

  Replace iso_file and virtio_iso_file with your ISO files and iso_storage_pool with your storage pool name. If you are using CEPH storage, you can use ceph as storage pool name. If you are using ZFS storage, you can use zfs as storage pool name. If you are using LVM storage, you can use local as storage pool name.

  network_adapters = {
    bridge                  = "vmbr0"
    model                   = "virtio"
    firewall                = false
    mac_address             = ""
  }

  Replace bridge with your bridge name.

• run proxmox_generic script with proper parameters for dedicated OS

Command	OS FullName and Version	Boot Type
./proxmox_generic.sh -V almalinux88 -F rhel -U true	AlmaLinux 8.8	UEFI
./proxmox_generic.sh -V almalinux88 -F rhel -U false	AlmaLinux 8.8	BIOS
./proxmox_generic.sh -V almalinux89 -F rhel -U true	AlmaLinux 8.9	UEFI
./proxmox_generic.sh -V almalinux89 -F rhel -U false	AlmaLinux 8.9	BIOS
./proxmox_generic.sh -V almalinux810 -F rhel -U true	AlmaLinux 8.10	UEFI
./proxmox_generic.sh -V almalinux810 -F rhel -U false	AlmaLinux 8.10	BIOS
./proxmox_generic.sh -V almalinux92 -F rhel -U true	AlmaLinux 9.2	UEFI
./proxmox_generic.sh -V almalinux92 -F rhel -U false	AlmaLinux 9.2	BIOS
./proxmox_generic.sh -V almalinux93 -F rhel -U true	AlmaLinux 9.3	UEFI
./proxmox_generic.sh -V almalinux93 -F rhel -U false	AlmaLinux 9.3	BIOS
./proxmox_generic.sh -V almalinux94 -F rhel -U true	AlmaLinux 9.4	UEFI
./proxmox_generic.sh -V almalinux94 -F rhel -U false	AlmaLinux 9.4	BIOS
./proxmox_generic.sh -V almalinux95 -F rhel -U true	AlmaLinux 9.5	UEFI
./proxmox_generic.sh -V almalinux95 -F rhel -U false	AlmaLinux 9.5	BIOS
./proxmox_generic.sh -V almalinux96 -F rhel -U true	AlmaLinux 9.6	UEFI
./proxmox_generic.sh -V almalinux96 -F rhel -U false	AlmaLinux 9.6	BIOS
./proxmox_generic.sh -V opensuse_leap_15_5 -F sles -U true	openSUSE Leap 15.5	UEFI
./proxmox_generic.sh -V opensuse_leap_15_5 -F sles -U false	openSUSE Leap 15.5	BIOS
./proxmox_generic.sh -V opensuse_leap_15_6 -F sles -U true	openSUSE Leap 15.6	UEFI
./proxmox_generic.sh -V opensuse_leap_15_6 -F sles -U false	openSUSE Leap 15.6	BIOS
./proxmox_generic.sh -V oraclelinux810 -F rhel -U true	Oracle Linux 8.10	UEFI
./proxmox_generic.sh -V oraclelinux810 -F rhel -U false	Oracle Linux 8.10	BIOS
./proxmox_generic.sh -V oraclelinux88 -F rhel -U true	Oracle Linux 8.8	UEFI
./proxmox_generic.sh -V oraclelinux88 -F rhel -U false	Oracle Linux 8.8	BIOS
./proxmox_generic.sh -V oraclelinux89 -F rhel -U true	Oracle Linux 8.9	UEFI
./proxmox_generic.sh -V oraclelinux89 -F rhel -U false	Oracle Linux 8.9	BIOS
./proxmox_generic.sh -V oraclelinux92 -F rhel -U true	Oracle Linux 9.2	UEFI
./proxmox_generic.sh -V oraclelinux92 -F rhel -U false	Oracle Linux 9.2	BIOS
./proxmox_generic.sh -V oraclelinux93 -F rhel -U true	Oracle Linux 9.3	UEFI
./proxmox_generic.sh -V oraclelinux93 -F rhel -U false	Oracle Linux 9.3	BIOS
./proxmox_generic.sh -V oraclelinux94 -F rhel -U true	Oracle Linux 9.4	UEFI
./proxmox_generic.sh -V oraclelinux94 -F rhel -U false	Oracle Linux 9.4	BIOS
./proxmox_generic.sh -V oraclelinux95 -F rhel -U true	Oracle Linux 9.5	UEFI
./proxmox_generic.sh -V oraclelinux95 -F rhel -U false	Oracle Linux 9.5	BIOS
./proxmox_generic.sh -V oraclelinux96 -F rhel -U true	Oracle Linux 9.6	UEFI
./proxmox_generic.sh -V oraclelinux96 -F rhel -U false	Oracle Linux 9.6	BIOS
./proxmox_generic.sh -V rockylinux810 -F rhel -U true	Rocky Linux 8.10	UEFI
./proxmox_generic.sh -V rockylinux810 -F rhel -U false	Rocky Linux 8.10	BIOS
./proxmox_generic.sh -V rockylinux88 -F rhel -U true	Rocky Linux 8.8	UEFI
./proxmox_generic.sh -V rockylinux88 -F rhel -U false	Rocky Linux 8.8	BIOS
./proxmox_generic.sh -V rockylinux89 -F rhel -U true	Rocky Linux 8.9	UEFI
./proxmox_generic.sh -V rockylinux89 -F rhel -U false	Rocky Linux 8.9	BIOS
./proxmox_generic.sh -V rockylinux92 -F rhel -U true	Rocky Linux 9.2	UEFI
./proxmox_generic.sh -V rockylinux92 -F rhel -U false	Rocky Linux 9.2	BIOS
./proxmox_generic.sh -V rockylinux93 -F rhel -U true	Rocky Linux 9.3	UEFI
./proxmox_generic.sh -V rockylinux93 -F rhel -U false	Rocky Linux 9.3	BIOS
./proxmox_generic.sh -V rockylinux94 -F rhel -U true	Rocky Linux 9.4	UEFI
./proxmox_generic.sh -V rockylinux94 -F rhel -U false	Rocky Linux 9.4	BIOS
./proxmox_generic.sh -V rockylinux95 -F rhel -U true	Rocky Linux 9.5	UEFI
./proxmox_generic.sh -V rockylinux95 -F rhel -U false	Rocky Linux 9.5	BIOS
./proxmox_generic.sh -V rockylinux96 -F rhel -U true	Rocky Linux 9.6	UEFI
./proxmox_generic.sh -V rockylinux96 -F rhel -U false	Rocky Linux 9.6	BIOS
./proxmox_generic.sh -V ubuntu2204 -F ubuntu -U true	Ubuntu 22.04	UEFI
./proxmox_generic.sh -V ubuntu2204 -F ubuntu -U false	Ubuntu 22.04	BIOS
./proxmox_generic.sh -V ubuntu2304 -F ubuntu -U true	Ubuntu 23.04	UEFI
./proxmox_generic.sh -V ubuntu2304 -F ubuntu -U false	Ubuntu 23.04	BIOS
./proxmox_generic.sh -V ubuntu2404 -F ubuntu -U true	Ubuntu 24.04	UEFI
./proxmox_generic.sh -V ubuntu2404 -F ubuntu -U false	Ubuntu 24.04	BIOS
./proxmox_generic.sh -V windows2019-dc -F windows -U true	Windows Server 2019 Datacenter	UEFI
./proxmox_generic.sh -V windows2019-dc -F windows -U false	Windows Server 2019 Datacenter	BIOS
./proxmox_generic.sh -V windows2019-std -F windows -U true	Windows Server 2019 Standard	UEFI
./proxmox_generic.sh -V windows2019-std -F windows -U false	Windows Server 2019 Standard	BIOS
./proxmox_generic.sh -V windows2022-dc -F windows -U true	Windows Server 2022 Datacenter	UEFI
./proxmox_generic.sh -V windows2022-dc -F windows -U false	Windows Server 2022 Datacenter	BIOS
./proxmox_generic.sh -V windows2022-std -F windows -U true	Windows Server 2022 Standard	UEFI
./proxmox_generic.sh -V windows2022-std -F windows -U false	Windows Server 2022 Standard	BIOS
./proxmox_generic.sh -V windows2025-dc -F windows -U true	Windows Server 2025 Datacenter	UEFI
./proxmox_generic.sh -V windows2025-dc -F windows -U false	Windows Server 2025 Datacenter	BIOS
./proxmox_generic.sh -V windows2025-std -F windows -U true	Windows Server 2025 Standard	UEFI
./proxmox_generic.sh -V windows2025-std -F windows -U false	Windows Server 2025 Standard	BIOS

Provisioning

• For RHEl-based machines, provisioning is done by Ansible Playbooks extra/playbooks using variables from variables/ folder

example:

install_epel: true
install_webmin: false
install_hyperv: false
install_cockpit: true
install_neofetch: true
install_updates: true
install_extra_groups: true
docker_prepare: false
extra_device: ""
install_motd: true

• For Ubuntu-based machines provisioning is done by scripts from extra/files/ubuntu* folders

• For Windows-based machines provisioning is done by Powershell scripts located in extra/scripts/windows/*

Updates

In case of RHEL clones, only current release is allowed to do updates, as updating for example Alma Linux 8.8 will always end in current release (8.10). This is due to the way how RHEL clones are built. To avoid that, all updates in NON current releases are disabled by setting extra variable for ansible playbook install_updates: false

ansible_extra_args        = ["-e", "@extra/playbooks/provision_rocky8_variables.yml", "-e", "@variables/rockylinux8.yml", "-e", "{\"install_updates\": false}","--scp-extra-args", "'-O'"]

if you really want to start from historical release and update it to current release, remove "-e","{\"install_updates\": false}" from ansible_extra_args variable

This setting will also cause to not install or update 'release' packages.

KVM

KVM Requirements

• Packer in version >= 1.10
• [Ansible] in version >= 2.10.0
• tested with AMD Ryzen 9 5950X, Intel(R) Core(TM) i3-7100T
• at least 2GB of free RAM for virtual machines (4GB recommended)
• KVM hypervisor

Cloud-init support

KVM builds are separated by cloud-init groups. Currently supported groups are:

RHEL

• generic - generic cloud-init configuration
• oci - Oracle Cloud Infrastructure cloud-init configuration
• alicloud - Alibaba Cloud cloud-init configuration

Ubuntu

KVM scripts usage

The KVM building system has been unified into a single generic script (kvm_generic.sh) that can build any supported Linux distribution with configurable parameters, replacing the need for individual scripts for each OS version.

Prerequisites

Initialize Packer before running any builds:

packer init config.pkr.hcl

Parameters

Parameter	Description	Valid Values	Default
-P	PACKER_LOG level	0 (silent) or 1 (verbose)	0
-C	Cloud-init configuration	generic, oci, alicloud	generic
-F	OS family	rhel	rhel
-V	Version identifier	See supported versions below	almalinux-8.7
-U	UEFI support	true or false	false

Basic usage

• Build Rocky Linux 9.6 with generic cloud-init configuration

./kvm_generic.sh -V rockylinux-9.6

• Build Rocky Linux 9.6 for OCI with UEFI support

./kvm_generic.sh -V rockylinux-9.6 -C oci -U true

• Build Oracle Linux 8.9 for AliCloud

./kvm_generic.sh -V oraclelinux-8.9 -C alicloud

• Build AlmaLinux 9.4 with generic cloud-init and UEFI

./kvm_generic.sh -V almalinux-9.4 -U true

KVM building scripts, by OS with cloud parameters

AlmaLinux

Version	Version Identifier	Generic	OCI	AliCloud
8.7	almalinux-8.7	✓	✓	✓
8.8	almalinux-8.8	✓	✓	✓
8.9	almalinux-8.9	✓	✓	✓
8.10	almalinux-8.10	✓	✓	✓
9.0	almalinux-9.0	✓	✓	✓
9.1	almalinux-9.1	✓	✓	✓
9.2	almalinux-9.2	✓	✓	✓
9.3	almalinux-9.3	✓	✓	✓
9.4	almalinux-9.4	✓	✓	✓
9.5	almalinux-9.5	✓	✓	✓
9.6	almalinux-9.6	✓	✓	✓

Oracle Linux

Version	Version Identifier	Generic	OCI	AliCloud
8.6	oraclelinux-8.6	✓	✓	✓
8.7	oraclelinux-8.7	✓	✓	✓
8.8	oraclelinux-8.8	✓	✓	✓
8.9	oraclelinux-8.9	✓	✓	✓
8.10	oraclelinux-8.10	✓	✓	✓
9.0	oraclelinux-9.0	✓	✓	✓
9.1	oraclelinux-9.1	✓	✓	✓
9.2	oraclelinux-9.2	✓	✓	✓
9.3	oraclelinux-9.3	✓	✓	✓
9.4	oraclelinux-9.4	✓	✓	✓
9.5	oraclelinux-9.5	✓	✓	✓
9.6	oraclelinux-9.6	✓	✓	✓

Rocky Linux

Version	Version Identifier	Generic	OCI	AliCloud
8.7	rockylinux-8.7	✓	✓	✓
8.8	rockylinux-8.8	✓	✓	✓
8.9	rockylinux-8.9	✓	✓	✓
9.0	rockylinux-9.0	✓	✓	✓
9.1	rockylinux-9.1	✓	✓	✓
9.2	rockylinux-9.2	✓	✓	✓
9.3	rockylinux-9.3	✓	✓	✓
9.4	rockylinux-9.4	✓	✓	✓
9.5	rockylinux-9.4	✓	✓	✓
9.4	rockylinux-9.6	✓	✓	✓

Migration from Legacy Scripts

The old individual scripts can be replaced with the generic script as follows:

Old vs New Command Examples

Old Command	New Command
./kvm_almalinux87.sh	./kvm_generic.sh -V almalinux-8.7
./kvm_almalinux87.sh 1 oci	./kvm_generic.sh -V almalinux-8.7 -P 1 -C oci
./kvm_rockylinux92.sh 1 generic	./kvm_generic.sh -V rockylinux-9.2 -P 1 -C generic
./kvm_oraclelinux89.sh oci	./kvm_generic.sh -V oraclelinux-8.9 -C oci

Default credentials

OS	username	password
Windows	Administrator	password
Alma/Rocky/Oracle	root	password
OpenSuse	root	password
Ubuntu	ubuntu	password

Known Issues

Windows UEFI boot and 'Press any key to boot from CD or DVD' issue

When using the proxmox builder with efi firmware, the Windows installer will not boot automatically. Instead, it will display the message Press any key to boot from CD or DVD and wait for user input. User needs to properly adjust boot_wait and boot_command wait times to find the right balance between waiting for the installer to boot and waiting for the user to press a key.

OpenSuse Leap stage 2 sshd fix

When building OpenSuse Leap 15.x sshd service starts in stage 2 which breaks packer scripts. There is an artificial delay added to builder (6 minutes) to wait for sshd to start. This is not ideal solution, but it works.

To DO

• ansible playbooks for Windows and Ubuntu machines
• OpenSuse Leap 15.x
  • OpenSuse Leap stage 2 sshd fix
• Debian 12

Q & A

Q: Will you add support for other OSes? A: Yes, I will add support for other OSes as I need them. If you need support for a specific OS, please open an issue and I will try to add it.

Q: My windows machine hangs at 'Waiting for WinRM to become available' step A: Update virtio drivers to the latest version. This issue is caused by old virtio drivers that are not compatible with Windows 10 and later versions.

Q: Will you add support for other hypervisors? A: No, this repository is dedicated to Proxmox and KVM. If you need support for other hypervisors, please look at my other repositories

Q: Will you add support for other cloud providers? A: Since some of cloud providers are using KVM based hypervisors, building custom image with KVM and importing them will solve the case

Q: Will you add support RHEL and RedHat based OSes? A: No, I will not add support for RHEL and RedHat directly, due to their licensing. However, I will add support for RHEL based OSes like AlmaLinux, Oracle Linux and Rocky Linux.

Q: Can I help? A: Yes, please open an issue or a pull request and I will try to help you. Please split PRs into separate commits for block of changes.

Q: Can I use this repository for my own projects? A: Yes, this repository is licensed under the Apache 2 license, so you can use it for your own projects. Please note that some of the files are licensed under different licenses, so please check the licenses of the individual files before using them