ENT-5725: Added vagrant provider for spawning VMs by victormlg · Pull Request #156 · cfengine/cf-remote

victormlg · 2025-09-09T15:10:24Z

It was a bit hard to know exactly what approach to take so if you have any better ideas I am interested

This doesn't exactly work yet, because

when creating VMs in a loop with a default name (like dev-1, dev-2, dev-3...) , the vms are created but only the first one created is accessible from the directory where lies the Vagrantfile (I'm using virtualbox)
when creating VMs with a custom name given by an env variable (ike in the pr) the vm is just not accessible, as if it wasn't created, but is actually present in virtualbox.

I am not sure how we should provision the created vms. We could:

just leave them unprovisioned
like I do in the code: let the user input his own provision script
start the VM unprovisioned, then inspect it using nt-discovery.sh and find all the information we need (like what package manager it uses, etc...) then provision it with a modular script using the collected data.

cf_remote/Vagrantfile

craigcomstock

looks like a great start! I have added some notes on things we have solved in jenkins-vms regarding various bits.

cf_remote/Vagrantfile

craigcomstock · 2025-09-10T14:12:04Z

cf_remote/Vagrantfile

+      node.vm.provider "virtualbox" do |vb|
+          vb.memory = VM_MEMORY
+          vb.cpus = VM_CPUS
+          vb.customize [ "guestproperty", "set", :id, "/VirtualBox/GuestAdd/VBoxService/--timesync-set-threshold", 1000 ]


regarding time and dns you might need to include this snippet from jenkins-vms that handles darwin/macos

https://gitlab.com/Northern.tech/CFEngine/jenkins-vms/-/blob/master/scripts/common.rb?ref_type=heads#L104

craigcomstock · 2025-09-10T14:13:23Z

cf_remote/Vagrantfile

+        # previously working Vagrantfiles:
+        # https://fedoraproject.org/wiki/Changes/Vagrant_2.2_with_QEMU_Session#Upgrade.2Fcompatibility_impact
+        v.qemu_use_session = false
+        override.vm.synced_folder "./", "/vagrant", type: :rsync


synced folders are also tricky for older distributions like debian-9:

here are some workarounds for centos-7 and old debians:

https://gitlab.com/Northern.tech/CFEngine/jenkins-vms/-/blob/master/scripts/common.rb?ref_type=heads#L151

cf_remote/main.py

cf_remote/spawn.py

larsewi

Looks great 🚀 Some smaller comments

While reviewing your PR, I never understood what the config argument to ssh and scp is for, or why it's necessary. Could you explain?

cf_remote/commands.py

cf_remote/spawn.py

cf_remote/Vagrantfile

victormlg · 2025-10-02T09:48:02Z

Looks great 🚀 Some smaller comments

While reviewing your PR, I never understood what the config argument to ssh and scp is for, or why it's necessary. Could you explain?

When you spawn a vagrant VM, vagrant generates a ssh config file with a private key and everything set up correctly. You can inspect it by running vagrant ssh-config. When you ssh into a vagrant machine by running vagrant ssh <name>, vagrant is simply doing ssh -F .
Connecting with vanilla ssh was a bit cumbersome because it resulted in a lot of errors and man-in-the-middle attacks warnings and such, so I thought it would be easier to connect by using the ssh config file generated by vagrant

The variable "config" is simply the path to the vagrant-ssh-config file inside the VM's directory. If it is not None, then the connection will connect using it.

larsewi

Looks like there are some failing test :)

victormlg · 2025-10-02T12:35:22Z

synced folders are also tricky for older distributions like debian-9:

here are some workarounds for centos-7 and old debians:

https://gitlab.com/Northern.tech/CFEngine/jenkins-vms/-/blob/master/scripts/common.rb?ref_type=heads#L151

I was thinking we could improve the Vagrantfile and other mechanics, like default provisioning scripts, in future iterations

cf_remote/commands.py

cf_remote/main.py

cf_remote/spawn.py

MANIFEST.in

cf_remote/spawn.py

cf_remote/Vagrantfile

cf_remote/spawn.py

cf_remote/ssh.py

Ticket: ENT-5725 Signed-off-by: Victor Moene <victor.moene@northern.tech>

larsewi · 2025-10-27T08:28:11Z

cf_remote/commands.py

-                else:
-                    print("VM '%s' not found in the clouds" % vm_uuid)
-            del vms_info[group_name]
+        if ssh_config and group_name in ssh_config:


Makes it easier to read

Suggested change

if ssh_config and group_name in ssh_config:

if ssh_config and (group_name in ssh_config):

larsewi · 2025-10-27T08:36:54Z

cf_remote/spawn.py

+    if cpus is None:
+        cpus = 1
+    if memory is None:
+        memory = 1024


Is this Mega Bytes?

Suggested change

memory = 1024

memory = 1024 # MB

victormlg requested review from craigcomstock and larsewi September 9, 2025 15:10

larsewi reviewed Sep 10, 2025

View reviewed changes

cf_remote/Vagrantfile Outdated Show resolved Hide resolved

craigcomstock reviewed Sep 10, 2025

View reviewed changes

victormlg force-pushed the spawn-vagrant branch 3 times, most recently from 429b367 to 8ff3c80 Compare September 23, 2025 15:37

victormlg force-pushed the spawn-vagrant branch from 8ff3c80 to c96596d Compare September 30, 2025 15:40

victormlg marked this pull request as ready for review September 30, 2025 15:40

victormlg force-pushed the spawn-vagrant branch from c96596d to be78500 Compare September 30, 2025 15:43

victormlg requested a review from larsewi September 30, 2025 15:44

larsewi requested changes Oct 1, 2025

View reviewed changes

victormlg force-pushed the spawn-vagrant branch from be78500 to 73e9bd8 Compare October 2, 2025 11:15

victormlg requested a review from larsewi October 2, 2025 11:16

larsewi requested changes Oct 2, 2025

View reviewed changes

victormlg force-pushed the spawn-vagrant branch from 73e9bd8 to fa2fa4f Compare October 2, 2025 12:30

victormlg requested a review from larsewi October 2, 2025 12:32

victormlg requested a review from craigcomstock October 2, 2025 12:36

larsewi reviewed Oct 2, 2025

View reviewed changes

cf_remote/commands.py Outdated Show resolved Hide resolved

cf_remote/main.py Show resolved Hide resolved

cf_remote/spawn.py Outdated Show resolved Hide resolved

cf_remote/spawn.py Outdated Show resolved Hide resolved

MANIFEST.in Outdated Show resolved Hide resolved

craigcomstock reviewed Oct 2, 2025

View reviewed changes

cf_remote/spawn.py Show resolved Hide resolved

victormlg force-pushed the spawn-vagrant branch 2 times, most recently from 6af64fc to 1f44cbe Compare October 6, 2025 16:29

victormlg requested a review from larsewi October 6, 2025 16:31

victormlg force-pushed the spawn-vagrant branch from 1f44cbe to 3887067 Compare October 6, 2025 16:36

craigcomstock approved these changes Oct 6, 2025

View reviewed changes

cf_remote/Vagrantfile Show resolved Hide resolved

larsewi reviewed Oct 7, 2025

View reviewed changes

cf_remote/spawn.py Outdated Show resolved Hide resolved

cf_remote/spawn.py Outdated Show resolved Hide resolved

cf_remote/spawn.py Show resolved Hide resolved

cf_remote/ssh.py Outdated Show resolved Hide resolved

victormlg force-pushed the spawn-vagrant branch 2 times, most recently from 933db4f to ab2189b Compare October 24, 2025 12:10

victormlg force-pushed the spawn-vagrant branch 2 times, most recently from b69818e to cd1e18a Compare October 24, 2025 13:12

Added vagrant vm spawning provider

76e6304

Ticket: ENT-5725 Signed-off-by: Victor Moene <victor.moene@northern.tech>

victormlg force-pushed the spawn-vagrant branch from cd1e18a to 76e6304 Compare October 24, 2025 13:19

victormlg requested a review from larsewi October 24, 2025 13:23

larsewi approved these changes Oct 27, 2025

View reviewed changes

larsewi merged commit eb99f83 into cfengine:master Oct 27, 2025
10 checks passed

	if ssh_config and group_name in ssh_config:
	if ssh_config and (group_name in ssh_config):

Conversation

victormlg commented Sep 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

craigcomstock left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

craigcomstock Sep 10, 2025

Choose a reason for hiding this comment

Uh oh!

craigcomstock Sep 10, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

larsewi left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

victormlg commented Oct 2, 2025

Uh oh!

larsewi left a comment

Choose a reason for hiding this comment

Uh oh!

victormlg commented Oct 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

larsewi Oct 27, 2025

Choose a reason for hiding this comment

Uh oh!

larsewi Oct 27, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

3 participants

victormlg commented Sep 9, 2025 •

edited

Loading

victormlg commented Oct 2, 2025 •

edited

Loading