Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RHEL-9] Drop RHSM and RHUI-specific config from Azure and EC2 images (COMPOSER-2308) #857

Merged
merged 12 commits into from
Sep 17, 2024

Conversation

thozza
Copy link
Member

@thozza thozza commented Aug 13, 2024

Drop the RHSM configuration from RHEL-9 Azure and EC2 image definitions, since it will be applies as a customization in the release configuration.

Additionally, unify the RHUI and non-RHUI image types as much as possible. Internally rename the original "RHUI" image types and functions to "internal", since they no longer have any RHUI-specific bits. However, these are still built only internally in Brew. We actually can't completely drop the RHUI image types, because these are built as compressed files in Brew. We could modify the implementation, but maybe let's just wait for OTK.

Lastly, drop the GCE RHUI image, which was never used and it is not built anywhere (only in osbuild-composer CI, but that can be fixed), even internally. The image could be built by customizing the GCE image type.

@thozza thozza marked this pull request as draft August 13, 2024 08:57
@thozza
Copy link
Member Author

thozza commented Aug 13, 2024

Converting to draft until the RHSM configuration is actually moved to the compose configuration.

@thozza
Copy link
Member Author

thozza commented Aug 13, 2024

Here is a manifest diff summary:

$ diff -I'[0-9a-f]\{8\}-[0-9a-f]\{4\}-[0-9a-f]\{4\}-[0-9a-f]\{4\}-[0-9a-f]\{12\}' -I'"volid": "[0-9a-f]\{8\}' -I'luks-[0-9a-f]\{4\}' test/data/manifests-old/ test/data/manifests -q 
Files test/data/manifests-old/rhel_9.0-aarch64-azure_rhui-empty.json and test/data/manifests/rhel_9.0-aarch64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.0-aarch64-ec2-empty.json and test/data/manifests/rhel_9.0-aarch64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.0-x86_64-azure_rhui-empty.json and test/data/manifests/rhel_9.0-x86_64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.0-x86_64-azure_sap_rhui-empty.json and test/data/manifests/rhel_9.0-x86_64-azure_sap_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.0-x86_64-ec2-empty.json and test/data/manifests/rhel_9.0-x86_64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.0-x86_64-ec2_ha-empty.json and test/data/manifests/rhel_9.0-x86_64-ec2_ha-empty.json differ
Files test/data/manifests-old/rhel_9.0-x86_64-ec2_sap-ec2_sap_empty.json and test/data/manifests/rhel_9.0-x86_64-ec2_sap-ec2_sap_empty.json differ
Only in test/data/manifests-old/: rhel_9.0-x86_64-gce_rhui-empty.json
Files test/data/manifests-old/rhel_9.1-aarch64-azure_rhui-empty.json and test/data/manifests/rhel_9.1-aarch64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.1-aarch64-ec2-empty.json and test/data/manifests/rhel_9.1-aarch64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.1-x86_64-azure_rhui-empty.json and test/data/manifests/rhel_9.1-x86_64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.1-x86_64-azure_sap_rhui-empty.json and test/data/manifests/rhel_9.1-x86_64-azure_sap_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.1-x86_64-ec2-empty.json and test/data/manifests/rhel_9.1-x86_64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.1-x86_64-ec2_ha-empty.json and test/data/manifests/rhel_9.1-x86_64-ec2_ha-empty.json differ
Files test/data/manifests-old/rhel_9.1-x86_64-ec2_sap-ec2_sap_empty.json and test/data/manifests/rhel_9.1-x86_64-ec2_sap-ec2_sap_empty.json differ
Only in test/data/manifests-old/: rhel_9.1-x86_64-gce_rhui-empty.json
Files test/data/manifests-old/rhel_9.2-aarch64-azure_rhui-empty.json and test/data/manifests/rhel_9.2-aarch64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.2-aarch64-ec2-empty.json and test/data/manifests/rhel_9.2-aarch64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.2-x86_64-azure_rhui-empty.json and test/data/manifests/rhel_9.2-x86_64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.2-x86_64-azure_sap_rhui-empty.json and test/data/manifests/rhel_9.2-x86_64-azure_sap_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.2-x86_64-ec2-empty.json and test/data/manifests/rhel_9.2-x86_64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.2-x86_64-ec2_ha-empty.json and test/data/manifests/rhel_9.2-x86_64-ec2_ha-empty.json differ
Files test/data/manifests-old/rhel_9.2-x86_64-ec2_sap-ec2_sap_empty.json and test/data/manifests/rhel_9.2-x86_64-ec2_sap-ec2_sap_empty.json differ
Only in test/data/manifests-old/: rhel_9.2-x86_64-gce_rhui-empty.json
Files test/data/manifests-old/rhel_9.3-aarch64-azure_rhui-empty.json and test/data/manifests/rhel_9.3-aarch64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.3-aarch64-ec2-empty.json and test/data/manifests/rhel_9.3-aarch64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.3-x86_64-azure_rhui-empty.json and test/data/manifests/rhel_9.3-x86_64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.3-x86_64-azure_sap_rhui-empty.json and test/data/manifests/rhel_9.3-x86_64-azure_sap_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.3-x86_64-ec2-empty.json and test/data/manifests/rhel_9.3-x86_64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.3-x86_64-ec2_ha-empty.json and test/data/manifests/rhel_9.3-x86_64-ec2_ha-empty.json differ
Files test/data/manifests-old/rhel_9.3-x86_64-ec2_sap-ec2_sap_empty.json and test/data/manifests/rhel_9.3-x86_64-ec2_sap-ec2_sap_empty.json differ
Only in test/data/manifests-old/: rhel_9.3-x86_64-gce_rhui-empty.json
Files test/data/manifests-old/rhel_9.4-aarch64-azure_rhui-empty.json and test/data/manifests/rhel_9.4-aarch64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.4-aarch64-ec2-empty.json and test/data/manifests/rhel_9.4-aarch64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.4-x86_64-azure_rhui-empty.json and test/data/manifests/rhel_9.4-x86_64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.4-x86_64-azure_sap_rhui-empty.json and test/data/manifests/rhel_9.4-x86_64-azure_sap_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.4-x86_64-ec2-empty.json and test/data/manifests/rhel_9.4-x86_64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.4-x86_64-ec2_ha-empty.json and test/data/manifests/rhel_9.4-x86_64-ec2_ha-empty.json differ
Files test/data/manifests-old/rhel_9.4-x86_64-ec2_sap-ec2_sap_empty.json and test/data/manifests/rhel_9.4-x86_64-ec2_sap-ec2_sap_empty.json differ
Only in test/data/manifests-old/: rhel_9.4-x86_64-gce_rhui-empty.json
Files test/data/manifests-old/rhel_9.5-aarch64-azure_rhui-empty.json and test/data/manifests/rhel_9.5-aarch64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.5-aarch64-ec2-empty.json and test/data/manifests/rhel_9.5-aarch64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.5-x86_64-azure_rhui-empty.json and test/data/manifests/rhel_9.5-x86_64-azure_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.5-x86_64-azure_sap_rhui-empty.json and test/data/manifests/rhel_9.5-x86_64-azure_sap_rhui-empty.json differ
Files test/data/manifests-old/rhel_9.5-x86_64-ec2-empty.json and test/data/manifests/rhel_9.5-x86_64-ec2-empty.json differ
Files test/data/manifests-old/rhel_9.5-x86_64-ec2_ha-empty.json and test/data/manifests/rhel_9.5-x86_64-ec2_ha-empty.json differ
Files test/data/manifests-old/rhel_9.5-x86_64-ec2_sap-ec2_sap_empty.json and test/data/manifests/rhel_9.5-x86_64-ec2_sap-ec2_sap_empty.json differ
Only in test/data/manifests-old/: rhel_9.5-x86_64-gce_rhui-empty.json

And here is a full diff:
manifests-diff.txt

@thozza
Copy link
Member Author

thozza commented Aug 29, 2024

I've submitted last compose config changes via https://issues.redhat.com/browse/COMPOSER-2344. Once those are merged, I'll mark this PR as ready.

@thozza thozza marked this pull request as ready for review September 16, 2024 12:51
@thozza
Copy link
Member Author

thozza commented Sep 16, 2024

RHEL / CS pungi configurations have been updated (https://issues.redhat.com/browse/COMPOSER-2344). This PR can be now reviewed.

Remove the RHUI client RPMs from the image base package set. These will
be specified in the Pungi compose configuration as a customization.

Related to:
https://issues.redhat.com/browse/COMPOSER-2310

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
Remove the RHUI client and the redhat-cloud-client-configuration RPMs
from the image base package set. These will be specified in the Pungi
compose configuration as a customization.

Related to:
https://issues.redhat.com/browse/COMPOSER-2310

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
Remove the RHUI variant of the GCE image. It was never used and exposed
to end users. Given the convergence of RHUI images to the common image
definitions and the existing customizations, one can customize the
plain GCE image to make it RHUI-like.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
The RHSM configuration specific to RHUI images was moved to the release
configuration, therefore it is no longer needed. Let's simplify
functions for constructing image definitions.

Related to:
https://issues.redhat.com/browse/COMPOSER-2310

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
The AMI and RHEL EC2 image had a different package set for no good
reason. Let's unify them to reduce the complexity.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
This is a leftover from the old times, when the required packages were
not added automatically to the image build pkg set based on used
customizations.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
Remove the RHUI-specific parts of image type configurations from the
image definition, since these are now specified in the compose
configuration.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
The previously named "RHUI" image types do not include any RHUI-specific
configuration. These images are still build only internally for RHEL.
Let's rename them to "internal". The actual image type names is still
kept untouched for backward compatibility.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
@thozza
Copy link
Member Author

thozza commented Sep 17, 2024

osbuild-composer failed tests are expected, since the current main and this PR will need some code changes in composer to be integrated.

In addition, the Unit tests failure on F41 is caused by the Fedora repository checksum mismatch 🤷‍♂️

Copy link
Member

@ondrejbudai ondrejbudai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome!

@thozza thozza added this pull request to the merge queue Sep 17, 2024
Merged via the queue into osbuild:main with commit 67a2b2f Sep 17, 2024
16 of 19 checks passed
achilleas-k added a commit to achilleas-k/osbuild-composer that referenced this pull request Sep 17, 2024
Update osbuild/images to include:
- blueprint: remove the sshkey customization
  (osbuild/images#928).
- [RHEL-9] Drop RHSM and RHUI-specific config from Azure and EC2 images
  (COMPOSER-2308) (osbuild/images#857).
achilleas-k added a commit to achilleas-k/osbuild-composer that referenced this pull request Sep 17, 2024
gce-rhui is now gone from RHEL 9 [1] and the old name simply aliases to
gce.  gcp-rhui in the cloudapi now resolves to 'gce' in RHEL 9 and
'gce-rhui' in RHEL 8.

[1] osbuild/images#857
thozza pushed a commit to osbuild/osbuild-composer that referenced this pull request Sep 17, 2024
Update osbuild/images to include:
- blueprint: remove the sshkey customization
  (osbuild/images#928).
- [RHEL-9] Drop RHSM and RHUI-specific config from Azure and EC2 images
  (COMPOSER-2308) (osbuild/images#857).
thozza pushed a commit to osbuild/osbuild-composer that referenced this pull request Sep 17, 2024
gce-rhui is now gone from RHEL 9 [1] and the old name simply aliases to
gce.  gcp-rhui in the cloudapi now resolves to 'gce' in RHEL 9 and
'gce-rhui' in RHEL 8.

[1] osbuild/images#857
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants