Skip to content

Conversation

@Chaffelson
Copy link
Contributor

Updated requirements for gcp, azure, and aws to pin requirements more suitable for Ansible 2.12. Needs full test runs to validate.
Migrated download_mirror from cloudera-deploy, renamed to auto_repo_mirror to better reflect actual functionality. Updated tasks to be more streamlined when used in a Collection. More refactoring to do here.
Migrated dynamic_inventory from cloudera-deploy, renamed some tasklists to better explain functionality. Needs further work to support different machine types from inventory template.
Updated cloudera.exe.infrastructure to support changes in dynamic_inventory. More to do to extract it as separate capability, espectially from utility_vm
Cloudera-Deploy init migrated to init_deployment. Now available to init any run against a definition_path for users not leveraging cloudera-deploy. woop woop.
minor bugfix where a know security group is not already present on a vpc when cloudera.exe.platform is called.

Signed-off-by: Daniel Chaffelson chaffelson@gmail.com

… suitable for Ansible 2.12. Needs full test runs to validate.

Migrated download_mirror from cloudera-deploy, renamed to auto_repo_mirror to better reflect actual functionality. Updated tasks to be more streamlined when used in a Collection. More refactoring to do here.
Migrated dynamic_inventory from cloudera-deploy, renamed some tasklists to better explain functionality. Needs further work to support different machine types from inventory template.
Updated cloudera.exe.infrastructure to support changes in dynamic_inventory. More to do to extract it as separate capability, espectially from utility_vm
Cloudera-Deploy init migrated to init_deployment. Now available to init any run against a definition_path for users not leveraging cloudera-deploy. woop woop.
minor bugfix where a know security group is not already present on a vpc when cloudera.exe.platform is called.

Signed-off-by: Daniel Chaffelson <chaffelson@gmail.com>
…distro rather than the os of the Ansible Controller

Improve auto_mirror to attempt to download both sha and sha1 if present, and not fail if they are not

Signed-off-by: Daniel Chaffelson <chaffelson@gmail.com>
….6.5 is primarily for PvC-DS.

Add draft ECS teardown processes
Add cloudera.cluster.operations.stop_cluster as a convenience method, as ECS needs to be stopped and cleaned in a specific sequence.
Provide additional wildcard DNS records for ECS in FreeIPA Autodns setup

Signed-off-by: Daniel Chaffelson <chaffelson@gmail.com>
@clevesque
Copy link
Contributor

clevesque commented Aug 6, 2022

auto-repo-mirror/task/populate_from_upstream.yml

  • name: Setup System Rhel8

Fails when Cloudera-Deploy container is CentOS Stream 8 and parcel_distro: el8
cat /etc/os-release
NAME="CentOS Stream"
VERSION="8"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="8"
PLATFORM_ID="platform:el8"
PRETTY_NAME="CentOS Stream 8"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:8"
HOME_URL="https://centos.org/"
BUG_REPORT_URL="https://bugzilla.redhat.com/"
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"

@wmudge wmudge marked this pull request as ready for review August 10, 2022 17:32
@wmudge
Copy link
Member

wmudge commented Aug 10, 2022

Please note, this commit contains breaking changes as we begin the 2.x.x release.

@wmudge wmudge added the enhancement MINOR - New feature or enhancement in the CHANGELOG label Aug 10, 2022
@wmudge wmudge added this to the PVC Update milestone Aug 10, 2022
@wmudge wmudge merged commit 0b14a0c into cloudera-labs:devel-pvc-update Aug 10, 2022
@wmudge
Copy link
Member

wmudge commented Aug 10, 2022

auto-repo-mirror/task/populate_from_upstream.yml

  • name: Setup System Rhel8

Fails when Cloudera-Deploy container is CentOS Stream 8 and parcel_distro: el8 cat /etc/os-release NAME="CentOS Stream" VERSION="8" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="8" PLATFORM_ID="platform:el8" PRETTY_NAME="CentOS Stream 8" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:8" HOME_URL="https://centos.org/" BUG_REPORT_URL="https://bugzilla.redhat.com/" REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"

@clevesque - could you please create a PR against the devel-pvc-updates branch now that this PR has been committed?

wmudge pushed a commit to wmudge/cloudera.exe that referenced this pull request Mar 8, 2023
* Update requirements for gcp, azure, and aws to pin requirements more suitable for Ansible 2.12. 
* Migrate download_mirror from cloudera-deploy, renamed to auto_repo_mirror to better reflect actual functionality.
* Update tasks to be more streamlined when used in a collection.
* Migrate dynamic_inventory from cloudera-deploy, renamed some tasklists to better explain functionality.
* Update cloudera.exe.infrastructure to support changes in dynamic_inventory.
* Migrate cloudera-deploy init role to init_deployment. Now available to init any run against a definition_path for users not leveraging cloudera-deploy.
* Fix minor bug where a known security group is not already present on a vpc when cloudera.exe.platform is called.
* Improve auto_mirror to set the cloudera manager version to match the distro rather than the OS of the Ansible Controller
* Improve auto_mirror to attempt to download both sha and sha1 if present, and not fail if they are not
* Set default Cloudera Manager version to 7.6.1 for base deployments. (7.6.5 is primarily for PvC-DS.)
* Add draft ECS teardown processes
* Add cloudera.cluster.operations.stop_cluster as a convenience method, as ECS needs to be stopped and cleaned in a specific sequence.
*Provide additional wildcard DNS records for ECS in FreeIPA Autodns setup

Signed-off-by: Daniel Chaffelson <chaffelson@gmail.com>
wmudge added a commit that referenced this pull request Mar 8, 2023
* Update to incorporate PVC prerequisites and Control Plane functions (#119)
* Update requirements for gcp, azure, and aws to pin requirements more suitable for Ansible 2.12. 
* Migrate download_mirror from cloudera-deploy, renamed to auto_repo_mirror to better reflect actual functionality.
* Update tasks to be more streamlined when used in a collection.
* Migrate dynamic_inventory from cloudera-deploy, renamed some tasklists to better explain functionality.
* Update cloudera.exe.infrastructure to support changes in dynamic_inventory.
* Migrate cloudera-deploy init role to init_deployment. Now available to init any run against a definition_path for users not leveraging cloudera-deploy.
* Fix minor bug where a known security group is not already present on a vpc when cloudera.exe.platform is called.
* Improve auto_mirror to set the cloudera manager version to match the distro rather than the OS of the Ansible Controller
* Improve auto_mirror to attempt to download both sha and sha1 if present, and not fail if they are not
* Set default Cloudera Manager version to 7.6.1 for base deployments. (7.6.5 is primarily for PvC-DS.)
* Add draft ECS teardown processes
* Add cloudera.cluster.operations.stop_cluster as a convenience method, as ECS needs to be stopped and cleaned in a specific sequence.
*Provide additional wildcard DNS records for ECS in FreeIPA Autodns setup
* Update collection dependency for PVC development (#122)
* Fix git branch in collection dependency (#123)
* Fixes for RHEL8.6 support and Dynamic Inventory (#127)
* Include Cloudera-Manager repo-as-tarball by default when collecting list of files for mirroring to custom_repo
* Include newer .sha256 checksums in custom_repo auto mirroring
* Fix bug where utility server was always being created for dynamic inventory because of typo in repo mirror targets test
* Skip epel-release to install python3 when not necessary (newer versions of RHEL8 do not need)
* Switch dynamic inventory to use RHEL8.6 instead of RHEL8.4 to keep up with preferred LTS releases
* Update cloudera.cloud dependency to 'main' branch

Signed-off-by: Daniel Chaffelson <chaffelson@gmail.com>
Signed-off-by: Webster Mudge <wmudge@cloudera.com>
Co-authored-by: Dan Chaffelson <chaffelson@gmail.com>
wmudge added a commit to wmudge/cloudera.exe that referenced this pull request Aug 12, 2025
* Remove legacy documentation and doc build tooling
* Update copyright and add missing license headers
* Update version to v2.0.0

Signed-off-by: Webster Mudge <wmudge@cloudera.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement MINOR - New feature or enhancement in the CHANGELOG

Development

Successfully merging this pull request may close these issues.

3 participants