Skip to content

CAPI cluster deletion stuck due to finalizer #1219

New issue
New issue
Closed
Closed
CAPI cluster deletion stuck due to finalizer#1219
Assignees
Danil-Grigorevcpinjani
Labels
area/installationkind/bugSomething isn't workingkind/regressionCategorizes issue or PR as related to a regression from a prior release.
@cpinjani

Description

@cpinjani
cpinjani
opened on Mar 27, 2025

What steps did you take and what happened?

CAPD cluster deletion stuck due to finalizer fleet.addons.cluster.x-k8s.io
Rancher: v2.10.2
Turtles dev build: 420cad0
CAAPF: v0.7.2

(Issue is not occurring on Turtles v0.17.0, CAAPF v0.6.0)

Steps:

  1. Create and import CAPD RKE2 cluster using fleet
  2. Once cluster is Active, update the turtles chart with some setting change.
  3. CAAPF and other deployments are restated.
  4. Delete the fleet repo and monitor CAPI cluster deletion
  5. Its stuck due to finalizer

Image

Add-on Logs:
Before chart update:

2025-03-27T10:51:09.325301Z  INFO actix_server::builder: starting 16 workers
2025-03-27T10:51:09.325508Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T10:51:09.325890Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T10:51:09.326028Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T10:51:09.326060Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T10:51:09.326250Z  INFO actix_server::server: Tokio runtime found; starting in existing Tokio runtime
2025-03-27T10:51:09.326265Z  INFO actix_server::server: starting service: "actix-web-service-0.0.0.0:8443", workers: 16, listening on: 0.0.0.0:8443
2025-03-27T10:51:09.376262Z  INFO update_watches: controller::controllers::addon_config: Reconciling dynamic watches trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:09.376335Z  INFO update_watches: controller::controllers::addon_config: Reconciled dynamic watches to match selectors: namespace=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import, cluster=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:09.376446Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T10:51:09.376480Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T10:51:09.381008Z  INFO reconciling object:reconcile_dynamic_watches:update_watches: controller::controllers::addon_config: Reconciling dynamic watches object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config" trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:09.381107Z  INFO reconciling object:reconcile_dynamic_watches:update_watches: controller::controllers::addon_config: Reconciled dynamic watches to match selectors: namespace=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import, cluster=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config" trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:09.385110Z  INFO reconciling object:reconcile_config_sync: controller::controllers::addon_config: Updated fleet config map object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:09.388307Z  INFO reconciling object:reconcile_config_sync: controller::controllers::addon_config: Updated fleet config map object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=related object updated: ConfigMap.v1./fleet-controller.cattle-fleet-system trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:13.215666Z  INFO reconciling object:reconcile_config_sync: controller::controllers::addon_config: Updated fleet config map object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=related object updated: ConfigMap.v1./fleet-controller.cattle-fleet-system trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:13.221843Z  INFO reconciling object:reconcile_config_sync: controller::controllers::addon_config: Updated fleet config map object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=related object updated: ConfigMap.v1./fleet-controller.cattle-fleet-system trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:18.711158Z  INFO reconciling object:reconcile_dynamic_watches:update_watches: controller::controllers::addon_config: Reconciling dynamic watches object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config" trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:18.711215Z  INFO reconciling object:reconcile_dynamic_watches:update_watches: controller::controllers::addon_config: Reconciled dynamic watches to match selectors: namespace=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import, cluster=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config" trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:18.714255Z  INFO reconciling object:reconcile_config_sync: controller::controllers::addon_config: Updated fleet config map object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T10:51:20.164293Z  INFO reconciling object: controller::controllers::cluster: Reconciled dynamic watches: added namespace watch on default object.ref=Namespace.v1./default object.reason=object updated
2025-03-27T10:54:49.421753Z ERROR reconciling object:reconcile: controller::controllers::controller: error=Finalizer Error: failed to add finalizer: ApiError: the server rejected our request due to an error in our request: Invalid (ErrorResponse { status: "Failure", message: "the server rejected our request due to an error in our request", reason: "Invalid", code: 422 }) object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:54:49.421839Z  WARN reconciling object: controller::controller: reconcile failed: FinalizerError(AddFinalizer(Api(ErrorResponse { status: "Failure", message: "the server rejected our request due to an error in our request", reason: "Invalid", code: 422 }))) object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated
2025-03-27T10:56:30.724203Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.746962Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.764492Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.779683Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.797676Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.811860Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.873063Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.905172Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.924116Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.954982Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:30.977127Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:31.002780Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:31.031902Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:31.057526Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:31.082547Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:31.139795Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:31.191921Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.130937Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.149819Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.175316Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.192387Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.209338Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.231395Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.257614Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.282938Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.307937Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.333365Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.358249Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.385016Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.407531Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.434426Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.459665Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.484643Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.508049Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.534356Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.560303Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.584520Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.611418Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.637724Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.687510Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.787030Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.886639Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:33.985279Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:34.087770Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:34.897750Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:34.917384Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:34.965956Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:34.988806Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:35.059407Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:35.092706Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:35.115773Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:35.465210Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:35.484798Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:37.277146Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:50.883253Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:50.900002Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:52.622650Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:58.012397Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:59.028222Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:56:59.047343Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:57:07.171472Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:57:07.207364Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:57:09.237981Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:57:09.257771Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:57:26.680422Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:57:26.762653Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:57:27.027298Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:57:27.123839Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"
2025-03-27T10:57:27.179900Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=related object updated: Cluster.v1alpha1.fleet.cattle.io/cluster1.default trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"

After chart update:

2025-03-27T11:00:42.111548Z  INFO actix_server::builder: starting 16 workers
2025-03-27T11:00:42.111781Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T11:00:42.112225Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T11:00:42.112397Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T11:00:42.112439Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T11:00:42.112769Z  INFO actix_server::server: Tokio runtime found; starting in existing Tokio runtime
2025-03-27T11:00:42.112782Z  INFO actix_server::server: starting service: "actix-web-service-0.0.0.0:8443", workers: 16, listening on: 0.0.0.0:8443
2025-03-27T11:00:42.160220Z  INFO update_watches: controller::controllers::addon_config: Reconciling dynamic watches trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T11:00:42.160251Z  INFO update_watches: controller::controllers::addon_config: Reconciled dynamic watches to match selectors: namespace=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import, cluster=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T11:00:42.160327Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T11:00:42.160364Z  INFO kube_runtime::controller: press ctrl+c to shut down gracefully
2025-03-27T11:00:42.166249Z  INFO reconciling object: controller::controllers::cluster: Reconciled dynamic watches: added namespace watch on default object.ref=Namespace.v1./default object.reason=object updated
2025-03-27T11:00:42.168323Z  INFO reconciling object:reconcile_config_sync: controller::controllers::addon_config: Updated fleet config map object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T11:00:42.264197Z  INFO reconciling object:reconcile_dynamic_watches:update_watches: controller::controllers::addon_config: Reconciling dynamic watches object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config" trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T11:00:42.264250Z  INFO reconciling object:reconcile_dynamic_watches:update_watches: controller::controllers::addon_config: Reconciled dynamic watches to match selectors: namespace=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import, cluster=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config" trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T11:00:42.606404Z  INFO reconciling object:reconcile_dynamic_watches:update_watches: controller::controllers::addon_config: Reconciling dynamic watches object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config" trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T11:00:42.606496Z  INFO reconciling object:reconcile_dynamic_watches:update_watches: controller::controllers::addon_config: Reconciled dynamic watches to match selectors: namespace=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import, cluster=cluster-api.cattle.io/rancher-auto-import=true,!cluster-api.cattle.io/disable-fleet-auto-import object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config" trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T11:00:42.610207Z  INFO reconciling object:reconcile_config_sync: controller::controllers::addon_config: Updated fleet config map object.ref=FleetAddonConfig.v1alpha1.addons.cluster.x-k8s.io/fleet-addon-config object.reason=object updated trace_id=00000000000000000000000000000000 name="fleet-addon-config"
2025-03-27T11:00:42.977808Z  INFO reconciling object:reconcile: controller::controllers::controller: Updated fleet object object.ref=Cluster.v1beta1.cluster.x-k8s.io/cluster1.default object.reason=object updated trace_id=00000000000000000000000000000000 name="cluster1" namespace="default"

What did you expect to happen?

CAPD cluster deletion should work.

How to reproduce it?

Steps mentioned above.

Rancher Turtles version

No response

Anything else you would like to add?

No response

Label(s) to be applied

/kind bug

Metadata

Metadata

Assignees

Labels

area/installationkind/bugSomething isn't workingkind/regressionCategorizes issue or PR as related to a regression from a prior release.

Type

No type

Projects

CAPI / Turtles

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions