I0424 12:19:44.529131 3549 start.go:68] Version: 7cb990c2 (6fd31b7e48fefb01d263cd19b733aca57ba2cf95) I0424 12:19:44.536542 3549 update.go:2769] Running: mount --rbind /run/secrets /rootfs/run/secrets I0424 12:19:44.551432 3549 update.go:2769] Running: mount --rbind /usr/bin /rootfs/run/machine-config-daemon-bin I0424 12:19:44.558200 3549 daemon.go:539] using appropriate binary for source=rhel-9 target=rhel-9 I0424 12:19:45.636099 3549 daemon.go:592] Invoking re-exec /run/bin/machine-config-daemon I0424 12:19:45.662730 3549 start.go:68] Version: 7cb990c2 (6fd31b7e48fefb01d263cd19b733aca57ba2cf95) I0424 12:19:45.663018 3549 update.go:2769] Running: systemctl daemon-reload I0424 12:19:47.489656 3549 rpm-ostree.go:68] Enabled workaround for bug 2111817 I0424 12:19:47.500126 3549 image_manager_helper.go:126] Linking rpm-ostree authfile to /etc/mco/internal-registry-pull-secret.json I0424 12:19:47.908333 3549 daemon.go:337] Booted osImageURL: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9dc537e553f8e9580004fdae353b71a82d1261ca661e6325f5a0253cd7c9b82d (9.6.20251203-0) d9690f9e2a655d861c2a90dc11e66a800cf568e011641a09ef6f3ddc33b9ad83 I0424 12:19:47.911042 3549 start.go:134] overriding kubernetes api to https://api-int.clusterpool419-52vmb.rhtap.devcluster.openshift.com:6443 I0424 12:19:47.912723 3549 metrics.go:92] Registering Prometheus metrics I0424 12:19:47.912826 3549 metrics.go:99] Starting metrics listener on 127.0.0.1:8797 I0424 12:19:48.075427 3549 simple_featuregate_reader.go:171] Starting feature-gate-detector I0424 12:19:48.076034 3549 writer.go:87] NodeWriter initialized with credentials from /var/lib/kubelet/kubeconfig I0424 12:19:48.086592 3549 start.go:220] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NewOLM NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PinnedImages PrivateHostedZoneAWS RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PlatformOperators ProcMountType SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI StreamingCollectionEncodingToJSON StreamingCollectionEncodingToProtobuf TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0424 12:19:48.086760 3549 start.go:222] Feature enabled: PinnedImages I0424 12:19:48.087082 3549 update.go:2814] "Starting to manage node: ip-10-0-94-193.ec2.internal" I0424 12:19:48.088112 3549 event.go:377] Event(v1.ObjectReference{Kind:"Node", Namespace:"openshift-machine-config-operator", Name:"ip-10-0-15-10.ec2.internal", UID:"e6c237b1-b8d8-4971-9651-8675c2ab8cba", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NewOLM", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PinnedImages", "PrivateHostedZoneAWS", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PlatformOperators", "ProcMountType", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StreamingCollectionEncodingToJSON", "StreamingCollectionEncodingToProtobuf", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0424 12:19:48.096142 3549 command_runner.go:24] Running captured: rpm-ostree status I0424 12:19:48.193191 3549 pinned_image_set.go:820] Starting PinnedImageSet Manager I0424 12:19:48.193681 3549 daemon.go:1811] State: idle Deployments: * ostree-unverified-registry:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9dc537e553f8e9580004fdae353b71a82d1261ca661e6325f5a0253cd7c9b82d Digest: sha256:6b8bfaf02530c869a8892c42b6b106b29ce3ca65184a8a659f290b022d6e8e02 Version: 9.6.20251203-0 (2025-12-03T23:33:08Z) I0424 12:19:48.194423 3549 coreos.go:53] CoreOS aleph version: mtime=2022-08-01 23:42:11 +0000 UTC { "container-image": { "image-digest": "sha256:1648888afe10ce3eba5b3274e1749c3e2ece6ff92038edbf840a47096409c98f", "image-labels": { "com.coreos.osname": "rhcos", "containers.bootc": "1", "coreos-assembler.image-config-checksum": "b444a32e2801642f1e41777fd51fa53304496c58a3a6b15e5964a1f86f866507", "io.openshift.build.version-display-names": "machine-os=Red Hat Enterprise Linux CoreOS", "io.openshift.build.versions": "machine-os=9.6.20251023-0", "org.opencontainers.image.revision": "4ac40108a2d1e8429cffc3095d0d2af0ca217b62", "org.opencontainers.image.source": "https://github.com/coreos/rhel-coreos-config", "org.opencontainers.image.version": "9.6.20251023-0", "ostree.bootable": "true", "ostree.commit": "6825ef8ca82681426788e6e7cdbdeb5deb2e05c9a3da4bbd812bbc75bfa5d471", "ostree.final-diffid": "sha256:12787d84fa137cd5649a9005efe98ec9d05ea46245fdc50aecb7dd007f2035b1", "ostree.linux": "5.14.0-570.58.1.el9_6.x86_64", "rpmostree.inputhash": "20445f11aa6ff8026bade3b18dae49892f70c3f79a4623145669789eee3c76f6" }, "image-name": "oci-archive:/rhcos-9.6.20251023-0-ostree.x86_64.ociarchive" }, "osbuild-version": "161", "ostree-commit": "6825ef8ca82681426788e6e7cdbdeb5deb2e05c9a3da4bbd812bbc75bfa5d471", "ref": "docker://ostree-image-signed:oci-archive:/rhcos-9.6.20251023-0-ostree.x86_64.ociarchive", "version": "9.6.20251023-0" } I0424 12:19:48.194522 3549 coreos.go:70] Ignition provisioning: time=2026-04-24T11:02:39Z I0424 12:19:48.194592 3549 command_runner.go:24] Running captured: journalctl --list-boots I0424 12:19:48.200834 3549 daemon.go:1820] journalctl --list-boots: IDX BOOT ID FIRST ENTRY LAST ENTRY -2 5873582a734e4302a2429a0558766454 Fri 2026-04-24 10:59:23 UTC Fri 2026-04-24 11:05:06 UTC -1 6979ad84ba5042769b0592521a8d2716 Fri 2026-04-24 11:05:25 UTC Fri 2026-04-24 11:35:17 UTC 0 d82082d71dba48bab2bc225fa50c2822 Fri 2026-04-24 12:17:37 UTC Fri 2026-04-24 12:19:48 UTC I0424 12:19:48.200894 3549 command_runner.go:24] Running captured: systemctl list-units --state=failed --no-legend I0424 12:19:48.207287 3549 daemon.go:1836] systemd service state: OK I0424 12:19:48.207333 3549 daemon.go:1389] Starting MachineConfigDaemon I0424 12:19:48.207391 3549 daemon.go:1396] Enabling Kubelet Healthz Monitor I0424 12:19:48.241127 3549 daemon.go:2988] Found 0 requested local packages in the booted deployment I0424 12:19:49.080498 3549 daemon.go:673] Node ip-10-0-94-193.ec2.internal is part of the control plane I0424 12:19:49.095179 3549 daemon.go:2041] Running: /run/machine-config-daemon-bin/nmstatectl persist-nic-names --root / --kargs-out /tmp/nmstate-kargs1649698540 --cleanup [2026-04-24T12:19:49Z INFO nmstatectl] Nmstate version: 2.2.54 [2026-04-24T12:19:49Z INFO nmstatectl::persist_nic] /etc/systemd/network/.nmstate-persist.stamp does not exist, no need to clean up I0424 12:19:49.127422 3549 daemon.go:1629] Previous boot ostree-finalize-staged.service appears successful I0424 12:19:49.127439 3549 daemon.go:1764] Current+desired config: rendered-master-4c703d72c93e387a77523277f64018ba I0424 12:19:49.127445 3549 daemon.go:1779] state: Done I0424 12:19:49.127463 3549 update.go:2769] Running: rpm-ostree cleanup -r Deployments unchanged. I0424 12:19:49.178817 3549 daemon.go:2239] Validating against current config rendered-master-4c703d72c93e387a77523277f64018ba I0424 12:19:49.178979 3549 daemon.go:2151] SSH key location ("/home/core/.ssh/authorized_keys.d/ignition") up-to-date! I0424 12:19:49.178990 3549 command_runner.go:24] Running captured: rpm-ostree kargs I0424 12:19:49.224772 3549 update.go:2814] "Validated on-disk state" I0424 12:19:49.516977 3549 daemon.go:2349] Completing update to target MachineConfig: rendered-master-4c703d72c93e387a77523277f64018ba I0424 12:19:59.522593 3549 update.go:2814] "Update completed for config rendered-master-4c703d72c93e387a77523277f64018ba and node has been successfully uncordoned" I0424 12:19:59.525238 3549 daemon.go:2374] In desired state MachineConfig: rendered-master-4c703d72c93e387a77523277f64018ba I0424 12:19:59.555394 3549 config_drift_monitor.go:246] Config Drift Monitor started I0424 12:19:59.555481 3549 daemon.go:768] Transitioned from state: -> Done I0424 12:20:48.242312 3549 certificate_writer.go:294] Certificate was synced from controllerconfig resourceVersion 24071 I0424 12:21:08.220738 3549 daemon.go:903] Starting health listener on 127.0.0.1:8798 I0424 12:21:29.534105 3549 certificate_writer.go:294] Certificate was synced from controllerconfig resourceVersion 39956 I0424 12:22:28.983514 3549 certificate_writer.go:294] Certificate was synced from controllerconfig resourceVersion 41220 I0424 12:22:30.128102 3549 certificate_writer.go:294] Certificate was synced from controllerconfig resourceVersion 41229 I0424 12:23:04.069875 3549 certificate_writer.go:294] Certificate was synced from controllerconfig resourceVersion 41845 I0424 12:23:04.183866 3549 certificate_writer.go:294] Certificate was synced from controllerconfig resourceVersion 41853 I0424 12:23:04.279632 3549 certificate_writer.go:294] Certificate was synced from controllerconfig resourceVersion 41860 I0424 12:23:05.815315 3549 certificate_writer.go:294] Certificate was synced from controllerconfig resourceVersion 41932 I0424 12:27:28.444828 3549 command_runner.go:24] Running captured: rpm-ostree kargs I0424 12:27:28.625279 3549 daemon.go:966] Preflight config drift check successful (took 180.452192ms) I0424 12:27:28.632599 3549 config_drift_monitor.go:255] Config Drift Monitor has shut down I0424 12:27:28.650926 3549 update.go:2836] Adding SIGTERM protection I0424 12:27:28.688198 3549 update.go:1119] Checking Reconcilable for config rendered-master-4c703d72c93e387a77523277f64018ba to rendered-master-66fc81b3e21b61e94d4687244e2736a9 I0424 12:27:28.731292 3549 update.go:2814] "Starting update from rendered-master-4c703d72c93e387a77523277f64018ba to rendered-master-66fc81b3e21b61e94d4687244e2736a9: &{osUpdate:false kargs:false fips:false passwd:false files:true units:false kernelType:false extensions:false oclEnabled:false revertFromOCL:false}" I0424 12:27:28.739109 3549 update.go:771] Calculating node disruption actions I0424 12:27:28.739141 3549 update.go:653] NodeDisruptionPolicy [{Restart 0xc000a37300} {Restart 0xc000a37310}] found for diff file /etc/pki/ca-trust/source/anchors/openshift-config-user-ca-bundle.crt I0424 12:27:28.739157 3549 update.go:800] Calculated node disruption actions: I0424 12:27:28.739162 3549 update.go:806] Restart - coreos-update-ca-trust.service I0424 12:27:28.739167 3549 update.go:806] Restart - crio.service I0424 12:27:28.742962 3549 drain.go:132] Checking drain required for node disruption actions I0424 12:27:28.742978 3549 update.go:1199] Drain calculated for node disruption: false for config rendered-master-66fc81b3e21b61e94d4687244e2736a9 I0424 12:27:28.774145 3549 update.go:1230] Changes do not require drain, skipping. I0424 12:27:28.804904 3549 update.go:1906] Updating files I0424 12:27:28.804918 3549 file_writers.go:234] Writing file "/usr/local/bin/nm-clean-initrd-state.sh" I0424 12:27:28.829686 3549 file_writers.go:234] Writing file "/etc/NetworkManager/conf.d/01-ipv6.conf" I0424 12:27:28.840243 3549 file_writers.go:234] Writing file "/etc/NetworkManager/conf.d/20-keyfiles.conf" I0424 12:27:28.849711 3549 file_writers.go:234] Writing file "/etc/pki/ca-trust/source/anchors/openshift-config-user-ca-bundle.crt" I0424 12:27:28.860050 3549 file_writers.go:234] Writing file "/etc/kubernetes/apiserver-url.env" I0424 12:27:28.868971 3549 file_writers.go:234] Writing file "/etc/audit/rules.d/mco-audit-quiet-containers.rules" I0424 12:27:28.878804 3549 file_writers.go:234] Writing file "/etc/NetworkManager/dispatcher.d/99-esp-offload" I0424 12:27:28.887299 3549 file_writers.go:234] Writing file "/etc/tmpfiles.d/cleanup-cni.conf" I0424 12:27:28.896036 3549 file_writers.go:234] Writing file "/usr/local/bin/configure-ovs.sh" I0424 12:27:28.905902 3549 file_writers.go:234] Writing file "/etc/containers/storage.conf" I0424 12:27:28.922209 3549 file_writers.go:234] Writing file "/etc/docker/certs.d/.create" I0424 12:27:28.932886 3549 file_writers.go:234] Writing file "/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" I0424 12:27:28.948919 3549 file_writers.go:234] Writing file "/etc/mco/proxy.env" I0424 12:27:28.976687 3549 file_writers.go:234] Writing file "/etc/systemd/system.conf.d/10-default-env-godebug.conf" I0424 12:27:29.022445 3549 file_writers.go:234] Writing file "/etc/NetworkManager/dispatcher.d/99-gcp-disable-idpf-tx-checksum-off" I0424 12:27:29.054161 3549 file_writers.go:234] Writing file "/etc/modules-load.d/iptables.conf" I0424 12:27:29.070061 3549 file_writers.go:234] Writing file "/etc/node-sizing-enabled.env" I0424 12:27:29.079266 3549 file_writers.go:234] Writing file "/usr/local/sbin/dynamic-system-reserved-calc.sh" I0424 12:27:29.088182 3549 file_writers.go:234] Writing file "/etc/systemd/system.conf.d/kubelet-cgroups.conf" I0424 12:27:29.097408 3549 file_writers.go:234] Writing file "/etc/systemd/system/kubelet.service.d/20-logging.conf" I0424 12:27:29.107606 3549 file_writers.go:234] Writing file "/etc/NetworkManager/conf.d/sdn.conf" I0424 12:27:29.118377 3549 file_writers.go:234] Writing file "/usr/local/bin/nmstate-configuration.sh" I0424 12:27:29.126854 3549 file_writers.go:234] Writing file "/etc/nmstate/nmstate.conf" I0424 12:27:29.135993 3549 file_writers.go:234] Writing file "/etc/NetworkManager/dispatcher.d/pre-up.d/10-ofport-request.sh" I0424 12:27:29.145723 3549 file_writers.go:234] Writing file "/etc/machine-config-daemon/generate_podman_policy_args.sh" I0424 12:27:29.155199 3549 file_writers.go:234] Writing file "/var/lib/kubelet/config.json" I0424 12:27:29.165741 3549 file_writers.go:234] Writing file "/etc/sysctl.d/arp.conf" I0424 12:27:29.175463 3549 file_writers.go:234] Writing file "/etc/sysctl.d/gc-thresh.conf" I0424 12:27:29.184149 3549 file_writers.go:234] Writing file "/etc/sysctl.d/inotify.conf" I0424 12:27:29.192587 3549 file_writers.go:234] Writing file "/etc/sysctl.d/enable-userfaultfd.conf" I0424 12:27:29.201371 3549 file_writers.go:234] Writing file "/etc/sysctl.d/vm-max-map.conf" I0424 12:27:29.209990 3549 file_writers.go:234] Writing file "/usr/local/bin/aws-kubelet-nodename" I0424 12:27:29.218409 3549 file_writers.go:234] Writing file "/usr/local/bin/aws-kubelet-providerid" I0424 12:27:29.226571 3549 file_writers.go:234] Writing file "/usr/local/bin/mco-hostname" I0424 12:27:29.234944 3549 file_writers.go:234] Writing file "/usr/local/bin/recover-kubeconfig.sh" I0424 12:27:29.243550 3549 file_writers.go:234] Writing file "/etc/kubernetes/kubelet-plugins/volume/exec/.dummy" I0424 12:27:29.250924 3549 file_writers.go:234] Writing file "/etc/NetworkManager/dispatcher.d/99-vsphere-disable-tx-udp-tnl" I0424 12:27:29.259143 3549 file_writers.go:234] Writing file "/usr/local/bin/ipsec-connect-wait.sh" I0424 12:27:29.267149 3549 file_writers.go:234] Writing file "/usr/local/bin/wait-for-primary-ip.sh" I0424 12:27:29.276278 3549 file_writers.go:234] Writing file "/etc/containers/registries.conf" I0424 12:27:29.286214 3549 file_writers.go:234] Writing file "/etc/crio/crio.conf.d/00-default" I0424 12:27:29.294549 3549 file_writers.go:234] Writing file "/etc/machine-config-daemon/policy-for-old-podman.json" I0424 12:27:29.303985 3549 file_writers.go:234] Writing file "/etc/containers/policy.json" I0424 12:27:29.313582 3549 file_writers.go:234] Writing file "/etc/kubernetes/cloud.conf" I0424 12:27:29.321933 3549 file_writers.go:234] Writing file "/etc/kubernetes/crio-metrics-proxy.cfg" I0424 12:27:29.330577 3549 file_writers.go:234] Writing file "/etc/kubernetes/manifests/criometricsproxy.yaml" I0424 12:27:29.339065 3549 file_writers.go:234] Writing file "/etc/kubernetes/kubelet.conf" I0424 12:27:29.350570 3549 file_writers.go:234] Writing file "/usr/local/bin/kubenswrapper" I0424 12:27:29.361638 3549 file_writers.go:294] Writing systemd unit "NetworkManager-clean-initrd-state.service" I0424 12:27:29.368730 3549 file_writers.go:307] Disabling systemd unit NetworkManager-clean-initrd-state.service before re-writing it I0424 12:27:30.355712 3549 file_writers.go:294] Writing systemd unit "aws-kubelet-nodename.service" I0424 12:27:30.374283 3549 file_writers.go:307] Disabling systemd unit aws-kubelet-nodename.service before re-writing it I0424 12:27:31.162867 3549 file_writers.go:294] Writing systemd unit "aws-kubelet-providerid.service" I0424 12:27:31.176289 3549 file_writers.go:307] Disabling systemd unit aws-kubelet-providerid.service before re-writing it I0424 12:27:32.099756 3549 file_writers.go:208] Writing systemd unit dropin "01-kubens.conf" I0424 12:27:32.101874 3549 file_writers.go:194] Dropin for 10-mco-default-env.conf has no content, skipping write I0424 12:27:32.101892 3549 file_writers.go:201] Removing "/etc/systemd/system/crio.service.d/10-mco-default-env.conf", updated file has zero length I0424 12:27:32.101913 3549 file_writers.go:208] Writing systemd unit dropin "10-mco-profile-unix-socket.conf" I0424 12:27:32.103992 3549 file_writers.go:208] Writing systemd unit dropin "05-mco-ordering.conf" I0424 12:27:32.106793 3549 file_writers.go:208] Writing systemd unit dropin "10-mco-default-madv.conf" I0424 12:27:32.969624 3549 update.go:2224] Preset systemd unit "crio.service" I0424 12:27:32.969653 3549 file_writers.go:208] Writing systemd unit dropin "mco-disabled.conf" I0424 12:27:32.982269 3549 update.go:2261] Could not reset unit preset for docker.socket, skipping. (Error msg: error running preset on unit: Failed to preset unit: Unit file docker.socket does not exist. ) I0424 12:27:32.982294 3549 file_writers.go:294] Writing systemd unit "firstboot-osupdate.target" I0424 12:27:32.989443 3549 file_writers.go:307] Disabling systemd unit firstboot-osupdate.target before re-writing it I0424 12:27:33.913406 3549 file_writers.go:208] Writing systemd unit dropin "01-after-configure-ovs.conf" I0424 12:27:33.925639 3549 update.go:2261] Could not reset unit preset for ipsec.service, skipping. (Error msg: error running preset on unit: Failed to preset unit: Unit file ipsec.service does not exist. ) I0424 12:27:33.925662 3549 file_writers.go:294] Writing systemd unit "kubelet-auto-node-size.service" I0424 12:27:33.932670 3549 file_writers.go:307] Disabling systemd unit kubelet-auto-node-size.service before re-writing it I0424 12:27:34.774012 3549 file_writers.go:294] Writing systemd unit "kubelet-dependencies.target" I0424 12:27:35.604127 3549 update.go:2224] Preset systemd unit "kubelet-dependencies.target" I0424 12:27:35.604156 3549 file_writers.go:208] Writing systemd unit dropin "20-node-env.conf" I0424 12:27:35.606174 3549 file_writers.go:208] Writing systemd unit dropin "01-kubens.conf" I0424 12:27:35.607965 3549 file_writers.go:194] Dropin for 10-mco-default-env.conf has no content, skipping write I0424 12:27:35.607979 3549 file_writers.go:201] Removing "/etc/systemd/system/kubelet.service.d/10-mco-default-env.conf", updated file has zero length I0424 12:27:35.607997 3549 file_writers.go:208] Writing systemd unit dropin "10-mco-default-madv.conf" I0424 12:27:35.609817 3549 file_writers.go:294] Writing systemd unit "kubelet.service" I0424 12:27:35.628203 3549 file_writers.go:307] Disabling systemd unit kubelet.service before re-writing it I0424 12:27:36.536932 3549 file_writers.go:294] Writing systemd unit "kubens.service" I0424 12:27:36.550124 3549 file_writers.go:294] Writing systemd unit "machine-config-daemon-firstboot.service" I0424 12:27:36.558373 3549 file_writers.go:307] Disabling systemd unit machine-config-daemon-firstboot.service before re-writing it I0424 12:27:37.314470 3549 file_writers.go:294] Writing systemd unit "machine-config-daemon-pull.service" I0424 12:27:37.326823 3549 file_writers.go:307] Disabling systemd unit machine-config-daemon-pull.service before re-writing it I0424 12:27:38.164030 3549 file_writers.go:294] Writing systemd unit "nmstate-configuration.service" I0424 12:27:38.174468 3549 file_writers.go:307] Disabling systemd unit nmstate-configuration.service before re-writing it I0424 12:27:38.992828 3549 file_writers.go:294] Writing systemd unit "nmstate.service" I0424 12:27:39.014012 3549 file_writers.go:307] Disabling systemd unit nmstate.service before re-writing it I0424 12:27:39.857546 3549 file_writers.go:294] Writing systemd unit "node-valid-hostname.service" I0424 12:27:39.868485 3549 file_writers.go:307] Disabling systemd unit node-valid-hostname.service before re-writing it I0424 12:27:40.626794 3549 file_writers.go:294] Writing systemd unit "nodeip-configuration.service" I0424 12:27:40.640596 3549 file_writers.go:294] Writing systemd unit "ovs-configuration.service" I0424 12:27:40.646812 3549 file_writers.go:307] Disabling systemd unit ovs-configuration.service before re-writing it I0424 12:27:41.440640 3549 file_writers.go:208] Writing systemd unit dropin "10-ovs-vswitchd-restart.conf" I0424 12:27:42.228892 3549 update.go:2224] Preset systemd unit "ovs-vswitchd.service" I0424 12:27:42.228989 3549 file_writers.go:208] Writing systemd unit dropin "10-ovsdb-restart.conf" I0424 12:27:42.232443 3549 file_writers.go:194] Dropin for 10-mco-default-env.conf has no content, skipping write I0424 12:27:42.232466 3549 file_writers.go:201] Removing "/etc/systemd/system/rpm-ostreed.service.d/10-mco-default-env.conf", updated file has zero length I0424 12:27:42.232493 3549 file_writers.go:208] Writing systemd unit dropin "mco-controlplane-nice.conf" I0424 12:27:42.988590 3549 update.go:2224] Preset systemd unit "rpm-ostreed.service" I0424 12:27:42.988684 3549 file_writers.go:294] Writing systemd unit "wait-for-ipsec-connect.service" I0424 12:27:42.999142 3549 file_writers.go:307] Disabling systemd unit wait-for-ipsec-connect.service before re-writing it I0424 12:27:43.781679 3549 file_writers.go:294] Writing systemd unit "wait-for-primary-ip.service" I0424 12:27:43.794765 3549 file_writers.go:307] Disabling systemd unit wait-for-primary-ip.service before re-writing it I0424 12:27:44.585156 3549 file_writers.go:208] Writing systemd unit dropin "mco-disabled.conf" I0424 12:27:44.600240 3549 update.go:2261] Could not reset unit preset for zincati.service, skipping. (Error msg: error running preset on unit: Failed to preset unit: Unit file zincati.service does not exist. ) I0424 12:27:44.600264 3549 file_writers.go:294] Writing systemd unit "kubelet-cleanup.service" I0424 12:27:44.607707 3549 file_writers.go:307] Disabling systemd unit kubelet-cleanup.service before re-writing it I0424 12:27:46.155722 3549 update.go:2202] Enabled systemd units: [NetworkManager-clean-initrd-state.service aws-kubelet-nodename.service aws-kubelet-providerid.service firstboot-osupdate.target kubelet-auto-node-size.service kubelet.service machine-config-daemon-firstboot.service machine-config-daemon-pull.service nmstate-configuration.service nmstate.service node-valid-hostname.service openvswitch.service ovs-configuration.service ovsdb-server.service wait-for-ipsec-connect.service wait-for-primary-ip.service kubelet-cleanup.service] I0424 12:27:46.914249 3549 update.go:2213] Disabled systemd units [kubens.service nodeip-configuration.service] I0424 12:27:46.915195 3549 update.go:1969] Deleting stale data I0424 12:27:46.915346 3549 update.go:2399] updating the permission of the kubeconfig to: 0o600 I0424 12:27:46.915407 3549 update.go:2365] Checking if absent users need to be disconfigured I0424 12:27:46.942786 3549 update.go:2814] "Performing post config change action: Restart for config rendered-master-66fc81b3e21b61e94d4687244e2736a9" I0424 12:27:46.944823 3549 update.go:2769] Running: systemctl restart coreos-update-ca-trust.service I0424 12:27:47.774327 3549 update.go:2814] "coreos-update-ca-trust.service service restarted successfully!" I0424 12:27:47.776347 3549 update.go:2814] "Performing post config change action: Restart for config rendered-master-66fc81b3e21b61e94d4687244e2736a9" I0424 12:27:47.778025 3549 update.go:2769] Running: systemctl restart crio.service W0424 12:27:48.225708 3549 daemon.go:1432] Got an error from auxiliary tools: kubelet health check has failed 1 times: Get "http://localhost:10248/healthz": dial tcp [::1]:10248: connect: connection refused W0424 12:28:18.226861 3549 daemon.go:1432] Got an error from auxiliary tools: kubelet health check has failed 2 times: Get "http://localhost:10248/healthz": dial tcp [::1]:10248: connect: connection refused W0424 12:28:48.227518 3549 daemon.go:1432] Got an error from auxiliary tools: kubelet health check has failed 3 times: Get "http://localhost:10248/healthz": dial tcp [::1]:10248: connect: connection refused I0424 12:29:18.073772 3549 update.go:2814] "crio.service service restarted successfully!" I0424 12:29:18.081646 3549 daemon.go:1629] Previous boot ostree-finalize-staged.service appears successful I0424 12:29:18.081665 3549 daemon.go:1770] Current config: rendered-master-4c703d72c93e387a77523277f64018ba I0424 12:29:18.081672 3549 daemon.go:1771] Desired config: rendered-master-66fc81b3e21b61e94d4687244e2736a9 I0424 12:29:18.081677 3549 daemon.go:1779] state: Done I0424 12:29:18.101918 3549 daemon.go:2349] Completing update to target MachineConfig: rendered-master-66fc81b3e21b61e94d4687244e2736a9 W0424 12:29:18.229151 3549 daemon.go:1432] Got an error from auxiliary tools: kubelet health check has failed 4 times: Get "http://localhost:10248/healthz": dial tcp [::1]:10248: connect: connection refused I0424 12:29:28.124495 3549 update.go:2814] "Update completed for config rendered-master-66fc81b3e21b61e94d4687244e2736a9 and node has been successfully uncordoned" I0424 12:29:28.163290 3549 daemon.go:2374] In desired state MachineConfig: rendered-master-66fc81b3e21b61e94d4687244e2736a9 I0424 12:29:28.272565 3549 config_drift_monitor.go:246] Config Drift Monitor started I0424 12:29:28.362292 3549 update.go:2845] Removing SIGTERM protection