Jun 03 15:32:07.715313 ip-10-0-129-205 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 15:32:07.715324 ip-10-0-129-205 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 15:32:07.715334 ip-10-0-129-205 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 15:32:07.715644 ip-10-0-129-205 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 15:32:17.798757 ip-10-0-129-205 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 15:32:17.798771 ip-10-0-129-205 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 40560abd99d4410fbe0c695da45dbc24 -- Jun 03 15:35:00.533630 ip-10-0-129-205 systemd[1]: Starting Kubernetes Kubelet... Jun 03 15:35:00.970449 ip-10-0-129-205 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:35:00.970449 ip-10-0-129-205 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 15:35:00.970449 ip-10-0-129-205 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:35:00.970449 ip-10-0-129-205 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 15:35:00.970449 ip-10-0-129-205 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:35:00.972272 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.972194 2568 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 15:35:00.978904 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978856 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:35:00.978904 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978901 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:35:00.978904 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978905 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:35:00.978904 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978909 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978913 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978916 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978919 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978922 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978926 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978929 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978931 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978934 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978938 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978943 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978946 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978949 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978952 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978955 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978958 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978961 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978964 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978966 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:35:00.979070 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978969 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978971 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978974 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978976 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978979 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978986 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978989 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978991 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978995 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978997 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.978999 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979002 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979005 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979007 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979009 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979013 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979016 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979018 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979021 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979024 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:35:00.979537 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979027 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979029 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979033 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979036 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979038 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979041 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979043 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979061 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979065 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979068 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979071 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979074 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979077 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979081 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979083 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979086 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979088 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979091 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979094 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979096 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:35:00.980022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979099 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979101 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979104 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979107 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979109 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979112 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979115 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979118 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979121 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979124 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979127 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979129 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979132 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979135 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979137 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979141 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979144 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979147 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979149 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:35:00.980564 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979152 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979156 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979160 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979163 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979165 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979558 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979564 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979567 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979570 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979572 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979575 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979578 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979580 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979583 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979586 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979588 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979591 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979594 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979596 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:35:00.981022 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979599 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979604 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979608 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979612 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979615 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979619 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979622 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979625 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979628 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979631 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979634 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979637 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979641 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979643 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979646 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979648 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979651 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979654 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979656 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:35:00.981493 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979659 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979661 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979664 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979666 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979669 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979671 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979674 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979677 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979679 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979682 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979684 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979687 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979689 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979692 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979695 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979698 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979700 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979703 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979705 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979708 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:35:00.981959 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979711 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979714 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979716 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979719 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979722 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979725 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979728 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979730 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979733 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979735 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979738 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979740 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979742 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979745 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979747 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979750 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979752 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979755 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979757 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979760 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:35:00.982472 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979762 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979765 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979768 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979771 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979773 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979776 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979778 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979781 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979784 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979786 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979789 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979792 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.979794 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979864 2568 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979871 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979877 2568 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979882 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979886 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979890 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979894 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979898 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 15:35:00.982961 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979901 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979904 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979907 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979911 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979914 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979917 2568 flags.go:64] FLAG: --cgroup-root="" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979919 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979922 2568 flags.go:64] FLAG: --client-ca-file="" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979925 2568 flags.go:64] FLAG: --cloud-config="" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979928 2568 flags.go:64] FLAG: --cloud-provider="external" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979931 2568 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979935 2568 flags.go:64] FLAG: --cluster-domain="" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979937 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979941 2568 flags.go:64] FLAG: --config-dir="" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979944 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979947 2568 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979951 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979954 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979957 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979961 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979964 2568 flags.go:64] FLAG: --contention-profiling="false" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979967 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979970 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979973 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979976 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 15:35:00.983495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979980 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979983 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979986 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979988 2568 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979992 2568 flags.go:64] FLAG: --enable-server="true" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.979995 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980000 2568 flags.go:64] FLAG: --event-burst="100" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980003 2568 flags.go:64] FLAG: --event-qps="50" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980006 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980009 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980012 2568 flags.go:64] FLAG: --eviction-hard="" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980015 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980018 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980021 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980025 2568 flags.go:64] FLAG: --eviction-soft="" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980028 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980031 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980034 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980037 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980040 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980043 2568 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980046 2568 flags.go:64] FLAG: --feature-gates="" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980050 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980055 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980058 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 15:35:00.984125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980062 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980064 2568 flags.go:64] FLAG: --healthz-port="10248" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980067 2568 flags.go:64] FLAG: --help="false" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980070 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-129-205.ec2.internal" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980073 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980076 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980079 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980082 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980086 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980088 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980091 2568 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980094 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980097 2568 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980100 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980103 2568 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980106 2568 flags.go:64] FLAG: --kube-reserved="" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980109 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980112 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980115 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980118 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980121 2568 flags.go:64] FLAG: --lock-file="" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980124 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980127 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980129 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 15:35:00.984752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980135 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980137 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980140 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980143 2568 flags.go:64] FLAG: --logging-format="text" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980146 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980149 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980153 2568 flags.go:64] FLAG: --manifest-url="" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980156 2568 flags.go:64] FLAG: --manifest-url-header="" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980161 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980164 2568 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980168 2568 flags.go:64] FLAG: --max-pods="110" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980171 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980174 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980177 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980180 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980183 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980186 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980189 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980196 2568 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980199 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980202 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980206 2568 flags.go:64] FLAG: --pod-cidr="" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980209 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 15:35:00.985381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980214 2568 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980217 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980220 2568 flags.go:64] FLAG: --pods-per-core="0" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980222 2568 flags.go:64] FLAG: --port="10250" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980226 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980229 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0de28524dffa88204" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980232 2568 flags.go:64] FLAG: --qos-reserved="" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980235 2568 flags.go:64] FLAG: --read-only-port="10255" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980238 2568 flags.go:64] FLAG: --register-node="true" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980241 2568 flags.go:64] FLAG: --register-schedulable="true" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980244 2568 flags.go:64] FLAG: --register-with-taints="" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980247 2568 flags.go:64] FLAG: --registry-burst="10" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980250 2568 flags.go:64] FLAG: --registry-qps="5" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980253 2568 flags.go:64] FLAG: --reserved-cpus="" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980256 2568 flags.go:64] FLAG: --reserved-memory="" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980261 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980264 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980267 2568 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980270 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980273 2568 flags.go:64] FLAG: --runonce="false" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980276 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980278 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980281 2568 flags.go:64] FLAG: --seccomp-default="false" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980284 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980287 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980290 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 15:35:00.985966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980293 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980295 2568 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980298 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980301 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980304 2568 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980307 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980310 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980313 2568 flags.go:64] FLAG: --system-cgroups="" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980316 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980321 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980327 2568 flags.go:64] FLAG: --tls-cert-file="" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980330 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980334 2568 flags.go:64] FLAG: --tls-min-version="" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980336 2568 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980339 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980342 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980345 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980348 2568 flags.go:64] FLAG: --v="2" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980352 2568 flags.go:64] FLAG: --version="false" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980356 2568 flags.go:64] FLAG: --vmodule="" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980372 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.980379 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980486 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980491 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:35:00.986700 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980494 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980497 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980500 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980502 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980505 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980508 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980510 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980513 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980515 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980518 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980520 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980522 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980525 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980527 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980534 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980537 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980539 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980544 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980549 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:35:00.987306 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980552 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980555 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980558 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980561 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980563 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980566 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980569 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980572 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980575 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980577 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980581 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980584 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980586 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980589 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980591 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980594 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980596 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980599 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980602 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980604 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:35:00.987799 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980606 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980609 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980611 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980614 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980616 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980619 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980621 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980624 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980627 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980629 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980632 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980635 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980637 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980640 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980642 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980645 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980648 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980651 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980655 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980657 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:35:00.988323 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980660 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980663 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980666 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980668 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980671 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980674 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980676 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980679 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980681 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980684 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980686 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980689 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980691 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980694 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980696 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980699 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980701 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980704 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980706 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980709 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:35:00.988856 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980712 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980715 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980717 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980720 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.980723 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.981196 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.987380 2568 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.987487 2568 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987535 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987540 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987544 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987547 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987550 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987552 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987556 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:35:00.989353 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987558 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987561 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987564 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987566 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987569 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987573 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987577 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987581 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987584 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987587 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987590 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987592 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987595 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987597 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987601 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987603 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987606 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987609 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987612 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987614 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:35:00.989780 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987617 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987619 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987622 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987625 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987628 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987631 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987634 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987636 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987639 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987641 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987644 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987647 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987649 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987652 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987654 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987657 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987659 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987662 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987666 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987669 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:35:00.990257 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987672 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987675 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987678 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987680 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987683 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987686 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987688 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987691 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987694 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987697 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987699 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987702 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987704 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987707 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987710 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987712 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987715 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987718 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987720 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:35:00.990767 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987723 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987726 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987728 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987731 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987734 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987736 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987739 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987741 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987744 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987746 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987749 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987751 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987754 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987756 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987759 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987761 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987764 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987766 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987769 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:35:00.991242 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987771 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.987776 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987903 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987909 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987913 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987916 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987919 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987921 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987924 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987927 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987930 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987933 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987936 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987939 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987942 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:35:00.991735 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987944 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987947 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987949 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987952 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987954 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987957 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987959 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987962 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987964 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987967 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987970 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987972 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987975 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987977 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987980 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987982 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987986 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987990 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987993 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987996 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:35:00.992118 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.987999 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988002 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988004 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988007 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988010 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988012 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988015 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988018 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988020 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988023 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988029 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988031 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988034 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988036 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988039 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988041 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988044 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988046 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988049 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988051 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:35:00.992639 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988054 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988056 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988059 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988061 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988063 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988066 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988068 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988071 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988073 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988076 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988078 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988081 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988083 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988086 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988088 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988090 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988093 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988096 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988098 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988101 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:35:00.993122 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988103 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988106 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988109 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988112 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988114 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988117 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988120 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988122 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988125 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988127 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988129 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988132 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:00.988134 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.988139 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.988799 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 15:35:00.993704 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.991519 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 15:35:00.994109 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.992597 2568 server.go:1019] "Starting client certificate rotation" Jun 03 15:35:00.994109 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.992695 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:35:00.994109 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:00.992726 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:35:01.017707 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.017691 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:35:01.020103 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.020086 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:35:01.037282 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.037262 2568 log.go:25] "Validated CRI v1 runtime API" Jun 03 15:35:01.042705 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.042691 2568 log.go:25] "Validated CRI v1 image API" Jun 03 15:35:01.045392 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.045378 2568 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 15:35:01.048162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.048143 2568 fs.go:135] Filesystem UUIDs: map[5a77217f-3d41-494a-9ad3-cea311a186b3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cf660cda-f7f9-4b8f-8b4b-2de387c3d75f:/dev/nvme0n1p3] Jun 03 15:35:01.048222 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.048163 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 15:35:01.050917 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.050890 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:35:01.052457 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.052332 2568 manager.go:217] Machine: {Timestamp:2026-06-03 15:35:01.051843976 +0000 UTC m=+0.401184389 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100879 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec273d566a87a74756adf0b123bb5f58 SystemUUID:ec273d56-6a87-a747-56ad-f0b123bb5f58 BootID:40560abd-99d4-410f-be0c-695da45dbc24 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:c6:55:8e:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:c6:55:8e:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:f3:f5:ea:b1:dc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 15:35:01.053095 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.053084 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 15:35:01.053202 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.053190 2568 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 15:35:01.056176 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.056150 2568 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 15:35:01.056304 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.056179 2568 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 15:35:01.056353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.056312 2568 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 15:35:01.056353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.056320 2568 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 15:35:01.056353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.056328 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:35:01.057211 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.057201 2568 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:35:01.058760 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.058751 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:35:01.058867 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.058858 2568 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 15:35:01.061512 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.061501 2568 kubelet.go:491] "Attempting to sync node with API server" Jun 03 15:35:01.061551 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.061517 2568 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 15:35:01.061551 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.061531 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 15:35:01.061551 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.061540 2568 kubelet.go:397] "Adding apiserver pod source" Jun 03 15:35:01.061551 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.061548 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 15:35:01.062736 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.062721 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:35:01.062799 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.062748 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:35:01.065355 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.065338 2568 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 15:35:01.067567 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.067554 2568 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 15:35:01.070056 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070039 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 15:35:01.070121 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070061 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 15:35:01.070121 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070068 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 15:35:01.070121 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070074 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 15:35:01.070121 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070083 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 15:35:01.070121 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070094 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 15:35:01.070121 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070101 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 15:35:01.070121 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070106 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 15:35:01.070121 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070113 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 15:35:01.070121 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070120 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 15:35:01.070472 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070129 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 15:35:01.070472 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.070134 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 15:35:01.071193 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.071178 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 15:35:01.071193 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.071193 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 15:35:01.074295 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.074270 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 15:35:01.074400 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.074283 2568 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 15:35:01.074400 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.074299 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 15:35:01.074655 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.074634 2568 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 15:35:01.074739 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.074680 2568 server.go:1295] "Started kubelet" Jun 03 15:35:01.074786 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.074743 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 15:35:01.075149 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.075109 2568 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 15:35:01.075195 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.075184 2568 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 15:35:01.075961 ip-10-0-129-205 systemd[1]: Started Kubernetes Kubelet. Jun 03 15:35:01.076186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.076168 2568 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 15:35:01.076437 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.076357 2568 server.go:317] "Adding debug handlers to kubelet server" Jun 03 15:35:01.083818 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.083799 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 15:35:01.083902 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.083816 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 15:35:01.083902 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.083826 2568 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 15:35:01.083902 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.083877 2568 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 15:35:01.083902 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.083901 2568 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 15:35:01.084097 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.083985 2568 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 15:35:01.084097 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.084044 2568 reconstruct.go:97] "Volume reconstruction finished" Jun 03 15:35:01.084097 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.084051 2568 reconciler.go:26] "Reconciler: start to sync state" Jun 03 15:35:01.084541 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.084506 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 15:35:01.084541 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.084526 2568 factory.go:55] Registering systemd factory Jun 03 15:35:01.084541 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.084535 2568 factory.go:223] Registration of the systemd container factory successfully Jun 03 15:35:01.084720 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.084641 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.084806 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.084789 2568 factory.go:153] Registering CRI-O factory Jun 03 15:35:01.084857 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.084811 2568 factory.go:223] Registration of the crio container factory successfully Jun 03 15:35:01.084857 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.084828 2568 factory.go:103] Registering Raw factory Jun 03 15:35:01.084857 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.084846 2568 manager.go:1196] Started watching for new ooms in manager Jun 03 15:35:01.085945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.085926 2568 manager.go:319] Starting recovery of all containers Jun 03 15:35:01.089753 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.089723 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 15:35:01.090182 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.090158 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 15:35:01.091560 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.090219 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-205.ec2.internal.18b59c22d2d14276 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-205.ec2.internal,UID:ip-10-0-129-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-205.ec2.internal,},FirstTimestamp:2026-06-03 15:35:01.074649718 +0000 UTC m=+0.423990138,LastTimestamp:2026-06-03 15:35:01.074649718 +0000 UTC m=+0.423990138,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-205.ec2.internal,}" Jun 03 15:35:01.092015 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.091981 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 15:35:01.096043 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.096027 2568 manager.go:324] Recovery completed Jun 03 15:35:01.099826 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.099813 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:35:01.102133 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.102107 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:35:01.102193 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.102148 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:35:01.102193 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.102160 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:35:01.102642 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.102614 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 15:35:01.102642 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.102626 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 15:35:01.102642 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.102640 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:35:01.104822 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.104753 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-205.ec2.internal.18b59c22d4749f1c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-205.ec2.internal,UID:ip-10-0-129-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-205.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-205.ec2.internal,},FirstTimestamp:2026-06-03 15:35:01.10213302 +0000 UTC m=+0.451473436,LastTimestamp:2026-06-03 15:35:01.10213302 +0000 UTC m=+0.451473436,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-205.ec2.internal,}" Jun 03 15:35:01.105510 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.105498 2568 policy_none.go:49] "None policy: Start" Jun 03 15:35:01.105575 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.105514 2568 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 15:35:01.105575 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.105525 2568 state_mem.go:35] "Initializing new in-memory state store" Jun 03 15:35:01.115050 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.114986 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-205.ec2.internal.18b59c22d474f25c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-205.ec2.internal,UID:ip-10-0-129-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-205.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-205.ec2.internal,},FirstTimestamp:2026-06-03 15:35:01.102154332 +0000 UTC m=+0.451494745,LastTimestamp:2026-06-03 15:35:01.102154332 +0000 UTC m=+0.451494745,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-205.ec2.internal,}" Jun 03 15:35:01.123923 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.123838 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-205.ec2.internal.18b59c22d4751731 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-205.ec2.internal,UID:ip-10-0-129-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-205.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-205.ec2.internal,},FirstTimestamp:2026-06-03 15:35:01.102163761 +0000 UTC m=+0.451504174,LastTimestamp:2026-06-03 15:35:01.102163761 +0000 UTC m=+0.451504174,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-205.ec2.internal,}" Jun 03 15:35:01.134959 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.134943 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w66fp" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.138892 2568 manager.go:341] "Starting Device Plugin manager" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.138931 2568 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.138940 2568 server.go:85] "Starting device plugin registration server" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.139119 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.139129 2568 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.139195 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.139260 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.139266 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.139843 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.139872 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.147957 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.143317 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w66fp" Jun 03 15:35:01.210695 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.210675 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 15:35:01.210769 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.210701 2568 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 15:35:01.210769 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.210717 2568 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 15:35:01.210769 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.210723 2568 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 15:35:01.210889 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.210781 2568 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 15:35:01.213902 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.213887 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:35:01.240057 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.240002 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:35:01.240806 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.240790 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:35:01.240886 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.240818 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:35:01.240886 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.240829 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:35:01.240886 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.240849 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.247958 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.247943 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.248002 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.247962 2568 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-205.ec2.internal\": node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.262769 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.262750 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.311695 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.311674 2568 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal"] Jun 03 15:35:01.311751 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.311728 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:35:01.312465 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.312443 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:35:01.312538 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.312472 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:35:01.312538 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.312485 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:35:01.313679 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.313667 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:35:01.313831 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.313818 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.313872 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.313848 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:35:01.314280 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.314266 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:35:01.314353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.314286 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:35:01.314353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.314290 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:35:01.314353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.314310 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:35:01.314353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.314324 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:35:01.314508 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.314295 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:35:01.315520 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.315507 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.315566 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.315530 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:35:01.316161 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.316146 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:35:01.316226 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.316172 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:35:01.316226 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.316185 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:35:01.330891 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.330874 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-205.ec2.internal\" not found" node="ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.334527 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.334515 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-205.ec2.internal\" not found" node="ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.363114 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.363102 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.463717 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.463687 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.484906 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.484888 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff54ee216c3e7ea819c2515787f1adad-config\") pod \"kube-apiserver-proxy-ip-10-0-129-205.ec2.internal\" (UID: \"ff54ee216c3e7ea819c2515787f1adad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.484965 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.484910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92ddf2d5addff330dacf6386d475ba4a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"92ddf2d5addff330dacf6386d475ba4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.484965 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.484927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92ddf2d5addff330dacf6386d475ba4a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"92ddf2d5addff330dacf6386d475ba4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.564193 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.564148 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.585448 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.585427 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92ddf2d5addff330dacf6386d475ba4a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"92ddf2d5addff330dacf6386d475ba4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.585496 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.585453 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92ddf2d5addff330dacf6386d475ba4a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"92ddf2d5addff330dacf6386d475ba4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.585496 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.585473 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff54ee216c3e7ea819c2515787f1adad-config\") pod \"kube-apiserver-proxy-ip-10-0-129-205.ec2.internal\" (UID: \"ff54ee216c3e7ea819c2515787f1adad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.585556 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.585517 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff54ee216c3e7ea819c2515787f1adad-config\") pod \"kube-apiserver-proxy-ip-10-0-129-205.ec2.internal\" (UID: \"ff54ee216c3e7ea819c2515787f1adad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.585556 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.585525 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92ddf2d5addff330dacf6386d475ba4a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"92ddf2d5addff330dacf6386d475ba4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.585556 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.585536 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92ddf2d5addff330dacf6386d475ba4a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"92ddf2d5addff330dacf6386d475ba4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.633552 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.633529 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.638272 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.638252 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" Jun 03 15:35:01.664778 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.664753 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.765234 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.765212 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.865702 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.865646 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.905964 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.905938 2568 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:35:01.966310 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:01.966285 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:01.991834 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.991814 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 15:35:01.992446 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:01.991932 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:35:02.067130 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:02.067105 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:02.084701 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.084584 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 15:35:02.096439 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.095263 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:35:02.096439 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:02.095407 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff54ee216c3e7ea819c2515787f1adad.slice/crio-ba6224533a92321ff3a4ac44e117ea0ae846d7bb1e61ef205fbab7a438a37a54 WatchSource:0}: Error finding container ba6224533a92321ff3a4ac44e117ea0ae846d7bb1e61ef205fbab7a438a37a54: Status 404 returned error can't find the container with id ba6224533a92321ff3a4ac44e117ea0ae846d7bb1e61ef205fbab7a438a37a54 Jun 03 15:35:02.096690 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:02.096666 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ddf2d5addff330dacf6386d475ba4a.slice/crio-9708fd209be2b7892100f18c75d637a01117bc491b92000d01feaa43e10a48d3 WatchSource:0}: Error finding container 9708fd209be2b7892100f18c75d637a01117bc491b92000d01feaa43e10a48d3: Status 404 returned error can't find the container with id 9708fd209be2b7892100f18c75d637a01117bc491b92000d01feaa43e10a48d3 Jun 03 15:35:02.101173 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.100678 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:35:02.117760 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.117713 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdlf4" Jun 03 15:35:02.125639 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.125623 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdlf4" Jun 03 15:35:02.145321 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.145296 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 15:30:01 +0000 UTC" deadline="2028-02-15 07:06:04.639453032 +0000 UTC" Jun 03 15:35:02.145382 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.145320 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14919h31m2.494135786s" Jun 03 15:35:02.167454 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:02.167438 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:02.213349 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.213312 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" event={"ID":"ff54ee216c3e7ea819c2515787f1adad","Type":"ContainerStarted","Data":"ba6224533a92321ff3a4ac44e117ea0ae846d7bb1e61ef205fbab7a438a37a54"} Jun 03 15:35:02.214191 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.214171 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" event={"ID":"92ddf2d5addff330dacf6386d475ba4a","Type":"ContainerStarted","Data":"9708fd209be2b7892100f18c75d637a01117bc491b92000d01feaa43e10a48d3"} Jun 03 15:35:02.268346 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:02.268320 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:02.368816 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:02.368772 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:02.469234 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:02.469206 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:02.569920 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:02.569898 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found" Jun 03 15:35:02.598149 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.598123 2568 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:35:02.598252 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.598152 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:35:02.684638 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.684575 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" Jun 03 15:35:02.698321 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.698297 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:35:02.699197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.699176 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" Jun 03 15:35:02.706184 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:02.706168 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:35:03.062446 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.062381 2568 apiserver.go:52] "Watching apiserver" Jun 03 15:35:03.078125 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.078103 2568 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 15:35:03.078510 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.078484 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-zvn5n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal","openshift-multus/multus-t42g8","openshift-multus/network-metrics-daemon-sp6lm","openshift-network-diagnostics/network-check-target-2k5tc","kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal","openshift-image-registry/node-ca-ngwtl","openshift-multus/multus-additional-cni-plugins-klrdc","openshift-network-operator/iptables-alerter-r8ncx","openshift-ovn-kubernetes/ovnkube-node-x44sn","kube-system/konnectivity-agent-4dnxk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl","openshift-cluster-node-tuning-operator/tuned-qrm5f"] Jun 03 15:35:03.081197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.081177 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.081283 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.081262 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.082465 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.082444 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:03.082574 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.082545 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:03.083563 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.083543 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:03.083663 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.083606 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:03.084676 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.084658 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.086212 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.086195 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 15:35:03.086340 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.086319 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 15:35:03.086474 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.086460 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.087460 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.087444 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 15:35:03.087550 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.087487 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 15:35:03.087607 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.087549 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 15:35:03.087657 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.087615 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 15:35:03.088165 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.087858 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 15:35:03.088165 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.087976 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vt5f2\"" Jun 03 15:35:03.088165 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.088062 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hg2ts\"" Jun 03 15:35:03.088381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.088228 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-prjzt\"" Jun 03 15:35:03.088617 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.088588 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 15:35:03.088729 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.088718 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 15:35:03.089889 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.089567 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.089889 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.089740 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.091189 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.091162 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:03.095147 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.094559 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 15:35:03.095147 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.094667 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.095147 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.094690 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 15:35:03.095147 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.094711 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sk8wx\"" Jun 03 15:35:03.095147 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.094732 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 15:35:03.095147 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.094858 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f50f2af2-fbef-4ee8-8657-9a5b186747d4-serviceca\") pod \"node-ca-ngwtl\" (UID: \"f50f2af2-fbef-4ee8-8657-9a5b186747d4\") " pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-multus-cni-dir\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-hostroot\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdvtz\" (UniqueName: \"kubernetes.io/projected/01bf0c95-a9ef-4d1e-835a-6bb767fcdd95-kube-api-access-kdvtz\") pod \"node-resolver-zvn5n\" (UID: \"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95\") " pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095306 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-var-lib-cni-bin\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-var-lib-kubelet\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095386 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjlc7\" (UniqueName: \"kubernetes.io/projected/71edc8a7-005e-4114-9c38-6b276650a275-kube-api-access-bjlc7\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095394 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-run-k8s-cni-cncf-io\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-var-lib-cni-multus\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095465 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-etc-kubernetes\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.095521 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-multus-conf-dir\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095399 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r2cl5\"" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095586 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71edc8a7-005e-4114-9c38-6b276650a275-multus-daemon-config\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-run-multus-certs\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79tv7\" (UniqueName: \"kubernetes.io/projected/f50f2af2-fbef-4ee8-8657-9a5b186747d4-kube-api-access-79tv7\") pod \"node-ca-ngwtl\" (UID: \"f50f2af2-fbef-4ee8-8657-9a5b186747d4\") " pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-run-netns\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095684 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8wb2x\"" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095709 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01bf0c95-a9ef-4d1e-835a-6bb767fcdd95-hosts-file\") pod \"node-resolver-zvn5n\" (UID: \"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95\") " pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f50f2af2-fbef-4ee8-8657-9a5b186747d4-host\") pod \"node-ca-ngwtl\" (UID: \"f50f2af2-fbef-4ee8-8657-9a5b186747d4\") " pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095827 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.095962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-cnibin\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.096070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.096047 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71edc8a7-005e-4114-9c38-6b276650a275-cni-binary-copy\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.096629 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.096086 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-multus-socket-dir-parent\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.096629 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.096119 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnfmt\" (UniqueName: \"kubernetes.io/projected/ee7c8c93-375b-4bb6-9f38-380932825b76-kube-api-access-nnfmt\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:03.096629 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.096200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01bf0c95-a9ef-4d1e-835a-6bb767fcdd95-tmp-dir\") pod \"node-resolver-zvn5n\" (UID: \"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95\") " pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.096629 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.096293 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-system-cni-dir\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.096812 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.096717 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-os-release\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.096812 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.096737 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.096939 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.096921 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 15:35:03.097343 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.097313 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 15:35:03.097932 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.097913 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 15:35:03.098099 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.098084 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 15:35:03.098245 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.098232 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 15:35:03.098446 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.098390 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 15:35:03.105501 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.105480 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 15:35:03.105501 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.105486 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fj5z7\"" Jun 03 15:35:03.105609 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.105589 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8h6rl\"" Jun 03 15:35:03.105735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.105718 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 15:35:03.105805 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.105753 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 15:35:03.105977 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.105960 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5sfw9\"" Jun 03 15:35:03.106172 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.106148 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:35:03.106240 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.106151 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 15:35:03.126198 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.126161 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:30:02 +0000 UTC" deadline="2027-12-17 19:27:30.283321842 +0000 UTC" Jun 03 15:35:03.126198 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.126196 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13491h52m27.157129646s" Jun 03 15:35:03.185406 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.185380 2568 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 15:35:03.197167 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197139 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dvrj\" (UniqueName: \"kubernetes.io/projected/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-kube-api-access-7dvrj\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.197279 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197180 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-sysconfig\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.197279 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-lib-modules\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.197279 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197259 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-var-lib-kubelet\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.197460 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac3307dd-15e2-4632-9a86-8c9f71593b6d-ovnkube-config\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.197460 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197322 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac3307dd-15e2-4632-9a86-8c9f71593b6d-ovn-node-metrics-cert\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.197460 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197356 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71edc8a7-005e-4114-9c38-6b276650a275-multus-daemon-config\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.197460 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197396 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-run-multus-certs\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.197460 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-kubernetes\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.197699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197486 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-run-multus-certs\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.197699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197504 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-sysctl-d\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.197699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197529 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-sys\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.197699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197560 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79tv7\" (UniqueName: \"kubernetes.io/projected/f50f2af2-fbef-4ee8-8657-9a5b186747d4-kube-api-access-79tv7\") pod \"node-ca-ngwtl\" (UID: \"f50f2af2-fbef-4ee8-8657-9a5b186747d4\") " pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.197699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197585 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:03.197699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-cnibin\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.197699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197634 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c52397-7672-4375-a848-77438f176998-host-slash\") pod \"iptables-alerter-r8ncx\" (UID: \"a6c52397-7672-4375-a848-77438f176998\") " pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.197699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197657 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.197699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197681 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7kkw\" (UniqueName: \"kubernetes.io/projected/08a8f1e9-be97-41bb-aa88-e9b384e069f6-kube-api-access-d7kkw\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-var-lib-openvswitch\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197734 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01bf0c95-a9ef-4d1e-835a-6bb767fcdd95-hosts-file\") pod \"node-resolver-zvn5n\" (UID: \"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95\") " pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197757 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f50f2af2-fbef-4ee8-8657-9a5b186747d4-host\") pod \"node-ca-ngwtl\" (UID: \"f50f2af2-fbef-4ee8-8657-9a5b186747d4\") " pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197779 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-cnibin\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197802 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-multus-socket-dir-parent\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197826 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnfmt\" (UniqueName: \"kubernetes.io/projected/ee7c8c93-375b-4bb6-9f38-380932825b76-kube-api-access-nnfmt\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3821ef9b-5007-4f5c-b6c0-03888f78cced-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-sys-fs\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197924 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-os-release\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.197936 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197948 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-host\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197969 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-kubelet\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.197986 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71edc8a7-005e-4114-9c38-6b276650a275-multus-daemon-config\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.197995 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs podName:ee7c8c93-375b-4bb6-9f38-380932825b76 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:03.697975464 +0000 UTC m=+3.047315876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs") pod "network-metrics-daemon-sp6lm" (UID: "ee7c8c93-375b-4bb6-9f38-380932825b76") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198034 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01bf0c95-a9ef-4d1e-835a-6bb767fcdd95-hosts-file\") pod \"node-resolver-zvn5n\" (UID: \"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95\") " pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198074 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-run-systemd\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.198111 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198097 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f50f2af2-fbef-4ee8-8657-9a5b186747d4-host\") pod \"node-ca-ngwtl\" (UID: \"f50f2af2-fbef-4ee8-8657-9a5b186747d4\") " pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198098 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-etc-openvswitch\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198167 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-run-ovn\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198185 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-cnibin\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198199 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-os-release\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-log-socket\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198247 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-multus-socket-dir-parent\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198285 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f50f2af2-fbef-4ee8-8657-9a5b186747d4-serviceca\") pod \"node-ca-ngwtl\" (UID: \"f50f2af2-fbef-4ee8-8657-9a5b186747d4\") " pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkm5d\" (UniqueName: \"kubernetes.io/projected/3821ef9b-5007-4f5c-b6c0-03888f78cced-kube-api-access-jkm5d\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198346 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-987px\" (UniqueName: \"kubernetes.io/projected/a6c52397-7672-4375-a848-77438f176998-kube-api-access-987px\") pod \"iptables-alerter-r8ncx\" (UID: \"a6c52397-7672-4375-a848-77438f176998\") " pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198417 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-systemd-units\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198446 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac3307dd-15e2-4632-9a86-8c9f71593b6d-env-overrides\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198502 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-var-lib-cni-bin\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198528 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjlc7\" (UniqueName: \"kubernetes.io/projected/71edc8a7-005e-4114-9c38-6b276650a275-kube-api-access-bjlc7\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75cecf41-56f7-4b58-9bfd-487f183dbae5-konnectivity-ca\") pod \"konnectivity-agent-4dnxk\" (UID: \"75cecf41-56f7-4b58-9bfd-487f183dbae5\") " pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198575 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-var-lib-cni-bin\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.198950 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-device-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-modprobe-d\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198720 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-var-lib-cni-multus\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198741 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-os-release\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198744 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f50f2af2-fbef-4ee8-8657-9a5b186747d4-serviceca\") pod \"node-ca-ngwtl\" (UID: \"f50f2af2-fbef-4ee8-8657-9a5b186747d4\") " pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198787 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198812 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-var-lib-cni-multus\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3821ef9b-5007-4f5c-b6c0-03888f78cced-cni-binary-copy\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198868 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-sysctl-conf\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-run\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198919 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-multus-conf-dir\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3821ef9b-5007-4f5c-b6c0-03888f78cced-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.198974 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-run-netns\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199010 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-run-netns\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199036 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-system-cni-dir\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-multus-conf-dir\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199063 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71edc8a7-005e-4114-9c38-6b276650a275-cni-binary-copy\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.199735 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-registration-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-run-netns\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-node-log\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199145 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-cni-bin\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199168 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac3307dd-15e2-4632-9a86-8c9f71593b6d-ovnkube-script-lib\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199203 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01bf0c95-a9ef-4d1e-835a-6bb767fcdd95-tmp-dir\") pod \"node-resolver-zvn5n\" (UID: \"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95\") " pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199228 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-system-cni-dir\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6c52397-7672-4375-a848-77438f176998-iptables-alerter-script\") pod \"iptables-alerter-r8ncx\" (UID: \"a6c52397-7672-4375-a848-77438f176998\") " pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199323 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-systemd\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199348 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-system-cni-dir\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199411 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-multus-cni-dir\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199437 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-hostroot\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199465 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgh6s\" (UniqueName: \"kubernetes.io/projected/ac3307dd-15e2-4632-9a86-8c9f71593b6d-kube-api-access-bgh6s\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199507 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdvtz\" (UniqueName: \"kubernetes.io/projected/01bf0c95-a9ef-4d1e-835a-6bb767fcdd95-kube-api-access-kdvtz\") pod \"node-resolver-zvn5n\" (UID: \"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95\") " pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199534 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-var-lib-kubelet\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.200535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199540 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-multus-cni-dir\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199540 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71edc8a7-005e-4114-9c38-6b276650a275-cni-binary-copy\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-socket-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199575 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01bf0c95-a9ef-4d1e-835a-6bb767fcdd95-tmp-dir\") pod \"node-resolver-zvn5n\" (UID: \"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95\") " pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-tuned\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199605 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-hostroot\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08a8f1e9-be97-41bb-aa88-e9b384e069f6-tmp\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199644 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-slash\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199648 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-var-lib-kubelet\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-cni-netd\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199703 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-run-k8s-cni-cncf-io\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199754 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-etc-kubernetes\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199795 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-host-run-k8s-cni-cncf-io\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199798 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71edc8a7-005e-4114-9c38-6b276650a275-etc-kubernetes\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75cecf41-56f7-4b58-9bfd-487f183dbae5-agent-certs\") pod \"konnectivity-agent-4dnxk\" (UID: \"75cecf41-56f7-4b58-9bfd-487f183dbae5\") " pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199877 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-etc-selinux\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.201186 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.199907 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-run-openvswitch\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.205636 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.205594 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 15:35:03.206327 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.206309 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:35:03.206327 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.206327 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:35:03.206480 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.206338 2568 projected.go:194] Error preparing data for projected volume kube-api-access-wd8c5 for pod openshift-network-diagnostics/network-check-target-2k5tc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:03.206480 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.206409 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5 podName:ab35a92c-ab3a-41b2-b835-a560fa81c4a4 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:03.706393475 +0000 UTC m=+3.055733894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wd8c5" (UniqueName: "kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5") pod "network-check-target-2k5tc" (UID: "ab35a92c-ab3a-41b2-b835-a560fa81c4a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:03.208870 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.208853 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79tv7\" (UniqueName: \"kubernetes.io/projected/f50f2af2-fbef-4ee8-8657-9a5b186747d4-kube-api-access-79tv7\") pod \"node-ca-ngwtl\" (UID: \"f50f2af2-fbef-4ee8-8657-9a5b186747d4\") " pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.209005 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.208987 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjlc7\" (UniqueName: \"kubernetes.io/projected/71edc8a7-005e-4114-9c38-6b276650a275-kube-api-access-bjlc7\") pod \"multus-t42g8\" (UID: \"71edc8a7-005e-4114-9c38-6b276650a275\") " pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.209379 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.209346 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdvtz\" (UniqueName: \"kubernetes.io/projected/01bf0c95-a9ef-4d1e-835a-6bb767fcdd95-kube-api-access-kdvtz\") pod \"node-resolver-zvn5n\" (UID: \"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95\") " pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.209656 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.209640 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnfmt\" (UniqueName: \"kubernetes.io/projected/ee7c8c93-375b-4bb6-9f38-380932825b76-kube-api-access-nnfmt\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:03.300511 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300471 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-node-log\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.300649 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300515 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-cni-bin\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.300649 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300540 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac3307dd-15e2-4632-9a86-8c9f71593b6d-ovnkube-script-lib\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.300649 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300566 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.300649 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300569 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-node-log\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.300649 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300590 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6c52397-7672-4375-a848-77438f176998-iptables-alerter-script\") pod \"iptables-alerter-r8ncx\" (UID: \"a6c52397-7672-4375-a848-77438f176998\") " pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.300649 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300597 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-cni-bin\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300711 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-systemd\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300756 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-systemd\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300713 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300756 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300799 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300811 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgh6s\" (UniqueName: \"kubernetes.io/projected/ac3307dd-15e2-4632-9a86-8c9f71593b6d-kube-api-access-bgh6s\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300838 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-socket-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300862 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-tuned\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300888 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08a8f1e9-be97-41bb-aa88-e9b384e069f6-tmp\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300912 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-slash\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.300945 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300936 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-cni-netd\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.300987 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-cni-netd\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301012 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-socket-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301059 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-slash\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301060 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75cecf41-56f7-4b58-9bfd-487f183dbae5-agent-certs\") pod \"konnectivity-agent-4dnxk\" (UID: \"75cecf41-56f7-4b58-9bfd-487f183dbae5\") " pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301087 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6c52397-7672-4375-a848-77438f176998-iptables-alerter-script\") pod \"iptables-alerter-r8ncx\" (UID: \"a6c52397-7672-4375-a848-77438f176998\") " pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301104 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-etc-selinux\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301129 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-run-openvswitch\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301146 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-etc-selinux\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301156 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dvrj\" (UniqueName: \"kubernetes.io/projected/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-kube-api-access-7dvrj\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301182 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-sysconfig\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301183 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac3307dd-15e2-4632-9a86-8c9f71593b6d-ovnkube-script-lib\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301206 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-lib-modules\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301246 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-var-lib-kubelet\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301273 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac3307dd-15e2-4632-9a86-8c9f71593b6d-ovnkube-config\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301299 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac3307dd-15e2-4632-9a86-8c9f71593b6d-ovn-node-metrics-cert\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301302 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-lib-modules\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.301447 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301182 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-run-openvswitch\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301324 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-kubernetes\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301399 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-kubernetes\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301356 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-sysconfig\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301444 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-sysctl-d\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301460 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-var-lib-kubelet\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301470 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-sys\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301508 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-cnibin\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301532 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c52397-7672-4375-a848-77438f176998-host-slash\") pod \"iptables-alerter-r8ncx\" (UID: \"a6c52397-7672-4375-a848-77438f176998\") " pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301576 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301582 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-sysctl-d\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301600 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7kkw\" (UniqueName: \"kubernetes.io/projected/08a8f1e9-be97-41bb-aa88-e9b384e069f6-kube-api-access-d7kkw\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301624 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-var-lib-openvswitch\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301656 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3821ef9b-5007-4f5c-b6c0-03888f78cced-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301662 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-sys\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301682 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-sys-fs\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301705 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-host\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302197 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301728 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-kubelet\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301752 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-run-systemd\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301783 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-etc-openvswitch\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301809 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac3307dd-15e2-4632-9a86-8c9f71593b6d-ovnkube-config\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301818 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-run-ovn\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301844 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-log-socket\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301873 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkm5d\" (UniqueName: \"kubernetes.io/projected/3821ef9b-5007-4f5c-b6c0-03888f78cced-kube-api-access-jkm5d\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301878 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c52397-7672-4375-a848-77438f176998-host-slash\") pod \"iptables-alerter-r8ncx\" (UID: \"a6c52397-7672-4375-a848-77438f176998\") " pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301900 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-987px\" (UniqueName: \"kubernetes.io/projected/a6c52397-7672-4375-a848-77438f176998-kube-api-access-987px\") pod \"iptables-alerter-r8ncx\" (UID: \"a6c52397-7672-4375-a848-77438f176998\") " pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301909 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301926 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-systemd-units\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301935 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-kubelet\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301954 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301980 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac3307dd-15e2-4632-9a86-8c9f71593b6d-env-overrides\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302009 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75cecf41-56f7-4b58-9bfd-487f183dbae5-konnectivity-ca\") pod \"konnectivity-agent-4dnxk\" (UID: \"75cecf41-56f7-4b58-9bfd-487f183dbae5\") " pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302001 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-sys-fs\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302063 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-host\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.302973 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302061 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-var-lib-openvswitch\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302102 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-device-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302136 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-modprobe-d\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302167 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-os-release\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302209 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3821ef9b-5007-4f5c-b6c0-03888f78cced-cni-binary-copy\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302233 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-sysctl-conf\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302257 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-run\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302285 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3821ef9b-5007-4f5c-b6c0-03888f78cced-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302314 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-run-netns\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302311 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-run-systemd\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302340 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-system-cni-dir\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302382 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-registration-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302386 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-etc-openvswitch\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302456 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-device-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302476 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-run\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302515 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3821ef9b-5007-4f5c-b6c0-03888f78cced-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.301625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-cnibin\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.304214 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-modprobe-d\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302641 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-system-cni-dir\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302677 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-systemd-units\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302790 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-sysctl-conf\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302842 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3821ef9b-5007-4f5c-b6c0-03888f78cced-os-release\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302845 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-host-run-netns\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.302897 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-registration-dir\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.303138 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-log-socket\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.303188 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75cecf41-56f7-4b58-9bfd-487f183dbae5-konnectivity-ca\") pod \"konnectivity-agent-4dnxk\" (UID: \"75cecf41-56f7-4b58-9bfd-487f183dbae5\") " pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.303231 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac3307dd-15e2-4632-9a86-8c9f71593b6d-env-overrides\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.303233 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac3307dd-15e2-4632-9a86-8c9f71593b6d-run-ovn\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.303546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3821ef9b-5007-4f5c-b6c0-03888f78cced-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.303614 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3821ef9b-5007-4f5c-b6c0-03888f78cced-cni-binary-copy\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.304087 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac3307dd-15e2-4632-9a86-8c9f71593b6d-ovn-node-metrics-cert\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.304244 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75cecf41-56f7-4b58-9bfd-487f183dbae5-agent-certs\") pod \"konnectivity-agent-4dnxk\" (UID: \"75cecf41-56f7-4b58-9bfd-487f183dbae5\") " pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:03.305201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.304514 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08a8f1e9-be97-41bb-aa88-e9b384e069f6-etc-tuned\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.305803 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.305532 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08a8f1e9-be97-41bb-aa88-e9b384e069f6-tmp\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.318897 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.318832 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgh6s\" (UniqueName: \"kubernetes.io/projected/ac3307dd-15e2-4632-9a86-8c9f71593b6d-kube-api-access-bgh6s\") pod \"ovnkube-node-x44sn\" (UID: \"ac3307dd-15e2-4632-9a86-8c9f71593b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.321813 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.321792 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dvrj\" (UniqueName: \"kubernetes.io/projected/075ac5f7-1efb-41ff-8a8b-1c6985e98d48-kube-api-access-7dvrj\") pod \"aws-ebs-csi-driver-node-wwwfl\" (UID: \"075ac5f7-1efb-41ff-8a8b-1c6985e98d48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.321900 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.321792 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-987px\" (UniqueName: \"kubernetes.io/projected/a6c52397-7672-4375-a848-77438f176998-kube-api-access-987px\") pod \"iptables-alerter-r8ncx\" (UID: \"a6c52397-7672-4375-a848-77438f176998\") " pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.322081 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.322064 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7kkw\" (UniqueName: \"kubernetes.io/projected/08a8f1e9-be97-41bb-aa88-e9b384e069f6-kube-api-access-d7kkw\") pod \"tuned-qrm5f\" (UID: \"08a8f1e9-be97-41bb-aa88-e9b384e069f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.322795 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.322769 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkm5d\" (UniqueName: \"kubernetes.io/projected/3821ef9b-5007-4f5c-b6c0-03888f78cced-kube-api-access-jkm5d\") pod \"multus-additional-cni-plugins-klrdc\" (UID: \"3821ef9b-5007-4f5c-b6c0-03888f78cced\") " pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.393169 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.393147 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ngwtl" Jun 03 15:35:03.402059 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.402042 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t42g8" Jun 03 15:35:03.409593 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.409574 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zvn5n" Jun 03 15:35:03.416143 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.416127 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-klrdc" Jun 03 15:35:03.425663 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.425647 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8ncx" Jun 03 15:35:03.433177 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.433157 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:03.440744 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.440728 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:03.450269 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.450250 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" Jun 03 15:35:03.454755 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.454734 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" Jun 03 15:35:03.532599 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.532571 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:35:03.706456 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.706389 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:03.706456 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.706437 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:03.706663 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.706544 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:03.706663 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.706575 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:35:03.706663 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.706594 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:35:03.706663 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.706604 2568 projected.go:194] Error preparing data for projected volume kube-api-access-wd8c5 for pod openshift-network-diagnostics/network-check-target-2k5tc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:03.706663 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.706608 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs podName:ee7c8c93-375b-4bb6-9f38-380932825b76 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:04.706588896 +0000 UTC m=+4.055929311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs") pod "network-metrics-daemon-sp6lm" (UID: "ee7c8c93-375b-4bb6-9f38-380932825b76") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:03.706663 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.706656 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5 podName:ab35a92c-ab3a-41b2-b835-a560fa81c4a4 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:04.706644089 +0000 UTC m=+4.055984489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd8c5" (UniqueName: "kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5") pod "network-check-target-2k5tc" (UID: "ab35a92c-ab3a-41b2-b835-a560fa81c4a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:03.933538 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.933510 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-76xsx"] Jun 03 15:35:03.936078 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:03.936055 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:03.936208 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:03.936127 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:03.954280 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:03.954257 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3821ef9b_5007_4f5c_b6c0_03888f78cced.slice/crio-d253636b3d6d7d90f358e4a3d1682c247fd5c7b2497b472ffee0d42b0de44b10 WatchSource:0}: Error finding container d253636b3d6d7d90f358e4a3d1682c247fd5c7b2497b472ffee0d42b0de44b10: Status 404 returned error can't find the container with id d253636b3d6d7d90f358e4a3d1682c247fd5c7b2497b472ffee0d42b0de44b10 Jun 03 15:35:03.971356 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:03.971333 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf50f2af2_fbef_4ee8_8657_9a5b186747d4.slice/crio-010d6d662d5d9ab90e85fbd52c0353184fdf053bc85d95f081b8782359b9f1b2 WatchSource:0}: Error finding container 010d6d662d5d9ab90e85fbd52c0353184fdf053bc85d95f081b8782359b9f1b2: Status 404 returned error can't find the container with id 010d6d662d5d9ab90e85fbd52c0353184fdf053bc85d95f081b8782359b9f1b2 Jun 03 15:35:03.972790 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:03.972767 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod075ac5f7_1efb_41ff_8a8b_1c6985e98d48.slice/crio-2b2762ccdc35ebb6299fd85b8855f0500bd6f5638798a3fe35e429aeb084f576 WatchSource:0}: Error finding container 2b2762ccdc35ebb6299fd85b8855f0500bd6f5638798a3fe35e429aeb084f576: Status 404 returned error can't find the container with id 2b2762ccdc35ebb6299fd85b8855f0500bd6f5638798a3fe35e429aeb084f576 Jun 03 15:35:03.974058 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:03.973991 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75cecf41_56f7_4b58_9bfd_487f183dbae5.slice/crio-690ad8b22268caa30984ddc4e717e38340cd5b00d240c73edf2d0b8bb1b44ee9 WatchSource:0}: Error finding container 690ad8b22268caa30984ddc4e717e38340cd5b00d240c73edf2d0b8bb1b44ee9: Status 404 returned error can't find the container with id 690ad8b22268caa30984ddc4e717e38340cd5b00d240c73edf2d0b8bb1b44ee9 Jun 03 15:35:03.974769 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:03.974658 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c52397_7672_4375_a848_77438f176998.slice/crio-6795a564747b198ce811937aa72625266e57169668510731be1473c3b84e6963 WatchSource:0}: Error finding container 6795a564747b198ce811937aa72625266e57169668510731be1473c3b84e6963: Status 404 returned error can't find the container with id 6795a564747b198ce811937aa72625266e57169668510731be1473c3b84e6963 Jun 03 15:35:03.978545 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:03.978084 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01bf0c95_a9ef_4d1e_835a_6bb767fcdd95.slice/crio-607796019f469cbdc160ced709f37ed8fedcbc51ef7a15ff0c6a1f1d2ec8be80 WatchSource:0}: Error finding container 607796019f469cbdc160ced709f37ed8fedcbc51ef7a15ff0c6a1f1d2ec8be80: Status 404 returned error can't find the container with id 607796019f469cbdc160ced709f37ed8fedcbc51ef7a15ff0c6a1f1d2ec8be80 Jun 03 15:35:03.978661 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:03.978635 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3307dd_15e2_4632_9a86_8c9f71593b6d.slice/crio-d446c6d77152be4c6278a0f7b9315cd10ca0d57d773ac42aa31f715f0628a41f WatchSource:0}: Error finding container d446c6d77152be4c6278a0f7b9315cd10ca0d57d773ac42aa31f715f0628a41f: Status 404 returned error can't find the container with id d446c6d77152be4c6278a0f7b9315cd10ca0d57d773ac42aa31f715f0628a41f Jun 03 15:35:03.980198 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:03.980107 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71edc8a7_005e_4114_9c38_6b276650a275.slice/crio-6a70b788537456bae0d7c17ce5f6cb2da25e86757abc546f5d89e17ba6b40e5f WatchSource:0}: Error finding container 6a70b788537456bae0d7c17ce5f6cb2da25e86757abc546f5d89e17ba6b40e5f: Status 404 returned error can't find the container with id 6a70b788537456bae0d7c17ce5f6cb2da25e86757abc546f5d89e17ba6b40e5f Jun 03 15:35:03.981838 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:35:03.981810 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a8f1e9_be97_41bb_aa88_e9b384e069f6.slice/crio-50aeda199b2a8408a8ac06afc627c6f0fa69694fa9e3d548aa3c72f467e3acc1 WatchSource:0}: Error finding container 50aeda199b2a8408a8ac06afc627c6f0fa69694fa9e3d548aa3c72f467e3acc1: Status 404 returned error can't find the container with id 50aeda199b2a8408a8ac06afc627c6f0fa69694fa9e3d548aa3c72f467e3acc1 Jun 03 15:35:04.008490 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.008463 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:04.008602 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.008541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44cc2e50-46ea-4f5e-b6cc-aad762692538-dbus\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:04.008602 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.008580 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44cc2e50-46ea-4f5e-b6cc-aad762692538-kubelet-config\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:04.109083 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.109060 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:04.109487 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.109109 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44cc2e50-46ea-4f5e-b6cc-aad762692538-dbus\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:04.109487 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.109132 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44cc2e50-46ea-4f5e-b6cc-aad762692538-kubelet-config\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:04.109487 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.109192 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44cc2e50-46ea-4f5e-b6cc-aad762692538-kubelet-config\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:04.109487 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.109201 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44cc2e50-46ea-4f5e-b6cc-aad762692538-dbus\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:04.109487 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.109233 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:04.109487 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.109300 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret podName:44cc2e50-46ea-4f5e-b6cc-aad762692538 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:04.609280739 +0000 UTC m=+3.958621140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret") pod "global-pull-secret-syncer-76xsx" (UID: "44cc2e50-46ea-4f5e-b6cc-aad762692538") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:04.126339 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.126315 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:30:02 +0000 UTC" deadline="2027-12-03 13:58:09.98118723 +0000 UTC" Jun 03 15:35:04.126339 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.126337 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13150h23m5.854851999s" Jun 03 15:35:04.211046 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.211025 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:04.211147 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.211124 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:04.217173 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.217123 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" event={"ID":"08a8f1e9-be97-41bb-aa88-e9b384e069f6","Type":"ContainerStarted","Data":"50aeda199b2a8408a8ac06afc627c6f0fa69694fa9e3d548aa3c72f467e3acc1"} Jun 03 15:35:04.217903 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.217888 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t42g8" event={"ID":"71edc8a7-005e-4114-9c38-6b276650a275","Type":"ContainerStarted","Data":"6a70b788537456bae0d7c17ce5f6cb2da25e86757abc546f5d89e17ba6b40e5f"} Jun 03 15:35:04.218703 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.218682 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zvn5n" event={"ID":"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95","Type":"ContainerStarted","Data":"607796019f469cbdc160ced709f37ed8fedcbc51ef7a15ff0c6a1f1d2ec8be80"} Jun 03 15:35:04.219457 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.219440 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" event={"ID":"075ac5f7-1efb-41ff-8a8b-1c6985e98d48","Type":"ContainerStarted","Data":"2b2762ccdc35ebb6299fd85b8855f0500bd6f5638798a3fe35e429aeb084f576"} Jun 03 15:35:04.220234 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.220218 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klrdc" event={"ID":"3821ef9b-5007-4f5c-b6c0-03888f78cced","Type":"ContainerStarted","Data":"d253636b3d6d7d90f358e4a3d1682c247fd5c7b2497b472ffee0d42b0de44b10"} Jun 03 15:35:04.221504 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.221487 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" event={"ID":"ff54ee216c3e7ea819c2515787f1adad","Type":"ContainerStarted","Data":"28c2ae7066e7c4c46fddf8450f0c0e8e76fa5e66cc7e5b1d1ad2be0d00e4d2b6"} Jun 03 15:35:04.222268 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.222253 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" event={"ID":"ac3307dd-15e2-4632-9a86-8c9f71593b6d","Type":"ContainerStarted","Data":"d446c6d77152be4c6278a0f7b9315cd10ca0d57d773ac42aa31f715f0628a41f"} Jun 03 15:35:04.223233 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.223216 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8ncx" event={"ID":"a6c52397-7672-4375-a848-77438f176998","Type":"ContainerStarted","Data":"6795a564747b198ce811937aa72625266e57169668510731be1473c3b84e6963"} Jun 03 15:35:04.224210 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.224185 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4dnxk" event={"ID":"75cecf41-56f7-4b58-9bfd-487f183dbae5","Type":"ContainerStarted","Data":"690ad8b22268caa30984ddc4e717e38340cd5b00d240c73edf2d0b8bb1b44ee9"} Jun 03 15:35:04.225112 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.225090 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ngwtl" event={"ID":"f50f2af2-fbef-4ee8-8657-9a5b186747d4","Type":"ContainerStarted","Data":"010d6d662d5d9ab90e85fbd52c0353184fdf053bc85d95f081b8782359b9f1b2"} Jun 03 15:35:04.234906 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.234871 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" podStartSLOduration=2.234859978 podStartE2EDuration="2.234859978s" podCreationTimestamp="2026-06-03 15:35:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:35:04.23467778 +0000 UTC m=+3.584018201" watchObservedRunningTime="2026-06-03 15:35:04.234859978 +0000 UTC m=+3.584200400" Jun 03 15:35:04.614119 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.614045 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:04.614273 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.614194 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:04.614273 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.614249 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret podName:44cc2e50-46ea-4f5e-b6cc-aad762692538 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:05.614232527 +0000 UTC m=+4.963572942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret") pod "global-pull-secret-syncer-76xsx" (UID: "44cc2e50-46ea-4f5e-b6cc-aad762692538") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:04.715018 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.714987 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:04.715170 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:04.715052 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:04.715242 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.715190 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:35:04.715242 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.715208 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:35:04.715242 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.715220 2568 projected.go:194] Error preparing data for projected volume kube-api-access-wd8c5 for pod openshift-network-diagnostics/network-check-target-2k5tc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:04.715411 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.715277 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5 podName:ab35a92c-ab3a-41b2-b835-a560fa81c4a4 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:06.715257578 +0000 UTC m=+6.064597991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd8c5" (UniqueName: "kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5") pod "network-check-target-2k5tc" (UID: "ab35a92c-ab3a-41b2-b835-a560fa81c4a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:04.715685 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.715666 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:04.715748 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:04.715721 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs podName:ee7c8c93-375b-4bb6-9f38-380932825b76 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:06.71570642 +0000 UTC m=+6.065046825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs") pod "network-metrics-daemon-sp6lm" (UID: "ee7c8c93-375b-4bb6-9f38-380932825b76") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:05.212011 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:05.211501 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:05.212011 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:05.211623 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:05.214391 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:05.212650 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:05.214391 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:05.212761 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:05.239051 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:05.238964 2568 generic.go:358] "Generic (PLEG): container finished" podID="92ddf2d5addff330dacf6386d475ba4a" containerID="e8374b5639e1cad074e0fde4c3fee080a3c80cb5d454b58bb1abd5d58f1469c5" exitCode=0 Jun 03 15:35:05.240003 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:05.239844 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" event={"ID":"92ddf2d5addff330dacf6386d475ba4a","Type":"ContainerDied","Data":"e8374b5639e1cad074e0fde4c3fee080a3c80cb5d454b58bb1abd5d58f1469c5"} Jun 03 15:35:05.633418 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:05.633383 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:05.633568 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:05.633535 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:05.633624 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:05.633593 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret podName:44cc2e50-46ea-4f5e-b6cc-aad762692538 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:07.633574142 +0000 UTC m=+6.982914543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret") pod "global-pull-secret-syncer-76xsx" (UID: "44cc2e50-46ea-4f5e-b6cc-aad762692538") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:06.211618 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:06.211589 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:06.211781 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:06.211735 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:06.266259 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:06.266212 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" event={"ID":"92ddf2d5addff330dacf6386d475ba4a","Type":"ContainerStarted","Data":"70bd6a6608d2d6189480005d1087b75ad45b0fd4e4fc434f8e335e5fc4d8c80c"} Jun 03 15:35:06.281801 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:06.280669 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" podStartSLOduration=4.280653701 podStartE2EDuration="4.280653701s" podCreationTimestamp="2026-06-03 15:35:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:35:06.280463574 +0000 UTC m=+5.629803995" watchObservedRunningTime="2026-06-03 15:35:06.280653701 +0000 UTC m=+5.629994124" Jun 03 15:35:06.741397 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:06.741347 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:06.741570 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:06.741432 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:06.741570 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:06.741565 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:35:06.741681 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:06.741581 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:35:06.741681 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:06.741595 2568 projected.go:194] Error preparing data for projected volume kube-api-access-wd8c5 for pod openshift-network-diagnostics/network-check-target-2k5tc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:06.741681 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:06.741649 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5 podName:ab35a92c-ab3a-41b2-b835-a560fa81c4a4 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:10.741631208 +0000 UTC m=+10.090971615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd8c5" (UniqueName: "kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5") pod "network-check-target-2k5tc" (UID: "ab35a92c-ab3a-41b2-b835-a560fa81c4a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:06.742052 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:06.742034 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:06.742134 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:06.742087 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs podName:ee7c8c93-375b-4bb6-9f38-380932825b76 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:10.742071042 +0000 UTC m=+10.091411445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs") pod "network-metrics-daemon-sp6lm" (UID: "ee7c8c93-375b-4bb6-9f38-380932825b76") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:07.212016 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:07.211330 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:07.212016 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:07.211427 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:07.212016 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:07.211551 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:07.212016 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:07.211682 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:07.648578 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:07.648499 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:07.649015 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:07.648637 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:07.649015 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:07.648716 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret podName:44cc2e50-46ea-4f5e-b6cc-aad762692538 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:11.648696075 +0000 UTC m=+10.998036490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret") pod "global-pull-secret-syncer-76xsx" (UID: "44cc2e50-46ea-4f5e-b6cc-aad762692538") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:08.211575 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:08.211536 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:08.211743 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:08.211666 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:09.211928 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:09.211888 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:09.212396 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:09.212015 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:09.212396 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:09.211891 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:09.212540 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:09.212433 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:10.211653 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:10.210938 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:10.211653 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:10.211071 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:10.772417 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:10.772382 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:10.772857 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:10.772482 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:10.772857 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:10.772518 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:10.772857 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:10.772550 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs podName:ee7c8c93-375b-4bb6-9f38-380932825b76 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:18.772532113 +0000 UTC m=+18.121872513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs") pod "network-metrics-daemon-sp6lm" (UID: "ee7c8c93-375b-4bb6-9f38-380932825b76") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:10.772857 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:10.772653 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:35:10.772857 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:10.772675 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:35:10.772857 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:10.772689 2568 projected.go:194] Error preparing data for projected volume kube-api-access-wd8c5 for pod openshift-network-diagnostics/network-check-target-2k5tc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:10.772857 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:10.772745 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5 podName:ab35a92c-ab3a-41b2-b835-a560fa81c4a4 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:18.772729457 +0000 UTC m=+18.122069872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd8c5" (UniqueName: "kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5") pod "network-check-target-2k5tc" (UID: "ab35a92c-ab3a-41b2-b835-a560fa81c4a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:11.212139 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:11.212080 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:11.212266 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:11.212187 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:11.212403 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:11.212382 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:11.212528 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:11.212488 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:11.681108 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:11.681022 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:11.681265 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:11.681182 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:11.681265 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:11.681252 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret podName:44cc2e50-46ea-4f5e-b6cc-aad762692538 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:19.68123377 +0000 UTC m=+19.030574177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret") pod "global-pull-secret-syncer-76xsx" (UID: "44cc2e50-46ea-4f5e-b6cc-aad762692538") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:12.211168 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:12.211137 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:12.211643 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:12.211267 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:13.211105 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:13.211039 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:13.211292 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:13.211045 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:13.211292 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:13.211172 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:13.211292 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:13.211253 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:14.211134 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.211092 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:14.211297 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:14.211225 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:14.281084 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.281047 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ngwtl" event={"ID":"f50f2af2-fbef-4ee8-8657-9a5b186747d4","Type":"ContainerStarted","Data":"5cca403ffe1a3fa0820a7c6ecbbdeb33359985561ae92c28afaf16b9da4f18d8"} Jun 03 15:35:14.282710 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.282680 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" event={"ID":"08a8f1e9-be97-41bb-aa88-e9b384e069f6","Type":"ContainerStarted","Data":"8ace4ed5c7e51637c7447a269ae0c0a6ea3f41d6faaf4272f2926f4b30b1b3b7"} Jun 03 15:35:14.284241 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.284212 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zvn5n" event={"ID":"01bf0c95-a9ef-4d1e-835a-6bb767fcdd95","Type":"ContainerStarted","Data":"45a8f83499793fefb824d19ae775d4333252ab5abbb4c16177a6bc22c259a2e3"} Jun 03 15:35:14.286081 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.286054 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" event={"ID":"075ac5f7-1efb-41ff-8a8b-1c6985e98d48","Type":"ContainerStarted","Data":"3b8f816735565ed5cc62b2ef960ec61a7130f4037fc478d7fcc88f22ee03975a"} Jun 03 15:35:14.289179 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.289148 2568 generic.go:358] "Generic (PLEG): container finished" podID="3821ef9b-5007-4f5c-b6c0-03888f78cced" containerID="d050f8c7e558de1b0abf68309d41543c1b638aa87d60cc152ad16855a053c4df" exitCode=0 Jun 03 15:35:14.289444 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.289421 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klrdc" event={"ID":"3821ef9b-5007-4f5c-b6c0-03888f78cced","Type":"ContainerDied","Data":"d050f8c7e558de1b0abf68309d41543c1b638aa87d60cc152ad16855a053c4df"} Jun 03 15:35:14.291828 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.291804 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4dnxk" event={"ID":"75cecf41-56f7-4b58-9bfd-487f183dbae5","Type":"ContainerStarted","Data":"affdcdb6cdc341f940119d32683e62bd87ac7b90cc35699624cac1a8f2d61de1"} Jun 03 15:35:14.308452 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.308402 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zvn5n" podStartSLOduration=3.8468680490000002 podStartE2EDuration="13.308390285s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:35:03.979815806 +0000 UTC m=+3.329156214" lastFinishedPulling="2026-06-03 15:35:13.441338038 +0000 UTC m=+12.790678450" observedRunningTime="2026-06-03 15:35:14.308357944 +0000 UTC m=+13.657698364" watchObservedRunningTime="2026-06-03 15:35:14.308390285 +0000 UTC m=+13.657730708" Jun 03 15:35:14.308769 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.308740 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ngwtl" podStartSLOduration=3.849453058 podStartE2EDuration="13.308729744s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:35:03.973286425 +0000 UTC m=+3.322626825" lastFinishedPulling="2026-06-03 15:35:13.43256309 +0000 UTC m=+12.781903511" observedRunningTime="2026-06-03 15:35:14.294675418 +0000 UTC m=+13.644015840" watchObservedRunningTime="2026-06-03 15:35:14.308729744 +0000 UTC m=+13.658070169" Jun 03 15:35:14.341203 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.341000 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4dnxk" podStartSLOduration=3.881202207 podStartE2EDuration="13.340985693s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:35:03.977203497 +0000 UTC m=+3.326543909" lastFinishedPulling="2026-06-03 15:35:13.43698698 +0000 UTC m=+12.786327395" observedRunningTime="2026-06-03 15:35:14.340500406 +0000 UTC m=+13.689840828" watchObservedRunningTime="2026-06-03 15:35:14.340985693 +0000 UTC m=+13.690326116" Jun 03 15:35:14.355171 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:14.355124 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qrm5f" podStartSLOduration=3.856120729 podStartE2EDuration="13.355110989s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:35:03.983762959 +0000 UTC m=+3.333103369" lastFinishedPulling="2026-06-03 15:35:13.482753214 +0000 UTC m=+12.832093629" observedRunningTime="2026-06-03 15:35:14.354795214 +0000 UTC m=+13.704135649" watchObservedRunningTime="2026-06-03 15:35:14.355110989 +0000 UTC m=+13.704451412" Jun 03 15:35:15.104377 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:15.104186 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 15:35:15.147068 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:15.146897 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:35:15.104356419Z","UUID":"d292a478-238b-485d-a3ce-25599ae0ab56","Handler":null,"Name":"","Endpoint":""} Jun 03 15:35:15.156577 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:15.156553 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 15:35:15.156685 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:15.156590 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 15:35:15.211479 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:15.211416 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:15.211964 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:15.211542 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:15.211964 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:15.211607 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:15.211964 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:15.211700 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:15.293853 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:15.293824 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8ncx" event={"ID":"a6c52397-7672-4375-a848-77438f176998","Type":"ContainerStarted","Data":"3f58f519ae5535555b72f89fd3cb250b58f2b8abd78bf69e7ae013f532a5c530"} Jun 03 15:35:15.295143 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:15.295120 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" event={"ID":"075ac5f7-1efb-41ff-8a8b-1c6985e98d48","Type":"ContainerStarted","Data":"404b1364ea8fd8c893a0302de329dfb876627d51eb71651a5a1998345792af0b"} Jun 03 15:35:15.306865 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:15.306829 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r8ncx" podStartSLOduration=4.852562582 podStartE2EDuration="14.30681871s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:35:03.978303595 +0000 UTC m=+3.327644010" lastFinishedPulling="2026-06-03 15:35:13.432559725 +0000 UTC m=+12.781900138" observedRunningTime="2026-06-03 15:35:15.306615703 +0000 UTC m=+14.655956129" watchObservedRunningTime="2026-06-03 15:35:15.30681871 +0000 UTC m=+14.656159131" Jun 03 15:35:16.210911 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:16.210877 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:16.211192 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:16.210997 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:16.992493 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:16.992458 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:16.993034 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:16.993011 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:17.211150 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:17.211112 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:17.212252 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:17.211244 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:17.212252 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:17.211376 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:17.212252 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:17.211479 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:18.211773 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:18.211736 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:18.212208 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:18.211857 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:18.834992 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:18.834961 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:18.835170 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:18.835023 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:18.835170 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:18.835128 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:18.835170 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:18.835128 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:35:18.835170 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:18.835156 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:35:18.835170 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:18.835169 2568 projected.go:194] Error preparing data for projected volume kube-api-access-wd8c5 for pod openshift-network-diagnostics/network-check-target-2k5tc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:18.835355 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:18.835181 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs podName:ee7c8c93-375b-4bb6-9f38-380932825b76 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:34.835163663 +0000 UTC m=+34.184504064 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs") pod "network-metrics-daemon-sp6lm" (UID: "ee7c8c93-375b-4bb6-9f38-380932825b76") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:18.835355 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:18.835210 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5 podName:ab35a92c-ab3a-41b2-b835-a560fa81c4a4 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:34.835198065 +0000 UTC m=+34.184538465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd8c5" (UniqueName: "kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5") pod "network-check-target-2k5tc" (UID: "ab35a92c-ab3a-41b2-b835-a560fa81c4a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:19.211876 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:19.211791 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:19.212291 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:19.211791 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:19.212291 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:19.211920 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:19.212291 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:19.212048 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:19.520347 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:19.520246 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:19.520523 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:19.520378 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 15:35:19.520902 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:19.520877 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4dnxk" Jun 03 15:35:19.742544 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:19.742515 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:19.742695 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:19.742676 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:19.742753 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:19.742745 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret podName:44cc2e50-46ea-4f5e-b6cc-aad762692538 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:35.742727612 +0000 UTC m=+35.092068017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret") pod "global-pull-secret-syncer-76xsx" (UID: "44cc2e50-46ea-4f5e-b6cc-aad762692538") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:20.211641 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:20.211612 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:20.211783 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:20.211725 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:21.212960 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:21.212927 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:21.213438 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:21.213071 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:21.213438 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:21.213148 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:21.213438 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:21.213254 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:22.211397 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:22.211357 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:22.211553 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:22.211486 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:23.211549 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:23.211519 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:23.211991 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:23.211697 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:23.211991 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:23.211749 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:23.211991 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:23.211866 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:24.211623 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:24.211590 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:24.212024 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:24.211703 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:25.210923 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:25.210889 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:25.211094 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:25.210889 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:25.211094 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:25.211006 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:25.211094 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:25.211054 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:26.211798 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.211778 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:26.212330 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:26.211872 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:26.315679 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.315655 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" event={"ID":"ac3307dd-15e2-4632-9a86-8c9f71593b6d","Type":"ContainerStarted","Data":"8d953eb334ba0cd130b6cf119288157d49deb74f0d37ca1ad7f3daadb0fcba71"} Jun 03 15:35:26.315783 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.315690 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" event={"ID":"ac3307dd-15e2-4632-9a86-8c9f71593b6d","Type":"ContainerStarted","Data":"a7cc38dc1800a626a69f5f1512c198718ef00cb0b2449c1e34cf330b5feb2017"} Jun 03 15:35:26.315783 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.315703 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" event={"ID":"ac3307dd-15e2-4632-9a86-8c9f71593b6d","Type":"ContainerStarted","Data":"de907e8ce2af68232a7749593bd57617bff4e96fb30454ba7337ebf52ffb9e70"} Jun 03 15:35:26.315783 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.315715 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" event={"ID":"ac3307dd-15e2-4632-9a86-8c9f71593b6d","Type":"ContainerStarted","Data":"27e25d4aa8e184e4a1682bf5e0589af8bddd599f54ecdf6cfadb021826ac0508"} Jun 03 15:35:26.315783 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.315728 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" event={"ID":"ac3307dd-15e2-4632-9a86-8c9f71593b6d","Type":"ContainerStarted","Data":"56b3a926edfc42b4fd386e044259dcc3446ea0377f6dfdaf67e3862d7ada8a11"} Jun 03 15:35:26.315783 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.315739 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" event={"ID":"ac3307dd-15e2-4632-9a86-8c9f71593b6d","Type":"ContainerStarted","Data":"d6d8bd56db6f0fecde9dae95858eb2dfcc143be1293eb833325426aadc1fc987"} Jun 03 15:35:26.316931 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.316912 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t42g8" event={"ID":"71edc8a7-005e-4114-9c38-6b276650a275","Type":"ContainerStarted","Data":"12aea5ecb7629c7e4232045bf24fd4e4a2120be6cd6c31cb2d01aba01480c0a4"} Jun 03 15:35:26.318700 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.318676 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" event={"ID":"075ac5f7-1efb-41ff-8a8b-1c6985e98d48","Type":"ContainerStarted","Data":"fee7bf80ae24c20a47385efd0a4cb7635c2d58809cc9cdb6f2e18aec5d814bac"} Jun 03 15:35:26.320667 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.320644 2568 generic.go:358] "Generic (PLEG): container finished" podID="3821ef9b-5007-4f5c-b6c0-03888f78cced" containerID="b7ba32dc60a017566ca1665e1f3e7c020b9b497446a93eb2d833b46ec987a8f1" exitCode=0 Jun 03 15:35:26.320743 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.320679 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klrdc" event={"ID":"3821ef9b-5007-4f5c-b6c0-03888f78cced","Type":"ContainerDied","Data":"b7ba32dc60a017566ca1665e1f3e7c020b9b497446a93eb2d833b46ec987a8f1"} Jun 03 15:35:26.338839 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.338805 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-t42g8" podStartSLOduration=3.732082246 podStartE2EDuration="25.338794592s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:35:03.982447154 +0000 UTC m=+3.331787569" lastFinishedPulling="2026-06-03 15:35:25.5891595 +0000 UTC m=+24.938499915" observedRunningTime="2026-06-03 15:35:26.33839725 +0000 UTC m=+25.687737672" watchObservedRunningTime="2026-06-03 15:35:26.338794592 +0000 UTC m=+25.688135013" Jun 03 15:35:26.357325 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:26.357290 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwwfl" podStartSLOduration=3.377873241 podStartE2EDuration="25.357282421s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:35:03.976353598 +0000 UTC m=+3.325694011" lastFinishedPulling="2026-06-03 15:35:25.955762776 +0000 UTC m=+25.305103191" observedRunningTime="2026-06-03 15:35:26.357077965 +0000 UTC m=+25.706418387" watchObservedRunningTime="2026-06-03 15:35:26.357282421 +0000 UTC m=+25.706622842" Jun 03 15:35:27.211750 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:27.211722 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:27.211829 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:27.211772 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:27.212073 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:27.211844 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:27.212073 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:27.211893 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:27.324740 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:27.324708 2568 generic.go:358] "Generic (PLEG): container finished" podID="3821ef9b-5007-4f5c-b6c0-03888f78cced" containerID="82bd13c0984ea3cddb04343a7896eaf263bdc011b398761291542383c0a9f296" exitCode=0 Jun 03 15:35:27.324901 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:27.324799 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klrdc" event={"ID":"3821ef9b-5007-4f5c-b6c0-03888f78cced","Type":"ContainerDied","Data":"82bd13c0984ea3cddb04343a7896eaf263bdc011b398761291542383c0a9f296"} Jun 03 15:35:28.211577 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:28.211554 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:28.211704 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:28.211683 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:28.328193 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:28.328165 2568 generic.go:358] "Generic (PLEG): container finished" podID="3821ef9b-5007-4f5c-b6c0-03888f78cced" containerID="c38128111d8f12340959138eeb3e791b4e60deb330dbc7644f0438ad153ab3ec" exitCode=0 Jun 03 15:35:28.328594 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:28.328203 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klrdc" event={"ID":"3821ef9b-5007-4f5c-b6c0-03888f78cced","Type":"ContainerDied","Data":"c38128111d8f12340959138eeb3e791b4e60deb330dbc7644f0438ad153ab3ec"} Jun 03 15:35:29.211017 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:29.210830 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:29.211157 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:29.210893 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:29.211157 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:29.211086 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:29.211157 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:29.211147 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:29.332133 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:29.332101 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" event={"ID":"ac3307dd-15e2-4632-9a86-8c9f71593b6d","Type":"ContainerStarted","Data":"ba941363b2ed39ea0ef212af5c590ee9b1c9e017f1820f500ec491140affba93"} Jun 03 15:35:30.211201 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:30.211172 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:30.211379 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:30.211270 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:31.211922 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:31.211896 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:31.212517 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:31.211995 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:31.212517 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:31.212083 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:31.212517 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:31.212190 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:31.339544 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:31.339505 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" event={"ID":"ac3307dd-15e2-4632-9a86-8c9f71593b6d","Type":"ContainerStarted","Data":"39f94e15885cf8b733ba39d2a7f0fa80a57699499d53366692b6d31835c3e6b8"} Jun 03 15:35:31.339902 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:31.339879 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:31.340009 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:31.339909 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:31.357234 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:31.357210 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:31.371467 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:31.371425 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" podStartSLOduration=8.481700542 podStartE2EDuration="30.371411509s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:35:03.980482187 +0000 UTC m=+3.329822601" lastFinishedPulling="2026-06-03 15:35:25.870193169 +0000 UTC m=+25.219533568" observedRunningTime="2026-06-03 15:35:31.370955645 +0000 UTC m=+30.720296066" watchObservedRunningTime="2026-06-03 15:35:31.371411509 +0000 UTC m=+30.720751932" Jun 03 15:35:32.211088 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:32.211052 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:32.211231 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:32.211182 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:32.342202 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:32.342176 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:32.358625 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:32.358600 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:35:32.632058 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:32.632015 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sp6lm"] Jun 03 15:35:32.632221 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:32.632143 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:32.632288 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:32.632259 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:32.632799 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:32.632777 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-76xsx"] Jun 03 15:35:32.632938 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:32.632878 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:32.633027 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:32.633001 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:32.634206 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:32.634187 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2k5tc"] Jun 03 15:35:32.634300 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:32.634280 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:32.634431 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:32.634392 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:34.211974 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:34.211746 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:34.212437 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:34.211762 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:34.212437 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:34.212186 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:34.212437 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:34.212079 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:34.212437 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:34.211791 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:34.212437 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:34.212290 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:34.863025 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:34.862940 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:34.863025 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:34.863020 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:34.863211 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:34.863101 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:35:34.863211 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:34.863118 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:34.863211 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:34.863185 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs podName:ee7c8c93-375b-4bb6-9f38-380932825b76 nodeName:}" failed. No retries permitted until 2026-06-03 15:36:06.863166447 +0000 UTC m=+66.212506860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs") pod "network-metrics-daemon-sp6lm" (UID: "ee7c8c93-375b-4bb6-9f38-380932825b76") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:35:34.863211 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:34.863121 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:35:34.863391 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:34.863220 2568 projected.go:194] Error preparing data for projected volume kube-api-access-wd8c5 for pod openshift-network-diagnostics/network-check-target-2k5tc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:34.863391 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:34.863268 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5 podName:ab35a92c-ab3a-41b2-b835-a560fa81c4a4 nodeName:}" failed. No retries permitted until 2026-06-03 15:36:06.86325323 +0000 UTC m=+66.212593636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd8c5" (UniqueName: "kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5") pod "network-check-target-2k5tc" (UID: "ab35a92c-ab3a-41b2-b835-a560fa81c4a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:35:35.771412 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:35.771355 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:35.771880 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:35.771522 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:35.771880 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:35.771595 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret podName:44cc2e50-46ea-4f5e-b6cc-aad762692538 nodeName:}" failed. No retries permitted until 2026-06-03 15:36:07.771579087 +0000 UTC m=+67.120919486 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret") pod "global-pull-secret-syncer-76xsx" (UID: "44cc2e50-46ea-4f5e-b6cc-aad762692538") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:35:36.211394 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:36.211308 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:36.211534 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:36.211305 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:36.211534 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:36.211444 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:36.211534 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:36.211310 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:36.211534 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:36.211498 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:36.211698 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:36.211584 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:37.352752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:37.352726 2568 generic.go:358] "Generic (PLEG): container finished" podID="3821ef9b-5007-4f5c-b6c0-03888f78cced" containerID="a41d4d85d59ac1e07d23de694285407cef40790f990f87cbb8bab7514a737d6a" exitCode=0 Jun 03 15:35:37.353303 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:37.352765 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klrdc" event={"ID":"3821ef9b-5007-4f5c-b6c0-03888f78cced","Type":"ContainerDied","Data":"a41d4d85d59ac1e07d23de694285407cef40790f990f87cbb8bab7514a737d6a"} Jun 03 15:35:38.211080 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.211043 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:38.211080 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.211063 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:38.211276 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.211067 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:38.211276 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.211159 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:35:38.211276 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.211213 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76xsx" podUID="44cc2e50-46ea-4f5e-b6cc-aad762692538" Jun 03 15:35:38.211406 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.211287 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k5tc" podUID="ab35a92c-ab3a-41b2-b835-a560fa81c4a4" Jun 03 15:35:38.356766 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.356738 2568 generic.go:358] "Generic (PLEG): container finished" podID="3821ef9b-5007-4f5c-b6c0-03888f78cced" containerID="fe2c344720e76a4dbacc4ff4bec325243a629aaf2263eae6591a9a737f977d9c" exitCode=0 Jun 03 15:35:38.357146 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.356796 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klrdc" event={"ID":"3821ef9b-5007-4f5c-b6c0-03888f78cced","Type":"ContainerDied","Data":"fe2c344720e76a4dbacc4ff4bec325243a629aaf2263eae6591a9a737f977d9c"} Jun 03 15:35:38.522645 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.522624 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeReady" Jun 03 15:35:38.522732 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.522713 2568 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 15:35:38.557277 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.557256 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59b6d8fc4-cgj7p"] Jun 03 15:35:38.574017 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.573997 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gpxtd"] Jun 03 15:35:38.574149 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.574131 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.577087 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.577067 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jwg26\"" Jun 03 15:35:38.577261 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.577191 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 15:35:38.577261 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.577246 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 15:35:38.577843 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.577653 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 15:35:38.581918 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.581897 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 15:35:38.597154 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.597133 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.597236 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.597164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0635a806-e1e7-49c3-a61b-b62a71f02951-ca-trust-extracted\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.597236 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.597181 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-image-registry-private-configuration\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.597354 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.597239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-trusted-ca\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.597354 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.597272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-bound-sa-token\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.597354 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.597301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gbxg\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-kube-api-access-9gbxg\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.597354 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.597330 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-installation-pull-secrets\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.597498 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.597416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-certificates\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.602143 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.602125 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g6jss"] Jun 03 15:35:38.602261 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.602248 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.604649 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.604635 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 15:35:38.604737 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.604638 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pf8ss\"" Jun 03 15:35:38.604737 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.604670 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 15:35:38.626340 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.626315 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59b6d8fc4-cgj7p"] Jun 03 15:35:38.626340 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.626335 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gpxtd"] Jun 03 15:35:38.626340 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.626342 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6jss"] Jun 03 15:35:38.626502 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.626427 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:38.628900 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.628885 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 15:35:38.629228 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.629213 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 15:35:38.629286 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.629254 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 15:35:38.629494 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.629479 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zqgtx\"" Jun 03 15:35:38.698297 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698268 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-certificates\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.698402 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698305 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-tmp-dir\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.698402 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698349 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.698484 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698406 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0635a806-e1e7-49c3-a61b-b62a71f02951-ca-trust-extracted\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.698484 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698435 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-image-registry-private-configuration\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.698484 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.698451 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:35:38.698484 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.698469 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b6d8fc4-cgj7p: secret "image-registry-tls" not found Jun 03 15:35:38.698484 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698473 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:38.698719 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698499 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.698719 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.698518 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls podName:0635a806-e1e7-49c3-a61b-b62a71f02951 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:39.198501701 +0000 UTC m=+38.547842107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls") pod "image-registry-59b6d8fc4-cgj7p" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951") : secret "image-registry-tls" not found Jun 03 15:35:38.698719 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698549 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-trusted-ca\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.698719 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698577 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-bound-sa-token\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.698719 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698603 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gbxg\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-kube-api-access-9gbxg\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.698719 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698631 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-installation-pull-secrets\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.698719 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698662 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-config-volume\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.698719 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698700 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9pqz\" (UniqueName: \"kubernetes.io/projected/810a54ac-0eef-4d57-99d4-445ec95baf54-kube-api-access-q9pqz\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:38.699166 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698725 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wbmx\" (UniqueName: \"kubernetes.io/projected/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-kube-api-access-6wbmx\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.699166 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698769 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0635a806-e1e7-49c3-a61b-b62a71f02951-ca-trust-extracted\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.699166 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.698977 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-certificates\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.699443 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.699424 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-trusted-ca\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.701977 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.701957 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-image-registry-private-configuration\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.702048 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.702014 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-installation-pull-secrets\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.712019 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.711998 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gbxg\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-kube-api-access-9gbxg\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.712113 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.712093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-bound-sa-token\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:38.799662 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.799642 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:38.799736 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.799670 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.799736 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.799696 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-config-volume\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.799830 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.799767 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:35:38.799830 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.799777 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:35:38.799830 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.799825 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert podName:810a54ac-0eef-4d57-99d4-445ec95baf54 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:39.299809941 +0000 UTC m=+38.649150352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert") pod "ingress-canary-g6jss" (UID: "810a54ac-0eef-4d57-99d4-445ec95baf54") : secret "canary-serving-cert" not found Jun 03 15:35:38.799984 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:38.799845 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls podName:a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:39.299836234 +0000 UTC m=+38.649176633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls") pod "dns-default-gpxtd" (UID: "a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3") : secret "dns-default-metrics-tls" not found Jun 03 15:35:38.799984 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.799823 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9pqz\" (UniqueName: \"kubernetes.io/projected/810a54ac-0eef-4d57-99d4-445ec95baf54-kube-api-access-q9pqz\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:38.799984 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.799904 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wbmx\" (UniqueName: \"kubernetes.io/projected/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-kube-api-access-6wbmx\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.799984 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.799949 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-tmp-dir\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.800212 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.800175 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-config-volume\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.800212 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.800192 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-tmp-dir\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.808679 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.808656 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wbmx\" (UniqueName: \"kubernetes.io/projected/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-kube-api-access-6wbmx\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:38.809316 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:38.809292 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9pqz\" (UniqueName: \"kubernetes.io/projected/810a54ac-0eef-4d57-99d4-445ec95baf54-kube-api-access-q9pqz\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:39.203174 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:39.203109 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:39.203302 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:39.203261 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:35:39.203302 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:39.203289 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b6d8fc4-cgj7p: secret "image-registry-tls" not found Jun 03 15:35:39.203448 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:39.203356 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls podName:0635a806-e1e7-49c3-a61b-b62a71f02951 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:40.203337368 +0000 UTC m=+39.552677771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls") pod "image-registry-59b6d8fc4-cgj7p" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951") : secret "image-registry-tls" not found Jun 03 15:35:39.303573 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:39.303542 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:39.303672 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:39.303577 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:39.303672 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:39.303665 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:35:39.303779 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:39.303685 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:35:39.303779 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:39.303714 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert podName:810a54ac-0eef-4d57-99d4-445ec95baf54 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:40.303700925 +0000 UTC m=+39.653041333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert") pod "ingress-canary-g6jss" (UID: "810a54ac-0eef-4d57-99d4-445ec95baf54") : secret "canary-serving-cert" not found Jun 03 15:35:39.303779 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:39.303735 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls podName:a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:40.30371922 +0000 UTC m=+39.653059637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls") pod "dns-default-gpxtd" (UID: "a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3") : secret "dns-default-metrics-tls" not found Jun 03 15:35:39.361534 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:39.361512 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klrdc" event={"ID":"3821ef9b-5007-4f5c-b6c0-03888f78cced","Type":"ContainerStarted","Data":"e8323ae3092e57378b3dc25879fee7810c9791a1e44af2012599c35f92fe9d10"} Jun 03 15:35:39.387301 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:39.387261 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-klrdc" podStartSLOduration=5.635680249 podStartE2EDuration="38.387250874s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:35:03.965809315 +0000 UTC m=+3.315149715" lastFinishedPulling="2026-06-03 15:35:36.717379932 +0000 UTC m=+36.066720340" observedRunningTime="2026-06-03 15:35:39.386999653 +0000 UTC m=+38.736340091" watchObservedRunningTime="2026-06-03 15:35:39.387250874 +0000 UTC m=+38.736591296" Jun 03 15:35:40.209638 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.209604 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:40.209803 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:40.209746 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:35:40.209803 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:40.209764 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b6d8fc4-cgj7p: secret "image-registry-tls" not found Jun 03 15:35:40.209878 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:40.209826 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls podName:0635a806-e1e7-49c3-a61b-b62a71f02951 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:42.209811437 +0000 UTC m=+41.559151837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls") pod "image-registry-59b6d8fc4-cgj7p" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951") : secret "image-registry-tls" not found Jun 03 15:35:40.211752 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.211726 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:35:40.211893 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.211727 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:35:40.211960 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.211727 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:35:40.214598 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.214575 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:35:40.214721 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.214603 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:35:40.214721 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.214611 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:35:40.214721 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.214622 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zg94t\"" Jun 03 15:35:40.216040 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.216025 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2b5h8\"" Jun 03 15:35:40.216115 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.216099 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:35:40.310615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.310594 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:40.310702 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:40.310621 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:40.310747 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:40.310719 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:35:40.310747 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:40.310726 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:35:40.310814 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:40.310773 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert podName:810a54ac-0eef-4d57-99d4-445ec95baf54 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:42.310760733 +0000 UTC m=+41.660101148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert") pod "ingress-canary-g6jss" (UID: "810a54ac-0eef-4d57-99d4-445ec95baf54") : secret "canary-serving-cert" not found Jun 03 15:35:40.310814 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:40.310786 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls podName:a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:42.310780715 +0000 UTC m=+41.660121115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls") pod "dns-default-gpxtd" (UID: "a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3") : secret "dns-default-metrics-tls" not found Jun 03 15:35:42.225831 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:42.225583 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:42.226201 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:42.225726 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:35:42.226201 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:42.225853 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b6d8fc4-cgj7p: secret "image-registry-tls" not found Jun 03 15:35:42.226201 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:42.225902 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls podName:0635a806-e1e7-49c3-a61b-b62a71f02951 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:46.225887885 +0000 UTC m=+45.575228291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls") pod "image-registry-59b6d8fc4-cgj7p" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951") : secret "image-registry-tls" not found Jun 03 15:35:42.326056 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:42.326032 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:42.326056 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:42.326058 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:42.326236 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:42.326165 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:35:42.326236 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:42.326193 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:35:42.326236 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:42.326205 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls podName:a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:46.326194971 +0000 UTC m=+45.675535371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls") pod "dns-default-gpxtd" (UID: "a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3") : secret "dns-default-metrics-tls" not found Jun 03 15:35:42.326388 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:42.326251 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert podName:810a54ac-0eef-4d57-99d4-445ec95baf54 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:46.32623456 +0000 UTC m=+45.675574960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert") pod "ingress-canary-g6jss" (UID: "810a54ac-0eef-4d57-99d4-445ec95baf54") : secret "canary-serving-cert" not found Jun 03 15:35:46.251837 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:46.251796 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:46.252336 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:46.251937 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:35:46.252336 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:46.251955 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b6d8fc4-cgj7p: secret "image-registry-tls" not found Jun 03 15:35:46.252336 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:46.252009 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls podName:0635a806-e1e7-49c3-a61b-b62a71f02951 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:54.251994553 +0000 UTC m=+53.601334957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls") pod "image-registry-59b6d8fc4-cgj7p" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951") : secret "image-registry-tls" not found Jun 03 15:35:46.352711 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:46.352688 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:46.352798 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:46.352721 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:46.352834 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:46.352823 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:35:46.352878 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:46.352867 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls podName:a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:54.352854855 +0000 UTC m=+53.702195255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls") pod "dns-default-gpxtd" (UID: "a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3") : secret "dns-default-metrics-tls" not found Jun 03 15:35:46.352919 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:46.352890 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:35:46.352962 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:46.352938 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert podName:810a54ac-0eef-4d57-99d4-445ec95baf54 nodeName:}" failed. No retries permitted until 2026-06-03 15:35:54.352925919 +0000 UTC m=+53.702266319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert") pod "ingress-canary-g6jss" (UID: "810a54ac-0eef-4d57-99d4-445ec95baf54") : secret "canary-serving-cert" not found Jun 03 15:35:54.310747 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:54.310703 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:35:54.311134 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:54.310812 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:35:54.311134 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:54.310823 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b6d8fc4-cgj7p: secret "image-registry-tls" not found Jun 03 15:35:54.311134 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:54.310878 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls podName:0635a806-e1e7-49c3-a61b-b62a71f02951 nodeName:}" failed. No retries permitted until 2026-06-03 15:36:10.31086486 +0000 UTC m=+69.660205261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls") pod "image-registry-59b6d8fc4-cgj7p" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951") : secret "image-registry-tls" not found Jun 03 15:35:54.411209 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:54.411180 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:35:54.411350 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:35:54.411215 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:35:54.411350 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:54.411308 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:35:54.411487 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:54.411355 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert podName:810a54ac-0eef-4d57-99d4-445ec95baf54 nodeName:}" failed. No retries permitted until 2026-06-03 15:36:10.4113427 +0000 UTC m=+69.760683103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert") pod "ingress-canary-g6jss" (UID: "810a54ac-0eef-4d57-99d4-445ec95baf54") : secret "canary-serving-cert" not found Jun 03 15:35:54.411487 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:54.411394 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:35:54.411487 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:35:54.411450 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls podName:a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:36:10.41143414 +0000 UTC m=+69.760774542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls") pod "dns-default-gpxtd" (UID: "a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3") : secret "dns-default-metrics-tls" not found Jun 03 15:36:02.787448 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.787406 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6"] Jun 03 15:36:02.830482 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.830462 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6"] Jun 03 15:36:02.830604 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.830555 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.834163 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.834143 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 15:36:02.834309 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.834148 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 15:36:02.834309 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.834148 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 15:36:02.834516 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.834473 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 15:36:02.834516 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.834497 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 15:36:02.834680 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.834556 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 15:36:02.834680 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.834563 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 15:36:02.870944 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.870919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.871045 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.871026 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-hub\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.871094 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.871054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-ca\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.871094 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.871087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.871192 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.871106 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.871246 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.871186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7sj\" (UniqueName: \"kubernetes.io/projected/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-kube-api-access-fr7sj\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.971586 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.971558 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-hub\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.971586 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.971587 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-ca\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.971743 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.971625 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.971743 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.971649 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.971832 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.971748 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7sj\" (UniqueName: \"kubernetes.io/projected/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-kube-api-access-fr7sj\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.971832 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.971783 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.972202 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.972172 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.974778 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.974752 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.974872 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.974857 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-hub\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.974912 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.974863 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.974946 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.974911 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-ca\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:02.979721 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:02.979701 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7sj\" (UniqueName: \"kubernetes.io/projected/f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43-kube-api-access-fr7sj\") pod \"cluster-proxy-proxy-agent-6c5f856585-rlbk6\" (UID: \"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:03.146584 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:03.146528 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:36:03.299023 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:03.298995 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6"] Jun 03 15:36:03.301940 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:36:03.301897 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2d10a56_aa62_48cb_9dc1_0e8eb2f78f43.slice/crio-35c5c0fc4039de435108b34dc871ba1735528483e51728ff7cac5bbd74f38e2e WatchSource:0}: Error finding container 35c5c0fc4039de435108b34dc871ba1735528483e51728ff7cac5bbd74f38e2e: Status 404 returned error can't find the container with id 35c5c0fc4039de435108b34dc871ba1735528483e51728ff7cac5bbd74f38e2e Jun 03 15:36:03.405946 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:03.405892 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" event={"ID":"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43","Type":"ContainerStarted","Data":"35c5c0fc4039de435108b34dc871ba1735528483e51728ff7cac5bbd74f38e2e"} Jun 03 15:36:04.368237 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:04.368198 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x44sn" Jun 03 15:36:06.902866 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:06.902838 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:36:06.903103 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:06.902904 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:36:06.905923 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:06.905906 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:36:06.905976 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:06.905906 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:36:06.914029 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:06.914009 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 15:36:06.914167 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:06.914072 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs podName:ee7c8c93-375b-4bb6-9f38-380932825b76 nodeName:}" failed. No retries permitted until 2026-06-03 15:37:10.914055011 +0000 UTC m=+130.263395424 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs") pod "network-metrics-daemon-sp6lm" (UID: "ee7c8c93-375b-4bb6-9f38-380932825b76") : secret "metrics-daemon-secret" not found Jun 03 15:36:06.916647 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:06.916631 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:36:06.926330 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:06.926312 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd8c5\" (UniqueName: \"kubernetes.io/projected/ab35a92c-ab3a-41b2-b835-a560fa81c4a4-kube-api-access-wd8c5\") pod \"network-check-target-2k5tc\" (UID: \"ab35a92c-ab3a-41b2-b835-a560fa81c4a4\") " pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:36:07.224430 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.224352 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zg94t\"" Jun 03 15:36:07.231607 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.231585 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:36:07.361891 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.361864 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2k5tc"] Jun 03 15:36:07.364736 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:36:07.364708 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab35a92c_ab3a_41b2_b835_a560fa81c4a4.slice/crio-0fa52affb2b44bc6880cc2b00e2d733581148a6a0df9998fb0d98c95bdc7d743 WatchSource:0}: Error finding container 0fa52affb2b44bc6880cc2b00e2d733581148a6a0df9998fb0d98c95bdc7d743: Status 404 returned error can't find the container with id 0fa52affb2b44bc6880cc2b00e2d733581148a6a0df9998fb0d98c95bdc7d743 Jun 03 15:36:07.414511 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.414483 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" event={"ID":"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43","Type":"ContainerStarted","Data":"f24c56706525b81aa18fd2ad70155c3f541b00ddc03fec03381fbccf81c82439"} Jun 03 15:36:07.415468 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.415440 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2k5tc" event={"ID":"ab35a92c-ab3a-41b2-b835-a560fa81c4a4","Type":"ContainerStarted","Data":"0fa52affb2b44bc6880cc2b00e2d733581148a6a0df9998fb0d98c95bdc7d743"} Jun 03 15:36:07.810175 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.810145 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:36:07.813081 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.813060 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:36:07.823500 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.823445 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44cc2e50-46ea-4f5e-b6cc-aad762692538-original-pull-secret\") pod \"global-pull-secret-syncer-76xsx\" (UID: \"44cc2e50-46ea-4f5e-b6cc-aad762692538\") " pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:36:07.832584 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.832557 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76xsx" Jun 03 15:36:07.995013 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:07.994962 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-76xsx"] Jun 03 15:36:07.999645 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:36:07.998631 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cc2e50_46ea_4f5e_b6cc_aad762692538.slice/crio-ed042041d13b4bc3e308787ae1a65662303f816ebea079db1aac60274dc8b56c WatchSource:0}: Error finding container ed042041d13b4bc3e308787ae1a65662303f816ebea079db1aac60274dc8b56c: Status 404 returned error can't find the container with id ed042041d13b4bc3e308787ae1a65662303f816ebea079db1aac60274dc8b56c Jun 03 15:36:08.418347 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:08.418294 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-76xsx" event={"ID":"44cc2e50-46ea-4f5e-b6cc-aad762692538","Type":"ContainerStarted","Data":"ed042041d13b4bc3e308787ae1a65662303f816ebea079db1aac60274dc8b56c"} Jun 03 15:36:10.332678 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:10.332645 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:36:10.333126 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:10.332818 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:36:10.333126 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:10.332838 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b6d8fc4-cgj7p: secret "image-registry-tls" not found Jun 03 15:36:10.333126 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:10.332942 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls podName:0635a806-e1e7-49c3-a61b-b62a71f02951 nodeName:}" failed. No retries permitted until 2026-06-03 15:36:42.332919626 +0000 UTC m=+101.682260038 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls") pod "image-registry-59b6d8fc4-cgj7p" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951") : secret "image-registry-tls" not found Jun 03 15:36:10.434063 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:10.434012 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:36:10.434063 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:10.434062 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:36:10.434267 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:10.434167 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:36:10.434267 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:10.434218 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:36:10.434267 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:10.434240 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert podName:810a54ac-0eef-4d57-99d4-445ec95baf54 nodeName:}" failed. No retries permitted until 2026-06-03 15:36:42.43422272 +0000 UTC m=+101.783563134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert") pod "ingress-canary-g6jss" (UID: "810a54ac-0eef-4d57-99d4-445ec95baf54") : secret "canary-serving-cert" not found Jun 03 15:36:10.434267 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:10.434258 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls podName:a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:36:42.434249437 +0000 UTC m=+101.783589848 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls") pod "dns-default-gpxtd" (UID: "a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3") : secret "dns-default-metrics-tls" not found Jun 03 15:36:13.429304 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:13.429267 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-76xsx" event={"ID":"44cc2e50-46ea-4f5e-b6cc-aad762692538","Type":"ContainerStarted","Data":"cff7b4c914ac2db0f16b7c7a37f3860c8441238661da4aa25a3be99f93ca040a"} Jun 03 15:36:13.431055 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:13.431031 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" event={"ID":"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43","Type":"ContainerStarted","Data":"6c9e7eea703afa90ef4fe131b0253447f499574cbe398e20a962fc56e7414720"} Jun 03 15:36:13.431155 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:13.431062 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" event={"ID":"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43","Type":"ContainerStarted","Data":"0dd863e8c844aba098dad7a258665039681d208165f2b3e6aa8513e5d94b8f1d"} Jun 03 15:36:13.432349 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:13.432325 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2k5tc" event={"ID":"ab35a92c-ab3a-41b2-b835-a560fa81c4a4","Type":"ContainerStarted","Data":"83b1ae529c27350eaa5fbd082a003217cb1875a3f49f55a6fd6fee16467cd5a5"} Jun 03 15:36:13.432516 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:13.432502 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:36:13.462481 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:13.462435 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" podStartSLOduration=2.260945961 podStartE2EDuration="11.462424858s" podCreationTimestamp="2026-06-03 15:36:02 +0000 UTC" firstStartedPulling="2026-06-03 15:36:03.303683253 +0000 UTC m=+62.653023653" lastFinishedPulling="2026-06-03 15:36:12.505162136 +0000 UTC m=+71.854502550" observedRunningTime="2026-06-03 15:36:13.462204489 +0000 UTC m=+72.811544933" watchObservedRunningTime="2026-06-03 15:36:13.462424858 +0000 UTC m=+72.811765281" Jun 03 15:36:13.463029 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:13.463005 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-76xsx" podStartSLOduration=65.946888762 podStartE2EDuration="1m10.462999877s" podCreationTimestamp="2026-06-03 15:35:03 +0000 UTC" firstStartedPulling="2026-06-03 15:36:08.001011624 +0000 UTC m=+67.350352036" lastFinishedPulling="2026-06-03 15:36:12.517122742 +0000 UTC m=+71.866463151" observedRunningTime="2026-06-03 15:36:13.444975009 +0000 UTC m=+72.794315431" watchObservedRunningTime="2026-06-03 15:36:13.462999877 +0000 UTC m=+72.812340300" Jun 03 15:36:13.477246 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:13.477210 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2k5tc" podStartSLOduration=67.329165181 podStartE2EDuration="1m12.477204133s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:36:07.366638421 +0000 UTC m=+66.715978820" lastFinishedPulling="2026-06-03 15:36:12.514677365 +0000 UTC m=+71.864017772" observedRunningTime="2026-06-03 15:36:13.476925013 +0000 UTC m=+72.826265434" watchObservedRunningTime="2026-06-03 15:36:13.477204133 +0000 UTC m=+72.826544552" Jun 03 15:36:42.343928 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:42.343895 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:36:42.344341 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:42.344035 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:36:42.344341 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:42.344054 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b6d8fc4-cgj7p: secret "image-registry-tls" not found Jun 03 15:36:42.344341 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:42.344105 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls podName:0635a806-e1e7-49c3-a61b-b62a71f02951 nodeName:}" failed. No retries permitted until 2026-06-03 15:37:46.344091097 +0000 UTC m=+165.693431497 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls") pod "image-registry-59b6d8fc4-cgj7p" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951") : secret "image-registry-tls" not found Jun 03 15:36:42.444867 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:42.444836 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:36:42.445000 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:42.444870 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:36:42.445000 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:42.444960 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:36:42.445000 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:42.444974 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:36:42.445098 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:42.445014 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls podName:a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:37:46.445001297 +0000 UTC m=+165.794341697 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls") pod "dns-default-gpxtd" (UID: "a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3") : secret "dns-default-metrics-tls" not found Jun 03 15:36:42.445098 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:36:42.445027 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert podName:810a54ac-0eef-4d57-99d4-445ec95baf54 nodeName:}" failed. No retries permitted until 2026-06-03 15:37:46.445021385 +0000 UTC m=+165.794361786 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert") pod "ingress-canary-g6jss" (UID: "810a54ac-0eef-4d57-99d4-445ec95baf54") : secret "canary-serving-cert" not found Jun 03 15:36:44.437258 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:36:44.437222 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2k5tc" Jun 03 15:37:10.941872 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:10.941832 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:37:10.942353 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:10.941980 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 15:37:10.942353 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:10.942058 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs podName:ee7c8c93-375b-4bb6-9f38-380932825b76 nodeName:}" failed. No retries permitted until 2026-06-03 15:39:12.942041869 +0000 UTC m=+252.291382273 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs") pod "network-metrics-daemon-sp6lm" (UID: "ee7c8c93-375b-4bb6-9f38-380932825b76") : secret "metrics-daemon-secret" not found Jun 03 15:37:20.065294 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:20.065263 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zvn5n_01bf0c95-a9ef-4d1e-835a-6bb767fcdd95/dns-node-resolver/0.log" Jun 03 15:37:21.064317 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:21.064281 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ngwtl_f50f2af2-fbef-4ee8-8657-9a5b186747d4/node-ca/0.log" Jun 03 15:37:31.348803 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.348771 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p8ljc"] Jun 03 15:37:31.354302 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.354278 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.357034 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.357014 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 15:37:31.358309 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.358286 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 15:37:31.358309 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.358301 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t7t4l\"" Jun 03 15:37:31.358501 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.358325 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 15:37:31.358501 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.358305 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 15:37:31.363006 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.362988 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p8ljc"] Jun 03 15:37:31.373776 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.373756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.373861 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.373800 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8q96\" (UniqueName: \"kubernetes.io/projected/0765c928-5b84-4b72-ac0b-be2d01bfbc98-kube-api-access-k8q96\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.373861 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.373846 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0765c928-5b84-4b72-ac0b-be2d01bfbc98-data-volume\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.373938 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.373867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0765c928-5b84-4b72-ac0b-be2d01bfbc98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.373938 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.373902 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0765c928-5b84-4b72-ac0b-be2d01bfbc98-crio-socket\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.474895 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.474872 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0765c928-5b84-4b72-ac0b-be2d01bfbc98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.475003 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.474916 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0765c928-5b84-4b72-ac0b-be2d01bfbc98-crio-socket\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.475003 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.474968 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.475113 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.475015 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8q96\" (UniqueName: \"kubernetes.io/projected/0765c928-5b84-4b72-ac0b-be2d01bfbc98-kube-api-access-k8q96\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.475113 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.475074 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0765c928-5b84-4b72-ac0b-be2d01bfbc98-crio-socket\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.475113 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:31.475107 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 15:37:31.475627 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.475435 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0765c928-5b84-4b72-ac0b-be2d01bfbc98-data-volume\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.475859 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.475671 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0765c928-5b84-4b72-ac0b-be2d01bfbc98-data-volume\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.475937 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.475881 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0765c928-5b84-4b72-ac0b-be2d01bfbc98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.476096 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:31.476061 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls podName:0765c928-5b84-4b72-ac0b-be2d01bfbc98 nodeName:}" failed. No retries permitted until 2026-06-03 15:37:31.97603169 +0000 UTC m=+151.325372153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p8ljc" (UID: "0765c928-5b84-4b72-ac0b-be2d01bfbc98") : secret "insights-runtime-extractor-tls" not found Jun 03 15:37:31.486114 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.486088 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8q96\" (UniqueName: \"kubernetes.io/projected/0765c928-5b84-4b72-ac0b-be2d01bfbc98-kube-api-access-k8q96\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.978406 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:31.978350 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:31.978566 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:31.978509 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 15:37:31.978605 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:31.978587 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls podName:0765c928-5b84-4b72-ac0b-be2d01bfbc98 nodeName:}" failed. No retries permitted until 2026-06-03 15:37:32.978571574 +0000 UTC m=+152.327911974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p8ljc" (UID: "0765c928-5b84-4b72-ac0b-be2d01bfbc98") : secret "insights-runtime-extractor-tls" not found Jun 03 15:37:32.984525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:32.984480 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:32.984936 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:32.984625 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 15:37:32.984936 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:32.984705 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls podName:0765c928-5b84-4b72-ac0b-be2d01bfbc98 nodeName:}" failed. No retries permitted until 2026-06-03 15:37:34.984686762 +0000 UTC m=+154.334027161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p8ljc" (UID: "0765c928-5b84-4b72-ac0b-be2d01bfbc98") : secret "insights-runtime-extractor-tls" not found Jun 03 15:37:34.995873 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:34.995833 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:34.996295 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:34.995987 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 15:37:34.996295 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:34.996085 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls podName:0765c928-5b84-4b72-ac0b-be2d01bfbc98 nodeName:}" failed. No retries permitted until 2026-06-03 15:37:38.996066591 +0000 UTC m=+158.345406990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p8ljc" (UID: "0765c928-5b84-4b72-ac0b-be2d01bfbc98") : secret "insights-runtime-extractor-tls" not found Jun 03 15:37:39.026212 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:39.026174 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:39.028779 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:39.028743 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0765c928-5b84-4b72-ac0b-be2d01bfbc98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p8ljc\" (UID: \"0765c928-5b84-4b72-ac0b-be2d01bfbc98\") " pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:39.162964 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:39.162929 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p8ljc" Jun 03 15:37:39.282767 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:39.282600 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p8ljc"] Jun 03 15:37:39.285280 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:37:39.285246 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0765c928_5b84_4b72_ac0b_be2d01bfbc98.slice/crio-82ad77f621847e75e03191810ea66e24d07b6e660c85bba44f3245f0b316780f WatchSource:0}: Error finding container 82ad77f621847e75e03191810ea66e24d07b6e660c85bba44f3245f0b316780f: Status 404 returned error can't find the container with id 82ad77f621847e75e03191810ea66e24d07b6e660c85bba44f3245f0b316780f Jun 03 15:37:39.605585 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:39.605511 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p8ljc" event={"ID":"0765c928-5b84-4b72-ac0b-be2d01bfbc98","Type":"ContainerStarted","Data":"003a498897b55dbab70325c0da50e77248ecd18bb7678e7b2f54a58aab3a4140"} Jun 03 15:37:39.605585 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:39.605547 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p8ljc" event={"ID":"0765c928-5b84-4b72-ac0b-be2d01bfbc98","Type":"ContainerStarted","Data":"82ad77f621847e75e03191810ea66e24d07b6e660c85bba44f3245f0b316780f"} Jun 03 15:37:40.609099 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:40.609068 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p8ljc" event={"ID":"0765c928-5b84-4b72-ac0b-be2d01bfbc98","Type":"ContainerStarted","Data":"4174c81ac2a3336678bed036c1c18df197badab1fab0f1ff535fafca57f80ea8"} Jun 03 15:37:41.585031 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:41.584987 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" podUID="0635a806-e1e7-49c3-a61b-b62a71f02951" Jun 03 15:37:41.609665 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:41.609623 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gpxtd" podUID="a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3" Jun 03 15:37:41.614171 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:41.612247 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:37:41.634332 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:41.634303 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-g6jss" podUID="810a54ac-0eef-4d57-99d4-445ec95baf54" Jun 03 15:37:42.616996 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:42.616958 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p8ljc" event={"ID":"0765c928-5b84-4b72-ac0b-be2d01bfbc98","Type":"ContainerStarted","Data":"4f198d9eb949e3101c5df5c4d9aca0573c7b0222ab3bb5a645f13be171925e68"} Jun 03 15:37:42.617391 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:42.617044 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpxtd" Jun 03 15:37:42.641598 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:42.641555 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p8ljc" podStartSLOduration=9.113812145 podStartE2EDuration="11.641543014s" podCreationTimestamp="2026-06-03 15:37:31 +0000 UTC" firstStartedPulling="2026-06-03 15:37:39.334918423 +0000 UTC m=+158.684258824" lastFinishedPulling="2026-06-03 15:37:41.862649281 +0000 UTC m=+161.211989693" observedRunningTime="2026-06-03 15:37:42.639719693 +0000 UTC m=+161.989060152" watchObservedRunningTime="2026-06-03 15:37:42.641543014 +0000 UTC m=+161.990883455" Jun 03 15:37:43.227776 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:37:43.227743 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sp6lm" podUID="ee7c8c93-375b-4bb6-9f38-380932825b76" Jun 03 15:37:46.377545 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.377453 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:37:46.379685 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.379664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"image-registry-59b6d8fc4-cgj7p\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:37:46.415880 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.415860 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jwg26\"" Jun 03 15:37:46.423952 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.423935 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:37:46.477928 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.477897 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:37:46.478059 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.477944 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:37:46.480766 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.480714 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3-metrics-tls\") pod \"dns-default-gpxtd\" (UID: \"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3\") " pod="openshift-dns/dns-default-gpxtd" Jun 03 15:37:46.480876 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.480776 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/810a54ac-0eef-4d57-99d4-445ec95baf54-cert\") pod \"ingress-canary-g6jss\" (UID: \"810a54ac-0eef-4d57-99d4-445ec95baf54\") " pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:37:46.520468 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.520443 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pf8ss\"" Jun 03 15:37:46.528601 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.528582 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpxtd" Jun 03 15:37:46.548463 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.548438 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59b6d8fc4-cgj7p"] Jun 03 15:37:46.551102 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:37:46.551077 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0635a806_e1e7_49c3_a61b_b62a71f02951.slice/crio-6417f05263d4e3c131ec2dd5925ec9ffc6e90dce0288f34e0c0c8b42871e72c0 WatchSource:0}: Error finding container 6417f05263d4e3c131ec2dd5925ec9ffc6e90dce0288f34e0c0c8b42871e72c0: Status 404 returned error can't find the container with id 6417f05263d4e3c131ec2dd5925ec9ffc6e90dce0288f34e0c0c8b42871e72c0 Jun 03 15:37:46.629012 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.628945 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" event={"ID":"0635a806-e1e7-49c3-a61b-b62a71f02951","Type":"ContainerStarted","Data":"b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982"} Jun 03 15:37:46.629012 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.628986 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" event={"ID":"0635a806-e1e7-49c3-a61b-b62a71f02951","Type":"ContainerStarted","Data":"6417f05263d4e3c131ec2dd5925ec9ffc6e90dce0288f34e0c0c8b42871e72c0"} Jun 03 15:37:46.629172 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.629134 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:37:46.647681 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:46.647657 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gpxtd"] Jun 03 15:37:46.650929 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:37:46.650898 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ab8adc_991c_4d6c_b78c_33bd6d52c6d3.slice/crio-4191b4a9777e33b15b7d93565cca68470951642ba5c3bdb2df9160ea36ae49a3 WatchSource:0}: Error finding container 4191b4a9777e33b15b7d93565cca68470951642ba5c3bdb2df9160ea36ae49a3: Status 404 returned error can't find the container with id 4191b4a9777e33b15b7d93565cca68470951642ba5c3bdb2df9160ea36ae49a3 Jun 03 15:37:47.632933 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:47.632884 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpxtd" event={"ID":"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3","Type":"ContainerStarted","Data":"4191b4a9777e33b15b7d93565cca68470951642ba5c3bdb2df9160ea36ae49a3"} Jun 03 15:37:48.637830 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:48.637790 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpxtd" event={"ID":"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3","Type":"ContainerStarted","Data":"43df32eb23d40ec57343afb14405b6e6e457abc732887d8b71c8ed91a37cb037"} Jun 03 15:37:48.637830 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:48.637834 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpxtd" event={"ID":"a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3","Type":"ContainerStarted","Data":"2cd367e7a0a0847e9cc2b6494a2d7db3053a51f490c70ecacaa819bedf4a982f"} Jun 03 15:37:48.638219 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:48.637873 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gpxtd" Jun 03 15:37:48.655923 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:48.655881 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" podStartSLOduration=144.655869356 podStartE2EDuration="2m24.655869356s" podCreationTimestamp="2026-06-03 15:35:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:37:46.649832452 +0000 UTC m=+165.999172897" watchObservedRunningTime="2026-06-03 15:37:48.655869356 +0000 UTC m=+168.005209779" Jun 03 15:37:48.656289 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:48.656257 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-gpxtd" podStartSLOduration=129.39624639 podStartE2EDuration="2m10.656252592s" podCreationTimestamp="2026-06-03 15:35:38 +0000 UTC" firstStartedPulling="2026-06-03 15:37:46.652649725 +0000 UTC m=+166.001990125" lastFinishedPulling="2026-06-03 15:37:47.912655927 +0000 UTC m=+167.261996327" observedRunningTime="2026-06-03 15:37:48.655581446 +0000 UTC m=+168.004921869" watchObservedRunningTime="2026-06-03 15:37:48.656252592 +0000 UTC m=+168.005593013" Jun 03 15:37:52.350741 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.350706 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs"] Jun 03 15:37:52.353476 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.353453 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h"] Jun 03 15:37:52.353622 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.353600 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs" Jun 03 15:37:52.355238 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.355217 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" Jun 03 15:37:52.371159 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.371142 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 15:37:52.371412 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.371396 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ghggk\"" Jun 03 15:37:52.371903 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.371888 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59b6d8fc4-cgj7p"] Jun 03 15:37:52.377845 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.377828 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hqmm7\"" Jun 03 15:37:52.399606 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.399586 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs"] Jun 03 15:37:52.400318 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.400297 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h"] Jun 03 15:37:52.417537 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.417514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8da9271c-f5f8-4bd4-bb4d-aab8ee4e2327-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-8qw8h\" (UID: \"8da9271c-f5f8-4bd4-bb4d-aab8ee4e2327\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" Jun 03 15:37:52.417622 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.417562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xx6v\" (UniqueName: \"kubernetes.io/projected/b4b70f5d-1d81-4696-b5b7-afb19d82828f-kube-api-access-8xx6v\") pod \"network-check-source-56d84b9f44-xnlbs\" (UID: \"b4b70f5d-1d81-4696-b5b7-afb19d82828f\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs" Jun 03 15:37:52.518101 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.518078 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8da9271c-f5f8-4bd4-bb4d-aab8ee4e2327-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-8qw8h\" (UID: \"8da9271c-f5f8-4bd4-bb4d-aab8ee4e2327\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" Jun 03 15:37:52.518211 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.518123 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xx6v\" (UniqueName: \"kubernetes.io/projected/b4b70f5d-1d81-4696-b5b7-afb19d82828f-kube-api-access-8xx6v\") pod \"network-check-source-56d84b9f44-xnlbs\" (UID: \"b4b70f5d-1d81-4696-b5b7-afb19d82828f\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs" Jun 03 15:37:52.520449 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.520427 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8da9271c-f5f8-4bd4-bb4d-aab8ee4e2327-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-8qw8h\" (UID: \"8da9271c-f5f8-4bd4-bb4d-aab8ee4e2327\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" Jun 03 15:37:52.526498 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.526481 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xx6v\" (UniqueName: \"kubernetes.io/projected/b4b70f5d-1d81-4696-b5b7-afb19d82828f-kube-api-access-8xx6v\") pod \"network-check-source-56d84b9f44-xnlbs\" (UID: \"b4b70f5d-1d81-4696-b5b7-afb19d82828f\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs" Jun 03 15:37:52.662934 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.662875 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs" Jun 03 15:37:52.667514 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.667493 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" Jun 03 15:37:52.785562 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.785535 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs"] Jun 03 15:37:52.788850 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:37:52.788825 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b70f5d_1d81_4696_b5b7_afb19d82828f.slice/crio-808eddcd740b225c20e005aaf427ebfb617b95fe8274eae36e6ade0d48f96409 WatchSource:0}: Error finding container 808eddcd740b225c20e005aaf427ebfb617b95fe8274eae36e6ade0d48f96409: Status 404 returned error can't find the container with id 808eddcd740b225c20e005aaf427ebfb617b95fe8274eae36e6ade0d48f96409 Jun 03 15:37:52.801098 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:52.801074 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h"] Jun 03 15:37:52.803813 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:37:52.803745 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da9271c_f5f8_4bd4_bb4d_aab8ee4e2327.slice/crio-bd97aa06304543e9e9643fe755f1f871fe79c000c18002b38ff454afee7f5c4c WatchSource:0}: Error finding container bd97aa06304543e9e9643fe755f1f871fe79c000c18002b38ff454afee7f5c4c: Status 404 returned error can't find the container with id bd97aa06304543e9e9643fe755f1f871fe79c000c18002b38ff454afee7f5c4c Jun 03 15:37:53.652661 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:53.652625 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" event={"ID":"8da9271c-f5f8-4bd4-bb4d-aab8ee4e2327","Type":"ContainerStarted","Data":"bd97aa06304543e9e9643fe755f1f871fe79c000c18002b38ff454afee7f5c4c"} Jun 03 15:37:53.654115 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:53.654089 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs" event={"ID":"b4b70f5d-1d81-4696-b5b7-afb19d82828f","Type":"ContainerStarted","Data":"09333ea7cae8928f3c943e686c73ab2d8225ffcf3ab16ee96a59badc88316be9"} Jun 03 15:37:53.654258 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:53.654120 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs" event={"ID":"b4b70f5d-1d81-4696-b5b7-afb19d82828f","Type":"ContainerStarted","Data":"808eddcd740b225c20e005aaf427ebfb617b95fe8274eae36e6ade0d48f96409"} Jun 03 15:37:53.668597 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:53.668553 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xnlbs" podStartSLOduration=1.668540551 podStartE2EDuration="1.668540551s" podCreationTimestamp="2026-06-03 15:37:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:37:53.668011464 +0000 UTC m=+173.017351900" watchObservedRunningTime="2026-06-03 15:37:53.668540551 +0000 UTC m=+173.017880972" Jun 03 15:37:54.658443 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:54.658406 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" event={"ID":"8da9271c-f5f8-4bd4-bb4d-aab8ee4e2327","Type":"ContainerStarted","Data":"b983b501f28609905ff4a6d341d34144c4a77690d94354929160bbc7d61add9d"} Jun 03 15:37:54.673781 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:54.673737 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" podStartSLOduration=1.633729183 podStartE2EDuration="2.673724415s" podCreationTimestamp="2026-06-03 15:37:52 +0000 UTC" firstStartedPulling="2026-06-03 15:37:52.805803399 +0000 UTC m=+172.155143798" lastFinishedPulling="2026-06-03 15:37:53.845798616 +0000 UTC m=+173.195139030" observedRunningTime="2026-06-03 15:37:54.672950884 +0000 UTC m=+174.022291305" watchObservedRunningTime="2026-06-03 15:37:54.673724415 +0000 UTC m=+174.023064837" Jun 03 15:37:55.211473 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:55.211431 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:37:55.214416 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:55.214396 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zqgtx\"" Jun 03 15:37:55.222479 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:55.222463 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6jss" Jun 03 15:37:55.356146 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:55.356112 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6jss"] Jun 03 15:37:55.360469 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:37:55.360441 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810a54ac_0eef_4d57_99d4_445ec95baf54.slice/crio-82d5e44565a3f9972fcb364f30291f0631f98842b409f8ceb80dd2c5f36cf263 WatchSource:0}: Error finding container 82d5e44565a3f9972fcb364f30291f0631f98842b409f8ceb80dd2c5f36cf263: Status 404 returned error can't find the container with id 82d5e44565a3f9972fcb364f30291f0631f98842b409f8ceb80dd2c5f36cf263 Jun 03 15:37:55.661966 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:55.661927 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6jss" event={"ID":"810a54ac-0eef-4d57-99d4-445ec95baf54","Type":"ContainerStarted","Data":"82d5e44565a3f9972fcb364f30291f0631f98842b409f8ceb80dd2c5f36cf263"} Jun 03 15:37:55.662357 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:55.662097 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" Jun 03 15:37:55.666695 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:55.666675 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-8qw8h" Jun 03 15:37:57.211424 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:57.211334 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:37:57.669816 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:57.669780 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6jss" event={"ID":"810a54ac-0eef-4d57-99d4-445ec95baf54","Type":"ContainerStarted","Data":"fd5a98e9e2b8ea0d69b7151d3dd30cec840b1c5379b70d66e0b51dccdf35112d"} Jun 03 15:37:57.686861 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:57.686821 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g6jss" podStartSLOduration=138.17458577 podStartE2EDuration="2m19.686806114s" podCreationTimestamp="2026-06-03 15:35:38 +0000 UTC" firstStartedPulling="2026-06-03 15:37:55.362180135 +0000 UTC m=+174.711520539" lastFinishedPulling="2026-06-03 15:37:56.874400483 +0000 UTC m=+176.223740883" observedRunningTime="2026-06-03 15:37:57.686036535 +0000 UTC m=+177.035376957" watchObservedRunningTime="2026-06-03 15:37:57.686806114 +0000 UTC m=+177.036146530" Jun 03 15:37:58.643169 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:37:58.643138 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gpxtd" Jun 03 15:38:00.894914 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.894877 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv"] Jun 03 15:38:00.897189 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.897172 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:00.904220 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.904190 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:38:00.904353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.904198 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:38:00.904353 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.904260 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:38:00.905640 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.905620 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 15:38:00.905786 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.905725 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 15:38:00.905836 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.905798 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sj544\"" Jun 03 15:38:00.908239 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.908223 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 15:38:00.916942 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.916922 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv"] Jun 03 15:38:00.975569 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.975546 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:00.975666 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.975577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c68ce1a-c072-4702-9d2e-3d246af3d527-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:00.975666 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.975595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2c68ce1a-c072-4702-9d2e-3d246af3d527-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:00.975666 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.975619 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:00.975828 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.975727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p5x4\" (UniqueName: \"kubernetes.io/projected/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-api-access-4p5x4\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:00.975828 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:00.975789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.009795 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.009772 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cmjtz"] Jun 03 15:38:01.011811 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.011799 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.014544 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.014526 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jxsdh\"" Jun 03 15:38:01.014649 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.014595 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:38:01.015294 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.015279 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:38:01.016457 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.016436 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:38:01.076005 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.075983 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c68ce1a-c072-4702-9d2e-3d246af3d527-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.076091 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076010 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-metrics-client-ca\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.076091 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076029 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2c68ce1a-c072-4702-9d2e-3d246af3d527-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.076091 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076046 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.076249 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076154 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-textfile\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.076249 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-root\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.076249 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076234 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4p5x4\" (UniqueName: \"kubernetes.io/projected/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-api-access-4p5x4\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.076443 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-tls\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.076443 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-accelerators-collector-config\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.076443 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-sys\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.076443 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-wtmp\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.076443 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076419 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftjbj\" (UniqueName: \"kubernetes.io/projected/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-kube-api-access-ftjbj\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.076443 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076441 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2c68ce1a-c072-4702-9d2e-3d246af3d527-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.076636 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076460 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.076636 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.076636 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.076525 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.080073 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.080056 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:38:01.080142 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.080056 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 15:38:01.080435 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.080420 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 15:38:01.080691 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.080677 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 15:38:01.087102 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:38:01.087079 2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 03 15:38:01.087199 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:38:01.087137 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-tls podName:2c68ce1a-c072-4702-9d2e-3d246af3d527 nodeName:}" failed. No retries permitted until 2026-06-03 15:38:01.587122576 +0000 UTC m=+180.936462976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-dn7bv" (UID: "2c68ce1a-c072-4702-9d2e-3d246af3d527") : secret "kube-state-metrics-tls" not found Jun 03 15:38:01.087547 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.087529 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c68ce1a-c072-4702-9d2e-3d246af3d527-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.087639 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.087620 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.089314 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.089295 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.091603 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.091584 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:38:01.101908 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.101890 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:38:01.111491 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.111467 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p5x4\" (UniqueName: \"kubernetes.io/projected/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-api-access-4p5x4\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.176799 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176737 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-accelerators-collector-config\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.176799 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176765 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-sys\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.176799 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176785 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-wtmp\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.176976 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176810 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftjbj\" (UniqueName: \"kubernetes.io/projected/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-kube-api-access-ftjbj\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.176976 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176843 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-sys\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.176976 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176859 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.176976 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176896 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-metrics-client-ca\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.176976 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176919 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-wtmp\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.176976 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176926 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-textfile\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.177267 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.176997 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-root\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.177267 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.177033 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-tls\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.177267 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.177100 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-root\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.177267 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.177221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-textfile\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.177561 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.177543 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-metrics-client-ca\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.180981 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.180967 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:38:01.181140 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.181128 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:38:01.181317 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.181306 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:38:01.185297 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.185276 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftjbj\" (UniqueName: \"kubernetes.io/projected/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-kube-api-access-ftjbj\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.187595 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.187575 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-accelerators-collector-config\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.189262 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.189240 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-tls\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.189375 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.189276 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0ad64fa-85bf-482d-9d42-0d8eedf06b69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cmjtz\" (UID: \"b0ad64fa-85bf-482d-9d42-0d8eedf06b69\") " pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.323499 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.323479 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jxsdh\"" Jun 03 15:38:01.330759 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.330736 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cmjtz" Jun 03 15:38:01.338893 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:38:01.338872 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ad64fa_85bf_482d_9d42_0d8eedf06b69.slice/crio-ae2809d3a39493ea44e35adf753ec3853c92fdcb619f45ddd009aaa9b23a7511 WatchSource:0}: Error finding container ae2809d3a39493ea44e35adf753ec3853c92fdcb619f45ddd009aaa9b23a7511: Status 404 returned error can't find the container with id ae2809d3a39493ea44e35adf753ec3853c92fdcb619f45ddd009aaa9b23a7511 Jun 03 15:38:01.679702 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.679670 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.679878 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.679821 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmjtz" event={"ID":"b0ad64fa-85bf-482d-9d42-0d8eedf06b69","Type":"ContainerStarted","Data":"ae2809d3a39493ea44e35adf753ec3853c92fdcb619f45ddd009aaa9b23a7511"} Jun 03 15:38:01.682086 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.682065 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c68ce1a-c072-4702-9d2e-3d246af3d527-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-dn7bv\" (UID: \"2c68ce1a-c072-4702-9d2e-3d246af3d527\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.809660 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.809634 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sj544\"" Jun 03 15:38:01.817409 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.817387 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" Jun 03 15:38:01.934978 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.934886 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:38:01.938620 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.938594 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.941275 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.941256 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4pl75\"" Jun 03 15:38:01.941517 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.941501 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 15:38:01.941629 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.941609 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 15:38:01.941682 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.941611 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 15:38:01.941736 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.941680 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 15:38:01.941736 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.941693 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 15:38:01.941837 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.941734 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 15:38:01.941914 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.941897 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 15:38:01.941957 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.941916 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 15:38:01.942188 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.942170 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 15:38:01.950414 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.950398 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv"] Jun 03 15:38:01.952889 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:38:01.952866 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c68ce1a_c072_4702_9d2e_3d246af3d527.slice/crio-eabbd149eb584b74f68e62d1eba379fb6114b6e94724249543b2d2e9c6fb5a53 WatchSource:0}: Error finding container eabbd149eb584b74f68e62d1eba379fb6114b6e94724249543b2d2e9c6fb5a53: Status 404 returned error can't find the container with id eabbd149eb584b74f68e62d1eba379fb6114b6e94724249543b2d2e9c6fb5a53 Jun 03 15:38:01.953563 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.953473 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:38:01.982881 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.982860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-out\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.982988 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.982898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.982988 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.982928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.982988 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.982961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.983164 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.982990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.983164 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.983022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.983164 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.983052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh6v5\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-kube-api-access-bh6v5\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.983164 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.983100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.983359 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.983222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.983359 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.983254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-volume\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.983359 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.983275 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.983359 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.983301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:01.983508 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:01.983378 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-web-config\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084405 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084352 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084548 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084433 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084548 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084463 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-volume\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084548 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:38:02.084469 2568 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 15:38:02.084548 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084496 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084548 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:38:02.084533 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-main-tls podName:9458be5c-f23d-42b9-ba99-9f4bac4ececa nodeName:}" failed. No retries permitted until 2026-06-03 15:38:02.584514163 +0000 UTC m=+181.933854568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa") : secret "alertmanager-main-tls" not found Jun 03 15:38:02.084823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084557 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084594 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-web-config\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084641 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-out\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084667 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084695 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084720 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084756 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084795 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.084823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.084825 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bh6v5\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-kube-api-access-bh6v5\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.086405 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.085416 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.086405 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.086106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.086805 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:38:02.086710 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-trusted-ca-bundle podName:9458be5c-f23d-42b9-ba99-9f4bac4ececa nodeName:}" failed. No retries permitted until 2026-06-03 15:38:02.586692983 +0000 UTC m=+181.936033384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa") : configmap references non-existent config key: ca-bundle.crt Jun 03 15:38:02.087434 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.087412 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.087847 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.087808 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-volume\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.087999 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.087980 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.088082 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.087979 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.088205 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.088178 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-web-config\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.088798 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.088764 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.088908 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.088885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.088982 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.088943 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-out\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.093789 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.093766 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh6v5\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-kube-api-access-bh6v5\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.377427 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.377393 2568 patch_prober.go:28] interesting pod/image-registry-59b6d8fc4-cgj7p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 15:38:02.377591 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.377450 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" podUID="0635a806-e1e7-49c3-a61b-b62a71f02951" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 15:38:02.588543 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.588477 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.588675 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.588570 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.589329 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.589300 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.591011 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.590988 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:02.683567 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.683538 2568 generic.go:358] "Generic (PLEG): container finished" podID="b0ad64fa-85bf-482d-9d42-0d8eedf06b69" containerID="05d4841398c6c60f091c4f3e36e17703b00b7f9c1124beed1b5a8c6b984de0ca" exitCode=0 Jun 03 15:38:02.683699 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.683620 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmjtz" event={"ID":"b0ad64fa-85bf-482d-9d42-0d8eedf06b69","Type":"ContainerDied","Data":"05d4841398c6c60f091c4f3e36e17703b00b7f9c1124beed1b5a8c6b984de0ca"} Jun 03 15:38:02.684837 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.684809 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" event={"ID":"2c68ce1a-c072-4702-9d2e-3d246af3d527","Type":"ContainerStarted","Data":"eabbd149eb584b74f68e62d1eba379fb6114b6e94724249543b2d2e9c6fb5a53"} Jun 03 15:38:02.850501 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:02.850437 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:38:03.005962 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:03.005929 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:38:03.263161 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:38:03.263126 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9458be5c_f23d_42b9_ba99_9f4bac4ececa.slice/crio-f3ab4ee1721dec3c9c7ba15ed538e84bc0df58f67580b08a7bed73aced56d594 WatchSource:0}: Error finding container f3ab4ee1721dec3c9c7ba15ed538e84bc0df58f67580b08a7bed73aced56d594: Status 404 returned error can't find the container with id f3ab4ee1721dec3c9c7ba15ed538e84bc0df58f67580b08a7bed73aced56d594 Jun 03 15:38:03.690396 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:03.690275 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmjtz" event={"ID":"b0ad64fa-85bf-482d-9d42-0d8eedf06b69","Type":"ContainerStarted","Data":"c940ccc48732f916601e9a4850d4acb480c1f91ded11d537deb80f96ec346002"} Jun 03 15:38:03.690396 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:03.690318 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmjtz" event={"ID":"b0ad64fa-85bf-482d-9d42-0d8eedf06b69","Type":"ContainerStarted","Data":"c8985cff407147a4667c86635ac2f6ae41afd785f330c66bbc59d71a3c4b77a2"} Jun 03 15:38:03.692665 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:03.692637 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" event={"ID":"2c68ce1a-c072-4702-9d2e-3d246af3d527","Type":"ContainerStarted","Data":"f2bd7b85df91d503c4c7f954cdd047213c9366e328251950bd3dd7b097ffca90"} Jun 03 15:38:03.692804 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:03.692692 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" event={"ID":"2c68ce1a-c072-4702-9d2e-3d246af3d527","Type":"ContainerStarted","Data":"33a2b681f4c63e1392718008cd368247bff1445eebb1e55852b66faca45a63fc"} Jun 03 15:38:03.692804 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:03.692708 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" event={"ID":"2c68ce1a-c072-4702-9d2e-3d246af3d527","Type":"ContainerStarted","Data":"324d54f27f3549bf24a16acf5ce7e4fd27a57b9560507878ea274832e2c58792"} Jun 03 15:38:03.693812 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:03.693790 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerStarted","Data":"f3ab4ee1721dec3c9c7ba15ed538e84bc0df58f67580b08a7bed73aced56d594"} Jun 03 15:38:03.719137 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:03.719090 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cmjtz" podStartSLOduration=2.801699514 podStartE2EDuration="3.719078523s" podCreationTimestamp="2026-06-03 15:38:00 +0000 UTC" firstStartedPulling="2026-06-03 15:38:01.340852321 +0000 UTC m=+180.690192741" lastFinishedPulling="2026-06-03 15:38:02.258231346 +0000 UTC m=+181.607571750" observedRunningTime="2026-06-03 15:38:03.718142578 +0000 UTC m=+183.067483013" watchObservedRunningTime="2026-06-03 15:38:03.719078523 +0000 UTC m=+183.068418945" Jun 03 15:38:03.766646 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:03.766605 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-dn7bv" podStartSLOduration=2.415021467 podStartE2EDuration="3.766594379s" podCreationTimestamp="2026-06-03 15:38:00 +0000 UTC" firstStartedPulling="2026-06-03 15:38:01.955411707 +0000 UTC m=+181.304752121" lastFinishedPulling="2026-06-03 15:38:03.306984634 +0000 UTC m=+182.656325033" observedRunningTime="2026-06-03 15:38:03.764683812 +0000 UTC m=+183.114024233" watchObservedRunningTime="2026-06-03 15:38:03.766594379 +0000 UTC m=+183.115934800" Jun 03 15:38:04.697938 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:04.697867 2568 generic.go:358] "Generic (PLEG): container finished" podID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerID="2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e" exitCode=0 Jun 03 15:38:04.698237 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:04.697954 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerDied","Data":"2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e"} Jun 03 15:38:06.710172 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:06.710136 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerStarted","Data":"a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71"} Jun 03 15:38:06.710172 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:06.710173 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerStarted","Data":"b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35"} Jun 03 15:38:06.710558 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:06.710183 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerStarted","Data":"df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1"} Jun 03 15:38:06.710558 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:06.710192 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerStarted","Data":"0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20"} Jun 03 15:38:06.710558 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:06.710201 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerStarted","Data":"971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527"} Jun 03 15:38:07.715866 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:07.715791 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerStarted","Data":"d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5"} Jun 03 15:38:07.747173 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:07.747135 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.601990479 podStartE2EDuration="6.747122889s" podCreationTimestamp="2026-06-03 15:38:01 +0000 UTC" firstStartedPulling="2026-06-03 15:38:03.265110376 +0000 UTC m=+182.614450780" lastFinishedPulling="2026-06-03 15:38:07.410242772 +0000 UTC m=+186.759583190" observedRunningTime="2026-06-03 15:38:07.746684226 +0000 UTC m=+187.096024671" watchObservedRunningTime="2026-06-03 15:38:07.747122889 +0000 UTC m=+187.096463312" Jun 03 15:38:12.376452 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:12.376424 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:38:17.390610 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.390555 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" podUID="0635a806-e1e7-49c3-a61b-b62a71f02951" containerName="registry" containerID="cri-o://b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982" gracePeriod=30 Jun 03 15:38:17.619688 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.619666 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:38:17.706382 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.706295 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-trusted-ca\") pod \"0635a806-e1e7-49c3-a61b-b62a71f02951\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " Jun 03 15:38:17.706382 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.706325 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-bound-sa-token\") pod \"0635a806-e1e7-49c3-a61b-b62a71f02951\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " Jun 03 15:38:17.706382 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.706380 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") pod \"0635a806-e1e7-49c3-a61b-b62a71f02951\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " Jun 03 15:38:17.706620 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.706409 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-image-registry-private-configuration\") pod \"0635a806-e1e7-49c3-a61b-b62a71f02951\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " Jun 03 15:38:17.706620 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.706435 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-installation-pull-secrets\") pod \"0635a806-e1e7-49c3-a61b-b62a71f02951\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " Jun 03 15:38:17.706620 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.706468 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gbxg\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-kube-api-access-9gbxg\") pod \"0635a806-e1e7-49c3-a61b-b62a71f02951\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " Jun 03 15:38:17.706620 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.706545 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-certificates\") pod \"0635a806-e1e7-49c3-a61b-b62a71f02951\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " Jun 03 15:38:17.706620 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.706572 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0635a806-e1e7-49c3-a61b-b62a71f02951-ca-trust-extracted\") pod \"0635a806-e1e7-49c3-a61b-b62a71f02951\" (UID: \"0635a806-e1e7-49c3-a61b-b62a71f02951\") " Jun 03 15:38:17.707209 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.707106 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0635a806-e1e7-49c3-a61b-b62a71f02951" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:38:17.707423 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.707392 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0635a806-e1e7-49c3-a61b-b62a71f02951" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:38:17.709304 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.709277 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-kube-api-access-9gbxg" (OuterVolumeSpecName: "kube-api-access-9gbxg") pod "0635a806-e1e7-49c3-a61b-b62a71f02951" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951"). InnerVolumeSpecName "kube-api-access-9gbxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:38:17.709304 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.709291 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0635a806-e1e7-49c3-a61b-b62a71f02951" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:38:17.709304 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.709277 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0635a806-e1e7-49c3-a61b-b62a71f02951" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:38:17.709593 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.709540 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0635a806-e1e7-49c3-a61b-b62a71f02951" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:38:17.709681 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.709630 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0635a806-e1e7-49c3-a61b-b62a71f02951" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:38:17.715556 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.715534 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0635a806-e1e7-49c3-a61b-b62a71f02951-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0635a806-e1e7-49c3-a61b-b62a71f02951" (UID: "0635a806-e1e7-49c3-a61b-b62a71f02951"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:38:17.743193 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.743168 2568 generic.go:358] "Generic (PLEG): container finished" podID="0635a806-e1e7-49c3-a61b-b62a71f02951" containerID="b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982" exitCode=0 Jun 03 15:38:17.743273 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.743221 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" Jun 03 15:38:17.743273 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.743254 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" event={"ID":"0635a806-e1e7-49c3-a61b-b62a71f02951","Type":"ContainerDied","Data":"b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982"} Jun 03 15:38:17.743344 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.743289 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b6d8fc4-cgj7p" event={"ID":"0635a806-e1e7-49c3-a61b-b62a71f02951","Type":"ContainerDied","Data":"6417f05263d4e3c131ec2dd5925ec9ffc6e90dce0288f34e0c0c8b42871e72c0"} Jun 03 15:38:17.743344 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.743305 2568 scope.go:117] "RemoveContainer" containerID="b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982" Jun 03 15:38:17.752269 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.752253 2568 scope.go:117] "RemoveContainer" containerID="b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982" Jun 03 15:38:17.752551 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:38:17.752531 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982\": container with ID starting with b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982 not found: ID does not exist" containerID="b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982" Jun 03 15:38:17.752620 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.752558 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982"} err="failed to get container status \"b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982\": rpc error: code = NotFound desc = could not find container \"b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982\": container with ID starting with b3e3e28abdce6fdb4796e255e5904db50f10c820347a44c82590bf15aaff8982 not found: ID does not exist" Jun 03 15:38:17.769821 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.769800 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59b6d8fc4-cgj7p"] Jun 03 15:38:17.775253 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.775235 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59b6d8fc4-cgj7p"] Jun 03 15:38:17.808029 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.808010 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-trusted-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:38:17.808029 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.808027 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-bound-sa-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:38:17.808133 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.808036 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-tls\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:38:17.808133 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.808045 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-image-registry-private-configuration\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:38:17.808133 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.808054 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0635a806-e1e7-49c3-a61b-b62a71f02951-installation-pull-secrets\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:38:17.808133 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.808064 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gbxg\" (UniqueName: \"kubernetes.io/projected/0635a806-e1e7-49c3-a61b-b62a71f02951-kube-api-access-9gbxg\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:38:17.808133 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.808073 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0635a806-e1e7-49c3-a61b-b62a71f02951-registry-certificates\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:38:17.808133 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:17.808081 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0635a806-e1e7-49c3-a61b-b62a71f02951-ca-trust-extracted\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:38:19.217576 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:19.215818 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0635a806-e1e7-49c3-a61b-b62a71f02951" path="/var/lib/kubelet/pods/0635a806-e1e7-49c3-a61b-b62a71f02951/volumes" Jun 03 15:38:43.148151 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:43.148110 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" podUID="f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 15:38:53.147820 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:38:53.147779 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" podUID="f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 15:39:03.147754 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:03.147713 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" podUID="f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 15:39:03.148234 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:03.147790 2568 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" Jun 03 15:39:03.148234 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:03.148220 2568 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"6c9e7eea703afa90ef4fe131b0253447f499574cbe398e20a962fc56e7414720"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 15:39:03.148347 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:03.148261 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" podUID="f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43" containerName="service-proxy" containerID="cri-o://6c9e7eea703afa90ef4fe131b0253447f499574cbe398e20a962fc56e7414720" gracePeriod=30 Jun 03 15:39:03.869896 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:03.869858 2568 generic.go:358] "Generic (PLEG): container finished" podID="f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43" containerID="6c9e7eea703afa90ef4fe131b0253447f499574cbe398e20a962fc56e7414720" exitCode=2 Jun 03 15:39:03.870059 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:03.869928 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" event={"ID":"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43","Type":"ContainerDied","Data":"6c9e7eea703afa90ef4fe131b0253447f499574cbe398e20a962fc56e7414720"} Jun 03 15:39:03.870059 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:03.869962 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5f856585-rlbk6" event={"ID":"f2d10a56-aa62-48cb-9dc1-0e8eb2f78f43","Type":"ContainerStarted","Data":"6fa9756b53248f0692dbbbb95c9a99c321e2d13c120a247f6994cc81d1473902"} Jun 03 15:39:12.985652 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:12.985615 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:39:12.987901 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:12.987882 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7c8c93-375b-4bb6-9f38-380932825b76-metrics-certs\") pod \"network-metrics-daemon-sp6lm\" (UID: \"ee7c8c93-375b-4bb6-9f38-380932825b76\") " pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:39:13.114583 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:13.114560 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2b5h8\"" Jun 03 15:39:13.122574 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:13.122556 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6lm" Jun 03 15:39:13.240410 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:13.240335 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sp6lm"] Jun 03 15:39:13.243718 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:39:13.243694 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7c8c93_375b_4bb6_9f38_380932825b76.slice/crio-651c537a1d966442733abfa62f5d88ef5b1ad57a134f05ea0798a33ad6b39adc WatchSource:0}: Error finding container 651c537a1d966442733abfa62f5d88ef5b1ad57a134f05ea0798a33ad6b39adc: Status 404 returned error can't find the container with id 651c537a1d966442733abfa62f5d88ef5b1ad57a134f05ea0798a33ad6b39adc Jun 03 15:39:13.900190 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:13.900153 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sp6lm" event={"ID":"ee7c8c93-375b-4bb6-9f38-380932825b76","Type":"ContainerStarted","Data":"651c537a1d966442733abfa62f5d88ef5b1ad57a134f05ea0798a33ad6b39adc"} Jun 03 15:39:14.904010 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:14.903909 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sp6lm" event={"ID":"ee7c8c93-375b-4bb6-9f38-380932825b76","Type":"ContainerStarted","Data":"67f42c0868919574bce8ce7366c5701da7909e34ac3979b0e30dd472e11edd79"} Jun 03 15:39:14.904010 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:14.903947 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sp6lm" event={"ID":"ee7c8c93-375b-4bb6-9f38-380932825b76","Type":"ContainerStarted","Data":"77995caae4ef8143aa0819c7a418653dfffdc63c0c2a058970081de7be693b47"} Jun 03 15:39:14.920875 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:14.920828 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sp6lm" podStartSLOduration=252.619672479 podStartE2EDuration="4m13.920814832s" podCreationTimestamp="2026-06-03 15:35:01 +0000 UTC" firstStartedPulling="2026-06-03 15:39:13.245815339 +0000 UTC m=+252.595155739" lastFinishedPulling="2026-06-03 15:39:14.546957689 +0000 UTC m=+253.896298092" observedRunningTime="2026-06-03 15:39:14.919520776 +0000 UTC m=+254.268861201" watchObservedRunningTime="2026-06-03 15:39:14.920814832 +0000 UTC m=+254.270155279" Jun 03 15:39:21.492953 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.492920 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:39:21.494042 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.494004 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="alertmanager" containerID="cri-o://971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527" gracePeriod=120 Jun 03 15:39:21.494042 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.494025 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy-metric" containerID="cri-o://a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71" gracePeriod=120 Jun 03 15:39:21.494237 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.494045 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy-web" containerID="cri-o://df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1" gracePeriod=120 Jun 03 15:39:21.494237 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.494126 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="config-reloader" containerID="cri-o://0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20" gracePeriod=120 Jun 03 15:39:21.494237 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.494108 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy" containerID="cri-o://b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35" gracePeriod=120 Jun 03 15:39:21.494237 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.494103 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="prom-label-proxy" containerID="cri-o://d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5" gracePeriod=120 Jun 03 15:39:21.927217 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.927182 2568 generic.go:358] "Generic (PLEG): container finished" podID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerID="d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5" exitCode=0 Jun 03 15:39:21.927217 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.927207 2568 generic.go:358] "Generic (PLEG): container finished" podID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerID="b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35" exitCode=0 Jun 03 15:39:21.927217 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.927217 2568 generic.go:358] "Generic (PLEG): container finished" podID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerID="0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20" exitCode=0 Jun 03 15:39:21.927217 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.927223 2568 generic.go:358] "Generic (PLEG): container finished" podID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerID="971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527" exitCode=0 Jun 03 15:39:21.927505 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.927252 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerDied","Data":"d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5"} Jun 03 15:39:21.927505 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.927279 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerDied","Data":"b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35"} Jun 03 15:39:21.927505 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.927289 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerDied","Data":"0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20"} Jun 03 15:39:21.927505 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:21.927300 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerDied","Data":"971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527"} Jun 03 15:39:22.765799 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.765777 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:22.854923 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.854859 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-main-tls\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.854923 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.854897 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.854923 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.854916 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-web-config\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.854931 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-cluster-tls-config\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.854949 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.854965 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-web\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.854985 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-volume\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.855033 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-tls-assets\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.855059 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-main-db\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.855092 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-metrics-client-ca\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.855120 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-trusted-ca-bundle\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855162 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.855151 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-out\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.855637 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.855176 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh6v5\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-kube-api-access-bh6v5\") pod \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\" (UID: \"9458be5c-f23d-42b9-ba99-9f4bac4ececa\") " Jun 03 15:39:22.856060 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.855847 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:39:22.856060 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.855876 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:39:22.856060 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.855946 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:39:22.858161 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.858127 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-kube-api-access-bh6v5" (OuterVolumeSpecName: "kube-api-access-bh6v5") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "kube-api-access-bh6v5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:39:22.858441 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.858402 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:39:22.858544 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.858445 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:39:22.858692 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.858669 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:39:22.858836 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.858811 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:39:22.858921 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.858899 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:39:22.859267 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.859240 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-out" (OuterVolumeSpecName: "config-out") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:39:22.859343 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.859294 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-volume" (OuterVolumeSpecName: "config-volume") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:39:22.861714 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.861688 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:39:22.867691 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.867667 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-web-config" (OuterVolumeSpecName: "web-config") pod "9458be5c-f23d-42b9-ba99-9f4bac4ececa" (UID: "9458be5c-f23d-42b9-ba99-9f4bac4ececa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:39:22.932234 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.932212 2568 generic.go:358] "Generic (PLEG): container finished" podID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerID="a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71" exitCode=0 Jun 03 15:39:22.932234 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.932231 2568 generic.go:358] "Generic (PLEG): container finished" podID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerID="df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1" exitCode=0 Jun 03 15:39:22.932429 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.932296 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerDied","Data":"a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71"} Jun 03 15:39:22.932429 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.932342 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerDied","Data":"df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1"} Jun 03 15:39:22.932429 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.932355 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9458be5c-f23d-42b9-ba99-9f4bac4ececa","Type":"ContainerDied","Data":"f3ab4ee1721dec3c9c7ba15ed538e84bc0df58f67580b08a7bed73aced56d594"} Jun 03 15:39:22.932429 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.932356 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:22.932429 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.932393 2568 scope.go:117] "RemoveContainer" containerID="d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5" Jun 03 15:39:22.939048 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.939028 2568 scope.go:117] "RemoveContainer" containerID="a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71" Jun 03 15:39:22.945550 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.945536 2568 scope.go:117] "RemoveContainer" containerID="b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35" Jun 03 15:39:22.953475 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.953456 2568 scope.go:117] "RemoveContainer" containerID="df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1" Jun 03 15:39:22.956247 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956214 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-main-tls\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956342 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956279 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956342 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956298 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-web-config\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956342 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956312 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-cluster-tls-config\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956342 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956326 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956349 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956400 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956414 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-tls-assets\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956426 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-main-db\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956440 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-metrics-client-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956454 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9458be5c-f23d-42b9-ba99-9f4bac4ececa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956469 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9458be5c-f23d-42b9-ba99-9f4bac4ececa-config-out\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.956525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.956488 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh6v5\" (UniqueName: \"kubernetes.io/projected/9458be5c-f23d-42b9-ba99-9f4bac4ececa-kube-api-access-bh6v5\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\"" Jun 03 15:39:22.957319 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.957299 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:39:22.959931 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.959915 2568 scope.go:117] "RemoveContainer" containerID="0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20" Jun 03 15:39:22.961249 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.961233 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:39:22.966068 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.966054 2568 scope.go:117] "RemoveContainer" containerID="971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527" Jun 03 15:39:22.972128 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.972116 2568 scope.go:117] "RemoveContainer" containerID="2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e" Jun 03 15:39:22.977911 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.977897 2568 scope.go:117] "RemoveContainer" containerID="d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5" Jun 03 15:39:22.978134 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:39:22.978116 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5\": container with ID starting with d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5 not found: ID does not exist" containerID="d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5" Jun 03 15:39:22.978174 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.978142 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5"} err="failed to get container status \"d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5\": rpc error: code = NotFound desc = could not find container \"d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5\": container with ID starting with d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5 not found: ID does not exist" Jun 03 15:39:22.978174 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.978159 2568 scope.go:117] "RemoveContainer" containerID="a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71" Jun 03 15:39:22.978373 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:39:22.978343 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71\": container with ID starting with a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71 not found: ID does not exist" containerID="a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71" Jun 03 15:39:22.978419 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.978389 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71"} err="failed to get container status \"a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71\": rpc error: code = NotFound desc = could not find container \"a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71\": container with ID starting with a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71 not found: ID does not exist" Jun 03 15:39:22.978419 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.978405 2568 scope.go:117] "RemoveContainer" containerID="b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35" Jun 03 15:39:22.978617 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:39:22.978604 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35\": container with ID starting with b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35 not found: ID does not exist" containerID="b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35" Jun 03 15:39:22.978697 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.978620 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35"} err="failed to get container status \"b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35\": rpc error: code = NotFound desc = could not find container \"b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35\": container with ID starting with b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35 not found: ID does not exist" Jun 03 15:39:22.978697 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.978632 2568 scope.go:117] "RemoveContainer" containerID="df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1" Jun 03 15:39:22.978818 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:39:22.978803 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1\": container with ID starting with df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1 not found: ID does not exist" containerID="df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1" Jun 03 15:39:22.978854 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.978820 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1"} err="failed to get container status \"df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1\": rpc error: code = NotFound desc = could not find container \"df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1\": container with ID starting with df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1 not found: ID does not exist" Jun 03 15:39:22.978854 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.978831 2568 scope.go:117] "RemoveContainer" containerID="0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20" Jun 03 15:39:22.979006 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:39:22.978991 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20\": container with ID starting with 0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20 not found: ID does not exist" containerID="0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20" Jun 03 15:39:22.979049 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979009 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20"} err="failed to get container status \"0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20\": rpc error: code = NotFound desc = could not find container \"0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20\": container with ID starting with 0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20 not found: ID does not exist" Jun 03 15:39:22.979049 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979019 2568 scope.go:117] "RemoveContainer" containerID="971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527" Jun 03 15:39:22.979187 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:39:22.979173 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527\": container with ID starting with 971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527 not found: ID does not exist" containerID="971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527" Jun 03 15:39:22.979226 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979189 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527"} err="failed to get container status \"971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527\": rpc error: code = NotFound desc = could not find container \"971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527\": container with ID starting with 971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527 not found: ID does not exist" Jun 03 15:39:22.979226 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979202 2568 scope.go:117] "RemoveContainer" containerID="2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e" Jun 03 15:39:22.979388 ip-10-0-129-205 kubenswrapper[2568]: E0603 15:39:22.979357 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e\": container with ID starting with 2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e not found: ID does not exist" containerID="2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e" Jun 03 15:39:22.979438 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979396 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e"} err="failed to get container status \"2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e\": rpc error: code = NotFound desc = could not find container \"2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e\": container with ID starting with 2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e not found: ID does not exist" Jun 03 15:39:22.979438 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979411 2568 scope.go:117] "RemoveContainer" containerID="d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5" Jun 03 15:39:22.979611 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979595 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5"} err="failed to get container status \"d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5\": rpc error: code = NotFound desc = could not find container \"d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5\": container with ID starting with d325c84a110968136e0bd29baf959d9a7ce6540c96dfb8e98c1550b6b3cecaa5 not found: ID does not exist" Jun 03 15:39:22.979652 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979611 2568 scope.go:117] "RemoveContainer" containerID="a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71" Jun 03 15:39:22.979833 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979800 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71"} err="failed to get container status \"a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71\": rpc error: code = NotFound desc = could not find container \"a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71\": container with ID starting with a04ce199d4bcb6ca39063ae61825451d3becb7543fb5f2b7e11592f84eba9e71 not found: ID does not exist" Jun 03 15:39:22.979833 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.979829 2568 scope.go:117] "RemoveContainer" containerID="b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35" Jun 03 15:39:22.980095 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.980060 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35"} err="failed to get container status \"b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35\": rpc error: code = NotFound desc = could not find container \"b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35\": container with ID starting with b18d4ef3a14da21a0a9e8ec1f346f10a17b486344d1ea94befed415984009e35 not found: ID does not exist" Jun 03 15:39:22.980095 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.980086 2568 scope.go:117] "RemoveContainer" containerID="df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1" Jun 03 15:39:22.980344 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.980300 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1"} err="failed to get container status \"df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1\": rpc error: code = NotFound desc = could not find container \"df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1\": container with ID starting with df1a6555c2c060201c2af3a086920e176461953daeafa717e4fd8cd8ad8b75b1 not found: ID does not exist" Jun 03 15:39:22.980344 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.980329 2568 scope.go:117] "RemoveContainer" containerID="0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20" Jun 03 15:39:22.980620 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.980600 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20"} err="failed to get container status \"0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20\": rpc error: code = NotFound desc = could not find container \"0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20\": container with ID starting with 0bd4f99b463c867ca4d659dca9a83b8af0dc441f6f709bbeaeafa56c23a4be20 not found: ID does not exist" Jun 03 15:39:22.980673 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.980621 2568 scope.go:117] "RemoveContainer" containerID="971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527" Jun 03 15:39:22.980823 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.980808 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527"} err="failed to get container status \"971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527\": rpc error: code = NotFound desc = could not find container \"971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527\": container with ID starting with 971f262222cbbc357895c454e97d44c71c5c66fb70ea6c2a688a7c9ef9941527 not found: ID does not exist" Jun 03 15:39:22.980869 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.980823 2568 scope.go:117] "RemoveContainer" containerID="2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e" Jun 03 15:39:22.981057 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.981041 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e"} err="failed to get container status \"2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e\": rpc error: code = NotFound desc = could not find container \"2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e\": container with ID starting with 2644dad52175c3774ab894e130b8fd687f849e0975b042c2224ef02655320c9e not found: ID does not exist" Jun 03 15:39:22.988929 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.988901 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:39:22.989147 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989135 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy-metric" Jun 03 15:39:22.989147 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989148 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy-metric" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989158 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy-web" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989163 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy-web" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989172 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="prom-label-proxy" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989178 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="prom-label-proxy" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989186 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989191 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989201 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="config-reloader" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989206 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="config-reloader" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989214 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0635a806-e1e7-49c3-a61b-b62a71f02951" containerName="registry" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989218 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0635a806-e1e7-49c3-a61b-b62a71f02951" containerName="registry" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989223 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="init-config-reloader" Jun 03 15:39:22.989225 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989228 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="init-config-reloader" Jun 03 15:39:22.989615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989234 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="alertmanager" Jun 03 15:39:22.989615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989239 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="alertmanager" Jun 03 15:39:22.989615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989276 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy-web" Jun 03 15:39:22.989615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989284 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="0635a806-e1e7-49c3-a61b-b62a71f02951" containerName="registry" Jun 03 15:39:22.989615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989289 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="alertmanager" Jun 03 15:39:22.989615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989320 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy" Jun 03 15:39:22.989615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989329 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="kube-rbac-proxy-metric" Jun 03 15:39:22.989615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989335 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="prom-label-proxy" Jun 03 15:39:22.989615 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.989342 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" containerName="config-reloader" Jun 03 15:39:22.994224 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.994209 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:22.996631 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.996608 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 15:39:22.996800 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.996781 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 15:39:22.996906 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.996786 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 15:39:22.996906 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.996805 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 15:39:22.996906 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.996878 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 15:39:22.997070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.996926 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4pl75\"" Jun 03 15:39:22.997070 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.996926 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 15:39:22.997273 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.997258 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 15:39:22.997347 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:22.997298 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 15:39:23.003705 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.003678 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 15:39:23.005397 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.005354 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:39:23.057420 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057398 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ea747bb-cd4d-4908-96cc-960a427c7472-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057496 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ea747bb-cd4d-4908-96cc-960a427c7472-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057496 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ea747bb-cd4d-4908-96cc-960a427c7472-config-out\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057496 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snc2x\" (UniqueName: \"kubernetes.io/projected/0ea747bb-cd4d-4908-96cc-960a427c7472-kube-api-access-snc2x\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057603 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057506 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057603 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057603 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057539 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057603 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ea747bb-cd4d-4908-96cc-960a427c7472-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057603 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057747 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057747 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057632 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ea747bb-cd4d-4908-96cc-960a427c7472-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057747 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-web-config\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.057747 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.057685 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158586 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158536 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ea747bb-cd4d-4908-96cc-960a427c7472-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158586 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158560 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ea747bb-cd4d-4908-96cc-960a427c7472-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158586 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158579 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ea747bb-cd4d-4908-96cc-960a427c7472-config-out\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158780 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158593 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snc2x\" (UniqueName: \"kubernetes.io/projected/0ea747bb-cd4d-4908-96cc-960a427c7472-kube-api-access-snc2x\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158780 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158617 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158780 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158641 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158780 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158666 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158780 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158689 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ea747bb-cd4d-4908-96cc-960a427c7472-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158780 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158726 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.158780 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158755 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.159129 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158787 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ea747bb-cd4d-4908-96cc-960a427c7472-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.159129 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.158825 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-web-config\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.159226 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.159122 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ea747bb-cd4d-4908-96cc-960a427c7472-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.159885 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.159858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ea747bb-cd4d-4908-96cc-960a427c7472-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.159977 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.159918 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.161342 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.161317 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ea747bb-cd4d-4908-96cc-960a427c7472-config-out\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.161568 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.161546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ea747bb-cd4d-4908-96cc-960a427c7472-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.161681 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.161656 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.161747 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.161702 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.161820 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.161799 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.161875 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.161799 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.162036 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.162016 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ea747bb-cd4d-4908-96cc-960a427c7472-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.162081 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.162028 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.162301 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.162286 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.163327 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.163310 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ea747bb-cd4d-4908-96cc-960a427c7472-web-config\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.167259 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.167240 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snc2x\" (UniqueName: \"kubernetes.io/projected/0ea747bb-cd4d-4908-96cc-960a427c7472-kube-api-access-snc2x\") pod \"alertmanager-main-0\" (UID: \"0ea747bb-cd4d-4908-96cc-960a427c7472\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.215088 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.215066 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9458be5c-f23d-42b9-ba99-9f4bac4ececa" path="/var/lib/kubelet/pods/9458be5c-f23d-42b9-ba99-9f4bac4ececa/volumes" Jun 03 15:39:23.303902 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.303875 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:39:23.435133 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:39:23.435106 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea747bb_cd4d_4908_96cc_960a427c7472.slice/crio-8fc3a70b5e9d7c26a254e63c2584f35b55cf180588762c5ad617b0dcf03eee28 WatchSource:0}: Error finding container 8fc3a70b5e9d7c26a254e63c2584f35b55cf180588762c5ad617b0dcf03eee28: Status 404 returned error can't find the container with id 8fc3a70b5e9d7c26a254e63c2584f35b55cf180588762c5ad617b0dcf03eee28 Jun 03 15:39:23.436017 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.435993 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:39:23.940034 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.940002 2568 generic.go:358] "Generic (PLEG): container finished" podID="0ea747bb-cd4d-4908-96cc-960a427c7472" containerID="7d49dfe6db0ba18c493fb957f0526febc3eadad89a3d4f5bde4dd0081563c9ae" exitCode=0 Jun 03 15:39:23.940525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.940086 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ea747bb-cd4d-4908-96cc-960a427c7472","Type":"ContainerDied","Data":"7d49dfe6db0ba18c493fb957f0526febc3eadad89a3d4f5bde4dd0081563c9ae"} Jun 03 15:39:23.940525 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:23.940120 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ea747bb-cd4d-4908-96cc-960a427c7472","Type":"ContainerStarted","Data":"8fc3a70b5e9d7c26a254e63c2584f35b55cf180588762c5ad617b0dcf03eee28"} Jun 03 15:39:24.946462 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:24.946428 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ea747bb-cd4d-4908-96cc-960a427c7472","Type":"ContainerStarted","Data":"78cce37417b4885bdf9b52ff0911ff724e7043d77e8b11c8814a0c26e6cedca4"} Jun 03 15:39:24.946462 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:24.946463 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ea747bb-cd4d-4908-96cc-960a427c7472","Type":"ContainerStarted","Data":"5dfb856acd96ac3883e144c3f83a9ffd969f90a08b755f2e00610d19601bd268"} Jun 03 15:39:24.946863 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:24.946473 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ea747bb-cd4d-4908-96cc-960a427c7472","Type":"ContainerStarted","Data":"00e624db535dd5cc04da49ddf47b5937cc58ee2046beb3b781de2a471f026d39"} Jun 03 15:39:24.946863 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:24.946483 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ea747bb-cd4d-4908-96cc-960a427c7472","Type":"ContainerStarted","Data":"eea2aed76b00b886fd4e14264dad3ed04864d8b1239edb587e48ee725581bc6c"} Jun 03 15:39:24.946863 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:24.946492 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ea747bb-cd4d-4908-96cc-960a427c7472","Type":"ContainerStarted","Data":"34e5f7b900185ba2b20192eb29c4d50f8679aa45d396e0c6be6e8b7cafda7305"} Jun 03 15:39:24.946863 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:24.946503 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ea747bb-cd4d-4908-96cc-960a427c7472","Type":"ContainerStarted","Data":"4a22fa632a451f1535dd8d7a310cd948a0461bdb4ee5b3411c7e85a425cc93b0"} Jun 03 15:39:24.974514 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:39:24.974473 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.974458908 podStartE2EDuration="2.974458908s" podCreationTimestamp="2026-06-03 15:39:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:39:24.971910652 +0000 UTC m=+264.321251074" watchObservedRunningTime="2026-06-03 15:39:24.974458908 +0000 UTC m=+264.323799329" Jun 03 15:40:01.106508 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:01.106481 2568 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 15:40:45.281494 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:45.281412 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-76xsx_44cc2e50-46ea-4f5e-b6cc-aad762692538/global-pull-secret-syncer/0.log" Jun 03 15:40:45.388098 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:45.388073 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4dnxk_75cecf41-56f7-4b58-9bfd-487f183dbae5/konnectivity-agent/0.log" Jun 03 15:40:45.473115 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:45.473094 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-205.ec2.internal_ff54ee216c3e7ea819c2515787f1adad/haproxy/0.log" Jun 03 15:40:48.774066 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:48.774023 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ea747bb-cd4d-4908-96cc-960a427c7472/alertmanager/0.log" Jun 03 15:40:48.807448 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:48.807424 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ea747bb-cd4d-4908-96cc-960a427c7472/config-reloader/0.log" Jun 03 15:40:48.831246 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:48.831220 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ea747bb-cd4d-4908-96cc-960a427c7472/kube-rbac-proxy-web/0.log" Jun 03 15:40:48.864305 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:48.864284 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ea747bb-cd4d-4908-96cc-960a427c7472/kube-rbac-proxy/0.log" Jun 03 15:40:48.893930 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:48.893882 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ea747bb-cd4d-4908-96cc-960a427c7472/kube-rbac-proxy-metric/0.log" Jun 03 15:40:48.919991 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:48.919973 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ea747bb-cd4d-4908-96cc-960a427c7472/prom-label-proxy/0.log" Jun 03 15:40:48.950560 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:48.950540 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ea747bb-cd4d-4908-96cc-960a427c7472/init-config-reloader/0.log" Jun 03 15:40:49.017329 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:49.017306 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-dn7bv_2c68ce1a-c072-4702-9d2e-3d246af3d527/kube-state-metrics/0.log" Jun 03 15:40:49.043264 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:49.043207 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-dn7bv_2c68ce1a-c072-4702-9d2e-3d246af3d527/kube-rbac-proxy-main/0.log" Jun 03 15:40:49.071969 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:49.071949 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-dn7bv_2c68ce1a-c072-4702-9d2e-3d246af3d527/kube-rbac-proxy-self/0.log" Jun 03 15:40:49.274853 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:49.274832 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmjtz_b0ad64fa-85bf-482d-9d42-0d8eedf06b69/node-exporter/0.log" Jun 03 15:40:49.326921 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:49.326867 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmjtz_b0ad64fa-85bf-482d-9d42-0d8eedf06b69/kube-rbac-proxy/0.log" Jun 03 15:40:49.373832 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:49.373812 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmjtz_b0ad64fa-85bf-482d-9d42-0d8eedf06b69/init-textfile/0.log" Jun 03 15:40:50.086275 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:50.086206 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-8qw8h_8da9271c-f5f8-4bd4-bb4d-aab8ee4e2327/prometheus-operator-admission-webhook/0.log" Jun 03 15:40:51.772825 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.772787 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq"] Jun 03 15:40:51.775905 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.775883 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:51.778586 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.778564 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z2px8\"/\"kube-root-ca.crt\"" Jun 03 15:40:51.779560 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.779542 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z2px8\"/\"default-dockercfg-lf2m6\"" Jun 03 15:40:51.779812 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.779793 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z2px8\"/\"openshift-service-ca.crt\"" Jun 03 15:40:51.783500 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.783480 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq"] Jun 03 15:40:51.956592 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.956565 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-sys\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:51.956727 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.956598 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-proc\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:51.956727 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.956629 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbwb\" (UniqueName: \"kubernetes.io/projected/12f32a4f-31a2-48f1-b04c-33a78f93982e-kube-api-access-chbwb\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:51.956727 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.956704 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-podres\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:51.956832 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:51.956744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-lib-modules\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.057682 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.057620 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-lib-modules\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.057682 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.057658 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-sys\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.057682 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.057676 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-proc\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.057887 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.057715 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chbwb\" (UniqueName: \"kubernetes.io/projected/12f32a4f-31a2-48f1-b04c-33a78f93982e-kube-api-access-chbwb\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.057887 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.057735 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-podres\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.057887 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.057743 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-sys\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.057887 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.057774 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-lib-modules\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.057887 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.057797 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-proc\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.057887 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.057830 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12f32a4f-31a2-48f1-b04c-33a78f93982e-podres\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.066515 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.066489 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbwb\" (UniqueName: \"kubernetes.io/projected/12f32a4f-31a2-48f1-b04c-33a78f93982e-kube-api-access-chbwb\") pod \"perf-node-gather-daemonset-phxrq\" (UID: \"12f32a4f-31a2-48f1-b04c-33a78f93982e\") " pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.086520 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.086500 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:52.208495 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.208393 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq"] Jun 03 15:40:52.211072 ip-10-0-129-205 kubenswrapper[2568]: W0603 15:40:52.211046 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod12f32a4f_31a2_48f1_b04c_33a78f93982e.slice/crio-92c890aa6be6e5af50dad4ef0a22d35681173f42c42280c0f2dcc8712f2b1cda WatchSource:0}: Error finding container 92c890aa6be6e5af50dad4ef0a22d35681173f42c42280c0f2dcc8712f2b1cda: Status 404 returned error can't find the container with id 92c890aa6be6e5af50dad4ef0a22d35681173f42c42280c0f2dcc8712f2b1cda Jun 03 15:40:52.212640 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:52.212620 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:40:53.198013 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:53.197975 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" event={"ID":"12f32a4f-31a2-48f1-b04c-33a78f93982e","Type":"ContainerStarted","Data":"4a4c7cc3a532c0f52fd5dee0d4c96d926dd5f225ea3300c286fab9f5de73aba3"} Jun 03 15:40:53.198013 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:53.198014 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" event={"ID":"12f32a4f-31a2-48f1-b04c-33a78f93982e","Type":"ContainerStarted","Data":"92c890aa6be6e5af50dad4ef0a22d35681173f42c42280c0f2dcc8712f2b1cda"} Jun 03 15:40:53.198449 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:53.198100 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:40:53.216608 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:53.216565 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" podStartSLOduration=2.216551408 podStartE2EDuration="2.216551408s" podCreationTimestamp="2026-06-03 15:40:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:40:53.214659381 +0000 UTC m=+352.563999802" watchObservedRunningTime="2026-06-03 15:40:53.216551408 +0000 UTC m=+352.565891829" Jun 03 15:40:53.217473 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:53.217449 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gpxtd_a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3/dns/0.log" Jun 03 15:40:53.244803 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:53.244778 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gpxtd_a2ab8adc-991c-4d6c-b78c-33bd6d52c6d3/kube-rbac-proxy/0.log" Jun 03 15:40:53.390553 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:53.390532 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zvn5n_01bf0c95-a9ef-4d1e-835a-6bb767fcdd95/dns-node-resolver/0.log" Jun 03 15:40:53.916628 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:53.916606 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ngwtl_f50f2af2-fbef-4ee8-8657-9a5b186747d4/node-ca/0.log" Jun 03 15:40:55.027108 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:55.027082 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g6jss_810a54ac-0eef-4d57-99d4-445ec95baf54/serve-healthcheck-canary/0.log" Jun 03 15:40:55.675290 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:55.675263 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p8ljc_0765c928-5b84-4b72-ac0b-be2d01bfbc98/kube-rbac-proxy/0.log" Jun 03 15:40:55.724058 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:55.724033 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p8ljc_0765c928-5b84-4b72-ac0b-be2d01bfbc98/exporter/0.log" Jun 03 15:40:55.769535 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:55.769506 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p8ljc_0765c928-5b84-4b72-ac0b-be2d01bfbc98/extractor/0.log" Jun 03 15:40:59.208684 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:40:59.208658 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z2px8/perf-node-gather-daemonset-phxrq" Jun 03 15:41:01.082072 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.082050 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klrdc_3821ef9b-5007-4f5c-b6c0-03888f78cced/kube-multus-additional-cni-plugins/0.log" Jun 03 15:41:01.107862 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.107814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klrdc_3821ef9b-5007-4f5c-b6c0-03888f78cced/egress-router-binary-copy/0.log" Jun 03 15:41:01.131856 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.131837 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klrdc_3821ef9b-5007-4f5c-b6c0-03888f78cced/cni-plugins/0.log" Jun 03 15:41:01.156552 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.156536 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klrdc_3821ef9b-5007-4f5c-b6c0-03888f78cced/bond-cni-plugin/0.log" Jun 03 15:41:01.179724 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.179708 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klrdc_3821ef9b-5007-4f5c-b6c0-03888f78cced/routeoverride-cni/0.log" Jun 03 15:41:01.204890 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.204876 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klrdc_3821ef9b-5007-4f5c-b6c0-03888f78cced/whereabouts-cni-bincopy/0.log" Jun 03 15:41:01.230330 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.230314 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klrdc_3821ef9b-5007-4f5c-b6c0-03888f78cced/whereabouts-cni/0.log" Jun 03 15:41:01.642140 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.642115 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t42g8_71edc8a7-005e-4114-9c38-6b276650a275/kube-multus/0.log" Jun 03 15:41:01.759777 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.759756 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sp6lm_ee7c8c93-375b-4bb6-9f38-380932825b76/network-metrics-daemon/0.log" Jun 03 15:41:01.781419 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:01.781400 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sp6lm_ee7c8c93-375b-4bb6-9f38-380932825b76/kube-rbac-proxy/0.log" Jun 03 15:41:03.186943 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:03.186916 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x44sn_ac3307dd-15e2-4632-9a86-8c9f71593b6d/ovn-controller/0.log" Jun 03 15:41:03.210096 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:03.210071 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x44sn_ac3307dd-15e2-4632-9a86-8c9f71593b6d/ovn-acl-logging/0.log" Jun 03 15:41:03.234619 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:03.234589 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x44sn_ac3307dd-15e2-4632-9a86-8c9f71593b6d/kube-rbac-proxy-node/0.log" Jun 03 15:41:03.256414 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:03.256398 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x44sn_ac3307dd-15e2-4632-9a86-8c9f71593b6d/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 15:41:03.276670 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:03.276654 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x44sn_ac3307dd-15e2-4632-9a86-8c9f71593b6d/northd/0.log" Jun 03 15:41:03.298381 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:03.298343 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x44sn_ac3307dd-15e2-4632-9a86-8c9f71593b6d/nbdb/0.log" Jun 03 15:41:03.321703 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:03.321687 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x44sn_ac3307dd-15e2-4632-9a86-8c9f71593b6d/sbdb/0.log" Jun 03 15:41:03.422810 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:03.422789 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x44sn_ac3307dd-15e2-4632-9a86-8c9f71593b6d/ovnkube-controller/0.log" Jun 03 15:41:04.444252 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:04.444225 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-xnlbs_b4b70f5d-1d81-4696-b5b7-afb19d82828f/check-endpoints/0.log" Jun 03 15:41:04.476420 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:04.476393 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2k5tc_ab35a92c-ab3a-41b2-b835-a560fa81c4a4/network-check-target-container/0.log" Jun 03 15:41:05.418901 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:05.418876 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-r8ncx_a6c52397-7672-4375-a848-77438f176998/iptables-alerter/0.log" Jun 03 15:41:06.056392 ip-10-0-129-205 kubenswrapper[2568]: I0603 15:41:06.056345 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qrm5f_08a8f1e9-be97-41bb-aa88-e9b384e069f6/tuned/0.log"