Jun 03 09:40:28.003440 ip-10-0-135-171 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 09:40:28.003452 ip-10-0-135-171 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 09:40:28.003459 ip-10-0-135-171 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 09:40:28.003688 ip-10-0-135-171 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 09:40:38.091281 ip-10-0-135-171 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 09:40:38.091304 ip-10-0-135-171 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 58aab6f6b4f24c699adabf6e667afc71 -- Jun 03 09:43:05.869975 ip-10-0-135-171 systemd[1]: Starting Kubernetes Kubelet... Jun 03 09:43:06.335863 ip-10-0-135-171 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 09:43:06.335863 ip-10-0-135-171 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 09:43:06.335863 ip-10-0-135-171 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 09:43:06.335863 ip-10-0-135-171 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 09:43:06.335863 ip-10-0-135-171 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 09:43:06.337703 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.337588 2581 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 09:43:06.342979 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.342964 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:06.342979 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.342979 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.342982 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.342985 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.342987 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.342990 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.342993 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.342996 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.342999 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343001 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343004 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343006 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343009 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343011 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343015 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343019 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343022 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343025 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343032 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343034 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343037 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:06.343050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343040 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343043 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343045 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343047 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343050 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343052 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343055 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343058 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343061 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343064 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343067 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343069 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343073 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343077 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343080 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343083 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343086 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343088 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343091 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:06.343524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343094 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343096 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343098 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343101 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343103 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343105 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343108 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343110 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343113 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343115 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343117 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343120 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343123 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343126 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343128 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343131 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343134 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343137 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343139 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343142 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:06.343999 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343144 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343147 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343149 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343152 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343154 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343157 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343159 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343162 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343164 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343166 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343169 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343171 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343173 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343176 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343178 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343180 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343183 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343185 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343187 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343190 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:06.344464 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343193 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343196 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343198 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343201 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343204 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343207 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343569 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343575 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343578 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343580 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343584 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343586 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343589 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343606 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343609 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343611 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343614 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343616 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343619 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343622 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:06.344977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343624 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343627 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343629 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343632 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343634 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343638 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343641 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343644 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343647 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343650 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343652 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343655 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343657 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343659 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343662 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343664 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343667 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343670 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343672 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:06.345456 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343676 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343678 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343681 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343685 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343688 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343691 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343694 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343697 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343699 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343701 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343704 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343706 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343708 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343711 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343713 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343716 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343718 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343720 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343723 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:06.345977 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343725 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343727 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343730 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343732 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343734 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343737 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343739 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343741 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343743 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343746 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343749 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343752 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343754 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343757 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343760 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343762 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343765 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343767 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343770 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343772 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:06.346434 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343774 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343777 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343779 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343781 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343784 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343787 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343789 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343791 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343794 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343796 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343799 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343801 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343803 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.343806 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343878 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343885 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343892 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343896 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343900 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343903 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343907 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 09:43:06.346934 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343914 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343918 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343921 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343925 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343928 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343931 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343934 2581 flags.go:64] FLAG: --cgroup-root="" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343936 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343939 2581 flags.go:64] FLAG: --client-ca-file="" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343942 2581 flags.go:64] FLAG: --cloud-config="" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343945 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.343947 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345516 2581 flags.go:64] FLAG: --cluster-domain="" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345520 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345524 2581 flags.go:64] FLAG: --config-dir="" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345527 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345531 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345535 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345538 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345541 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345544 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345547 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345550 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345553 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345557 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 09:43:06.347435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345559 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345564 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345566 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345569 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345572 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345575 2581 flags.go:64] FLAG: --enable-server="true" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345578 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345583 2581 flags.go:64] FLAG: --event-burst="100" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345587 2581 flags.go:64] FLAG: --event-qps="50" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345606 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345610 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345621 2581 flags.go:64] FLAG: --eviction-hard="" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345626 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345629 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345632 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345635 2581 flags.go:64] FLAG: --eviction-soft="" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345638 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345641 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345644 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345646 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345649 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345652 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345654 2581 flags.go:64] FLAG: --feature-gates="" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345658 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345661 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 09:43:06.348041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345664 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345667 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345671 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345674 2581 flags.go:64] FLAG: --help="false" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345677 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345680 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345683 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345685 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345689 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345692 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345695 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345697 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345700 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345703 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345705 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345708 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345712 2581 flags.go:64] FLAG: --kube-reserved="" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345715 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345717 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345721 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345724 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345727 2581 flags.go:64] FLAG: --lock-file="" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345730 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345733 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 09:43:06.348642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345736 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345741 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345744 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345746 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345749 2581 flags.go:64] FLAG: --logging-format="text" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345752 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345756 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345758 2581 flags.go:64] FLAG: --manifest-url="" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345761 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345765 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345768 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345772 2581 flags.go:64] FLAG: --max-pods="110" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345775 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345778 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345781 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345784 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345787 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345789 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345792 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345799 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345802 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345805 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345808 2581 flags.go:64] FLAG: --pod-cidr="" Jun 03 09:43:06.349209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345811 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345818 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345821 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345824 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345827 2581 flags.go:64] FLAG: --port="10250" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345830 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345834 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-039d2d6b4625d061b" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345838 2581 flags.go:64] FLAG: --qos-reserved="" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345840 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345843 2581 flags.go:64] FLAG: --register-node="true" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345846 2581 flags.go:64] FLAG: --register-schedulable="true" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345849 2581 flags.go:64] FLAG: --register-with-taints="" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345853 2581 flags.go:64] FLAG: --registry-burst="10" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345856 2581 flags.go:64] FLAG: --registry-qps="5" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345859 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345861 2581 flags.go:64] FLAG: --reserved-memory="" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345865 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345868 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345871 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345873 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345876 2581 flags.go:64] FLAG: --runonce="false" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345879 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345881 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345884 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345887 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345890 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 09:43:06.349786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345893 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345898 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345901 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345904 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345907 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345910 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345912 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345915 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345918 2581 flags.go:64] FLAG: --system-cgroups="" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345921 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345926 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345929 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345933 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345937 2581 flags.go:64] FLAG: --tls-min-version="" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345940 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345942 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345945 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345948 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345951 2581 flags.go:64] FLAG: --v="2" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345954 2581 flags.go:64] FLAG: --version="false" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345958 2581 flags.go:64] FLAG: --vmodule="" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345962 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.345965 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346062 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:06.350428 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346066 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346069 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346072 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346075 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346078 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346080 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346083 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346086 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346088 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346092 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346095 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346098 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346100 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346102 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346107 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346110 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346112 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346115 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346117 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346120 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:06.351020 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346122 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346125 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346128 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346130 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346133 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346135 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346138 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346140 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346143 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346147 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346150 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346153 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346156 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346160 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346163 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346166 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346169 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346171 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346174 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:06.351508 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346177 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346179 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346183 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346186 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346188 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346191 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346193 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346198 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346200 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346203 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346205 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346207 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346210 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346212 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346215 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346218 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346220 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346223 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346225 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346228 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:06.352023 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346230 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346233 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346235 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346238 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346240 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346243 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346245 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346247 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346250 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346252 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346254 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346257 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346259 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346262 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346265 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346268 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346270 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346273 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346276 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346279 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:06.352524 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346282 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:06.353024 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346284 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:06.353024 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346286 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:06.353024 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346289 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:06.353024 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346291 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:06.353024 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.346294 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:06.353024 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.347068 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 09:43:06.356424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.356402 2581 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 09:43:06.356424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.356424 2581 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356495 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356504 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356510 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356515 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356519 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356523 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356527 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356531 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356535 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356539 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356543 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356547 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356551 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356555 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356560 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356564 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356568 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356572 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:06.356699 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356579 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356585 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356590 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356613 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356617 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356621 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356624 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356629 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356633 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356637 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356640 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356644 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356647 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356651 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356655 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356659 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356663 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356667 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356670 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:06.357519 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356674 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356680 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356686 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356691 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356695 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356699 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356703 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356708 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356712 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356716 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356720 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356724 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356728 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356732 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356736 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356740 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356745 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356749 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356753 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:06.358079 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356758 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356762 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356766 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356771 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356775 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356779 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356784 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356788 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356792 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356797 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356801 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356805 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356809 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356813 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356817 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356820 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356825 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356829 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356834 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356838 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:06.358648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356853 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356857 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356861 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356866 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356869 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356874 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356878 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356882 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356886 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.356890 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.356899 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357080 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357089 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357094 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357098 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357102 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:06.359317 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357107 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357111 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357117 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357124 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357129 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357132 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357137 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357141 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357145 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357149 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357153 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357158 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357162 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357166 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357170 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357174 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357179 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357192 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357196 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:06.360001 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357200 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357204 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357208 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357213 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357217 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357221 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357225 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357230 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357234 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357238 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357243 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357248 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357251 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357255 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357259 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357263 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357267 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357271 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357275 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357280 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:06.360731 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357284 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357288 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357292 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357296 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357300 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357304 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357308 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357312 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357316 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357320 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357324 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357329 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357334 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357338 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357342 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357346 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357350 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357354 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357358 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357362 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:06.361348 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357366 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357370 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357374 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357378 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357383 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357387 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357391 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357396 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357400 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357404 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357408 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357413 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357417 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357421 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357425 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357429 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357433 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357439 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357444 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:06.361861 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357449 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:06.362395 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357454 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:06.362395 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:06.357458 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:06.362395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.357466 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 09:43:06.362395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.358367 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 09:43:06.362395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.361072 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 09:43:06.362395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.362219 2581 server.go:1019] "Starting client certificate rotation" Jun 03 09:43:06.362395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.362322 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 09:43:06.362395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.362352 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 09:43:06.388283 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.388259 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 09:43:06.390506 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.390023 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 09:43:06.404039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.404024 2581 log.go:25] "Validated CRI v1 runtime API" Jun 03 09:43:06.409870 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.409856 2581 log.go:25] "Validated CRI v1 image API" Jun 03 09:43:06.411081 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.411068 2581 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 09:43:06.414818 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.414798 2581 fs.go:135] Filesystem UUIDs: map[4567bf05-ff26-4989-939b-17b9dc76a120:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ecc5dde8-0974-4fa7-a1e3-bf4addc1c693:/dev/nvme0n1p3] Jun 03 09:43:06.414888 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.414818 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 09:43:06.421314 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.421202 2581 manager.go:217] Machine: {Timestamp:2026-06-03 09:43:06.420702878 +0000 UTC m=+0.419773729 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088897 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23a2c66eb919ff66ebee483d13c046 SystemUUID:ec23a2c6-6eb9-19ff-66eb-ee483d13c046 BootID:58aab6f6-b4f2-4c69-9ada-bf6e667afc71 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:91:1c:c9:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:91:1c:c9:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:4b:56:4b:13:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 09:43:06.421966 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.421955 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 09:43:06.422044 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.422032 2581 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 09:43:06.423088 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.423071 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 09:43:06.423625 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.423577 2581 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 09:43:06.423748 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.423627 2581 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-171.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 09:43:06.423790 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.423758 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 09:43:06.423790 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.423767 2581 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 09:43:06.423790 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.423773 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 09:43:06.424405 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.424396 2581 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 09:43:06.426265 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.426253 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 03 09:43:06.426378 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.426369 2581 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 09:43:06.428671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.428662 2581 kubelet.go:491] "Attempting to sync node with API server" Jun 03 09:43:06.428704 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.428675 2581 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 09:43:06.428704 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.428687 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 09:43:06.428704 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.428695 2581 kubelet.go:397] "Adding apiserver pod source" Jun 03 09:43:06.428704 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.428703 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 09:43:06.429862 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.429841 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 09:43:06.429903 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.429875 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 09:43:06.432883 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.432869 2581 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 09:43:06.434709 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.434693 2581 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 09:43:06.436778 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436763 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 09:43:06.436859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436782 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 09:43:06.436859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436792 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 09:43:06.436859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436800 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 09:43:06.436859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436812 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 09:43:06.436859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436821 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 09:43:06.436859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436830 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 09:43:06.436859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436838 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 09:43:06.436859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436848 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 09:43:06.436859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436857 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 09:43:06.437197 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436869 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 09:43:06.437197 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.436878 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 09:43:06.437813 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.437800 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 09:43:06.437863 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.437818 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 09:43:06.440365 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.440336 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 09:43:06.440445 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.440370 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 09:43:06.440987 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.440974 2581 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 09:43:06.441031 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.441011 2581 server.go:1295] "Started kubelet" Jun 03 09:43:06.441136 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.441101 2581 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 09:43:06.441185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.441157 2581 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 09:43:06.441576 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.441528 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 09:43:06.442277 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.442260 2581 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 09:43:06.442356 ip-10-0-135-171 systemd[1]: Started Kubernetes Kubelet. Jun 03 09:43:06.443743 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.443730 2581 server.go:317] "Adding debug handlers to kubelet server" Jun 03 09:43:06.448781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.448761 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 09:43:06.449312 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.449294 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 09:43:06.449474 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.449453 2581 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 09:43:06.450043 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450028 2581 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 09:43:06.450196 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450054 2581 factory.go:55] Registering systemd factory Jun 03 09:43:06.450270 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450201 2581 factory.go:223] Registration of the systemd container factory successfully Jun 03 09:43:06.450270 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.450054 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:06.450270 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450150 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-171.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 09:43:06.450270 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.449611 2581 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 09:43:06.450527 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450510 2581 factory.go:153] Registering CRI-O factory Jun 03 09:43:06.450573 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450532 2581 factory.go:223] Registration of the crio container factory successfully Jun 03 09:43:06.450622 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450585 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 09:43:06.450658 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450621 2581 factory.go:103] Registering Raw factory Jun 03 09:43:06.450658 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450641 2581 manager.go:1196] Started watching for new ooms in manager Jun 03 09:43:06.451015 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.450998 2581 manager.go:319] Starting recovery of all containers Jun 03 09:43:06.451241 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.451213 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 03 09:43:06.451241 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.451230 2581 reconciler.go:26] "Reconciler: start to sync state" Jun 03 09:43:06.451486 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.450486 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-171.ec2.internal.18b588eeb09417e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-171.ec2.internal,UID:ip-10-0-135-171.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-171.ec2.internal,},FirstTimestamp:2026-06-03 09:43:06.440988643 +0000 UTC m=+0.440059497,LastTimestamp:2026-06-03 09:43:06.440988643 +0000 UTC m=+0.440059497,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-171.ec2.internal,}" Jun 03 09:43:06.453139 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.452960 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 09:43:06.453254 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.453103 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 09:43:06.453332 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.453145 2581 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 09:43:06.460884 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.460851 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k7ct4" Jun 03 09:43:06.462523 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.462504 2581 manager.go:324] Recovery completed Jun 03 09:43:06.463829 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.463793 2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 03 09:43:06.466815 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.466802 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:06.468671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.468656 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:06.468725 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.468681 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:06.468725 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.468691 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:06.469190 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.469177 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 09:43:06.469190 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.469189 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 09:43:06.469269 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.469203 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 03 09:43:06.471062 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.471047 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k7ct4" Jun 03 09:43:06.471946 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.471935 2581 policy_none.go:49] "None policy: Start" Jun 03 09:43:06.471988 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.471952 2581 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 09:43:06.471988 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.471967 2581 state_mem.go:35] "Initializing new in-memory state store" Jun 03 09:43:06.472125 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.472068 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-171.ec2.internal.18b588eeb23a79e1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-171.ec2.internal,UID:ip-10-0-135-171.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-171.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-171.ec2.internal,},FirstTimestamp:2026-06-03 09:43:06.468669921 +0000 UTC m=+0.467740772,LastTimestamp:2026-06-03 09:43:06.468669921 +0000 UTC m=+0.467740772,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-171.ec2.internal,}" Jun 03 09:43:06.507147 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.507133 2581 manager.go:341] "Starting Device Plugin manager" Jun 03 09:43:06.507233 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.507160 2581 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 09:43:06.507233 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.507173 2581 server.go:85] "Starting device plugin registration server" Jun 03 09:43:06.507415 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.507403 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 09:43:06.507485 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.507416 2581 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 09:43:06.507755 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.507628 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 09:43:06.507755 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.507699 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 09:43:06.507755 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.507712 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 09:43:06.508222 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.508200 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 09:43:06.508465 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.508243 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:06.583067 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.583045 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 09:43:06.584375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.584355 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 09:43:06.584436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.584382 2581 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 09:43:06.584436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.584398 2581 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 09:43:06.584436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.584405 2581 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 09:43:06.584556 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.584437 2581 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 09:43:06.587080 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.587033 2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:06.608050 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.608035 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:06.608965 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.608952 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:06.609019 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.608981 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:06.609019 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.608996 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:06.609019 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.609018 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.626650 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.626636 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.626706 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.626657 2581 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-171.ec2.internal\": node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:06.670225 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.670210 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:06.685296 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.685268 2581 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal"] Jun 03 09:43:06.685376 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.685348 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:06.686058 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.686043 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:06.686127 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.686073 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:06.686127 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.686087 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:06.687247 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.687234 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:06.687407 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.687393 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.687489 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.687428 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:06.687929 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.687911 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:06.688014 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.687941 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:06.688014 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.687917 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:06.688014 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.687953 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:06.688014 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.687971 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:06.688014 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.687982 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:06.688973 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.688958 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.689055 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.688986 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:06.689564 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.689550 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:06.689669 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.689577 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:06.689669 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.689588 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:06.715100 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.715082 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-171.ec2.internal\" not found" node="ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.719155 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.719137 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-171.ec2.internal\" not found" node="ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.752463 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.752445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b947761e3a7fdae22c9238b5b9e04d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal\" (UID: \"8b947761e3a7fdae22c9238b5b9e04d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.752509 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.752468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b947761e3a7fdae22c9238b5b9e04d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal\" (UID: \"8b947761e3a7fdae22c9238b5b9e04d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.752509 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.752485 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a81c4b353697dcd6d18eda03f48f2de-config\") pod \"kube-apiserver-proxy-ip-10-0-135-171.ec2.internal\" (UID: \"4a81c4b353697dcd6d18eda03f48f2de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.771015 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.771001 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:06.853397 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.853355 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a81c4b353697dcd6d18eda03f48f2de-config\") pod \"kube-apiserver-proxy-ip-10-0-135-171.ec2.internal\" (UID: \"4a81c4b353697dcd6d18eda03f48f2de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.853397 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.853380 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b947761e3a7fdae22c9238b5b9e04d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal\" (UID: \"8b947761e3a7fdae22c9238b5b9e04d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.853478 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.853399 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b947761e3a7fdae22c9238b5b9e04d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal\" (UID: \"8b947761e3a7fdae22c9238b5b9e04d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.853478 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.853441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b947761e3a7fdae22c9238b5b9e04d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal\" (UID: \"8b947761e3a7fdae22c9238b5b9e04d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.853546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.853480 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a81c4b353697dcd6d18eda03f48f2de-config\") pod \"kube-apiserver-proxy-ip-10-0-135-171.ec2.internal\" (UID: \"4a81c4b353697dcd6d18eda03f48f2de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.853546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:06.853506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b947761e3a7fdae22c9238b5b9e04d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal\" (UID: \"8b947761e3a7fdae22c9238b5b9e04d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" Jun 03 09:43:06.871574 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.871554 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:06.972011 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:06.971986 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:07.018163 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.018129 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" Jun 03 09:43:07.022779 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.022763 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal" Jun 03 09:43:07.073071 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:07.073042 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:07.173708 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:07.173638 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:07.274121 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:07.274097 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:07.361602 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.361577 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 09:43:07.362161 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.361724 2581 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 09:43:07.374734 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:07.374712 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:07.449402 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.449343 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 09:43:07.473517 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.473476 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 09:38:06 +0000 UTC" deadline="2028-01-06 15:05:27.389942548 +0000 UTC" Jun 03 09:43:07.473517 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.473512 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13973h22m19.916434373s" Jun 03 09:43:07.475656 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:07.475640 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:07.479183 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.479163 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 09:43:07.570743 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.570714 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9sslm" Jun 03 09:43:07.575746 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:07.575726 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:07.581012 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.580998 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9sslm" Jun 03 09:43:07.598742 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.598722 2581 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:07.605807 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:07.605783 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a81c4b353697dcd6d18eda03f48f2de.slice/crio-1644b24cddfc385455de60a8d9d6cc058a71da24c0b1b3d0fc69d3a0ef1266ca WatchSource:0}: Error finding container 1644b24cddfc385455de60a8d9d6cc058a71da24c0b1b3d0fc69d3a0ef1266ca: Status 404 returned error can't find the container with id 1644b24cddfc385455de60a8d9d6cc058a71da24c0b1b3d0fc69d3a0ef1266ca Jun 03 09:43:07.606065 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:07.606041 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b947761e3a7fdae22c9238b5b9e04d7.slice/crio-8cf3d9e9c3765ca9817558dc79c84e29ab7cd439c294c1099deecd469eed6c20 WatchSource:0}: Error finding container 8cf3d9e9c3765ca9817558dc79c84e29ab7cd439c294c1099deecd469eed6c20: Status 404 returned error can't find the container with id 8cf3d9e9c3765ca9817558dc79c84e29ab7cd439c294c1099deecd469eed6c20 Jun 03 09:43:07.610269 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.610254 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 09:43:07.676048 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:07.676023 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-171.ec2.internal\" not found" Jun 03 09:43:07.690355 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.690328 2581 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:07.690506 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.690491 2581 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:07.750099 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.750078 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal" Jun 03 09:43:07.768475 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.768456 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 09:43:07.769550 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.769538 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" Jun 03 09:43:07.786902 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:07.786887 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 09:43:08.429356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.429325 2581 apiserver.go:52] "Watching apiserver" Jun 03 09:43:08.437114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.437063 2581 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 09:43:08.437588 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.437559 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal","openshift-multus/multus-additional-cni-plugins-qnrcx","openshift-network-operator/iptables-alerter-mgpc8","openshift-cluster-node-tuning-operator/tuned-49jlt","openshift-multus/multus-zzjpd","openshift-multus/network-metrics-daemon-l29jq","openshift-network-diagnostics/network-check-target-lnxjc","openshift-ovn-kubernetes/ovnkube-node-nkws8","kube-system/konnectivity-agent-jf6z9","kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz","openshift-dns/node-resolver-ctb7x","openshift-image-registry/node-ca-b525w"] Jun 03 09:43:08.440370 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.440340 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:08.440489 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:08.440425 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:08.442330 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.442308 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.444578 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.444545 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.445633 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.445236 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 09:43:08.445633 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.445263 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 09:43:08.445633 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.445277 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 09:43:08.445633 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.445388 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 09:43:08.445633 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.445525 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ldtqx\"" Jun 03 09:43:08.445633 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.445556 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 09:43:08.447566 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.446547 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 09:43:08.447566 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.447437 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 09:43:08.447725 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.447711 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8vrj8\"" Jun 03 09:43:08.447836 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.447774 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 09:43:08.449620 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.449190 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.449620 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.449275 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.451517 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.451500 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:08.451653 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:08.451561 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:08.454159 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.454139 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.455645 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.455625 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 09:43:08.455739 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.455625 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 09:43:08.455739 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.455688 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x5k76\"" Jun 03 09:43:08.457511 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.456621 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:08.457511 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.456756 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 09:43:08.457511 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.457018 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pkb8x\"" Jun 03 09:43:08.457511 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.457193 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 09:43:08.457511 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.457362 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 09:43:08.459781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.459516 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 09:43:08.459889 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.459808 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 09:43:08.460048 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.459940 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7kl5d\"" Jun 03 09:43:08.461443 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.460670 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 09:43:08.461443 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.461190 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 09:43:08.461443 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.461199 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9cx6g\"" Jun 03 09:43:08.461443 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.461220 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 09:43:08.461443 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.461281 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 09:43:08.463071 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.463013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t65c\" (UniqueName: \"kubernetes.io/projected/d6b29734-5571-4e06-a3b1-232d14cb2c02-kube-api-access-8t65c\") pod \"iptables-alerter-mgpc8\" (UID: \"d6b29734-5571-4e06-a3b1-232d14cb2c02\") " pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.463071 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.463063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-sysctl-conf\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.463214 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.463100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-var-lib-kubelet\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.463214 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.463169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pwg4\" (UniqueName: \"kubernetes.io/projected/9fea2333-d855-4c22-8eb4-89f7aa063cbe-kube-api-access-9pwg4\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.463214 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.463195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-run-k8s-cni-cncf-io\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.463360 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.463218 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-etc-kubernetes\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.463360 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.463242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/958fef8c-f445-44ce-8c5f-6f80c528d394-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.463360 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.463287 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-systemd\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.463528 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.463497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fea2333-d855-4c22-8eb4-89f7aa063cbe-tmp\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.464420 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-var-lib-cni-bin\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.464512 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-var-lib-cni-multus\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.464512 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-hostroot\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.464512 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-system-cni-dir\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.464512 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464490 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.464512 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-run\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-lib-modules\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-tuned\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af634bdb-1625-437f-9e8d-c3c41386143c-cni-binary-copy\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-multus-conf-dir\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-run-multus-certs\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6b29734-5571-4e06-a3b1-232d14cb2c02-host-slash\") pod \"iptables-alerter-mgpc8\" (UID: \"d6b29734-5571-4e06-a3b1-232d14cb2c02\") " pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-cnibin\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464634 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-os-release\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzzgs\" (UniqueName: \"kubernetes.io/projected/958fef8c-f445-44ce-8c5f-6f80c528d394-kube-api-access-bzzgs\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-host\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-os-release\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.464788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-sys\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-multus-socket-dir-parent\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-run-netns\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/958fef8c-f445-44ce-8c5f-6f80c528d394-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6b29734-5571-4e06-a3b1-232d14cb2c02-iptables-alerter-script\") pod \"iptables-alerter-mgpc8\" (UID: \"d6b29734-5571-4e06-a3b1-232d14cb2c02\") " pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-sysconfig\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464920 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-kubernetes\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-cnibin\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/958fef8c-f445-44ce-8c5f-6f80c528d394-cni-binary-copy\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-modprobe-d\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.464992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-var-lib-kubelet\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.465013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-sysctl-d\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.465036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-system-cni-dir\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.465095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-multus-cni-dir\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.465347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.465120 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af634bdb-1625-437f-9e8d-c3c41386143c-multus-daemon-config\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.465981 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.465147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s44g\" (UniqueName: \"kubernetes.io/projected/af634bdb-1625-437f-9e8d-c3c41386143c-kube-api-access-8s44g\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.465981 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.465171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfh4\" (UniqueName: \"kubernetes.io/projected/a9a4d589-d1bc-4604-affa-2aa626fc7021-kube-api-access-sgfh4\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:08.467279 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.467262 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.467279 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.467273 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.467858 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.467840 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 09:43:08.468169 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.468152 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 09:43:08.468356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.468336 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tzhlt\"" Jun 03 09:43:08.470678 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.470414 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 09:43:08.470678 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.470503 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 09:43:08.471330 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.471313 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 09:43:08.471420 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.471388 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 09:43:08.471467 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.471447 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 09:43:08.471510 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.471447 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 09:43:08.471555 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.471517 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wjgjr\"" Jun 03 09:43:08.472028 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.471754 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9x97t\"" Jun 03 09:43:08.551286 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.551260 2581 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 09:43:08.565795 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565769 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:08.565795 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565798 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-sys\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.565958 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565814 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-multus-socket-dir-parent\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.565958 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-device-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.565958 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565868 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-sys-fs\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.565958 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-systemd-units\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.565958 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565908 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-sys\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.565958 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565909 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-multus-socket-dir-parent\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.565958 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565945 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/958fef8c-f445-44ce-8c5f-6f80c528d394-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.565976 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-cnibin\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-cni-bin\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-ovnkube-config\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566058 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/958fef8c-f445-44ce-8c5f-6f80c528d394-cni-binary-copy\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566063 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-cnibin\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47rc7\" (UniqueName: \"kubernetes.io/projected/ced04495-5f40-4e7d-ae5c-53efaeeec70f-kube-api-access-47rc7\") pod \"node-ca-b525w\" (UID: \"ced04495-5f40-4e7d-ae5c-53efaeeec70f\") " pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566101 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-sysctl-d\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566126 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-multus-cni-dir\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566154 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af634bdb-1625-437f-9e8d-c3c41386143c-multus-daemon-config\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.566185 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566176 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfh4\" (UniqueName: \"kubernetes.io/projected/a9a4d589-d1bc-4604-affa-2aa626fc7021-kube-api-access-sgfh4\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/19bb936b-7cb7-4b1f-810c-00d367f83055-konnectivity-ca\") pod \"konnectivity-agent-jf6z9\" (UID: \"19bb936b-7cb7-4b1f-810c-00d367f83055\") " pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566200 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-multus-cni-dir\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-var-lib-openvswitch\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566240 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8t65c\" (UniqueName: \"kubernetes.io/projected/d6b29734-5571-4e06-a3b1-232d14cb2c02-kube-api-access-8t65c\") pod \"iptables-alerter-mgpc8\" (UID: \"d6b29734-5571-4e06-a3b1-232d14cb2c02\") " pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566263 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-var-lib-kubelet\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566286 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pwg4\" (UniqueName: \"kubernetes.io/projected/9fea2333-d855-4c22-8eb4-89f7aa063cbe-kube-api-access-9pwg4\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566308 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-etc-kubernetes\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566310 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-sysctl-d\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-kubelet\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-run-ovn\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-cni-netd\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566404 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/958fef8c-f445-44ce-8c5f-6f80c528d394-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566429 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-systemd\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566454 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-hostroot\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-run-netns\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.566671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566541 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566566 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-run\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566616 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-lib-modules\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566648 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-tuned\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566672 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-run-multus-certs\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-run-systemd\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566722 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af634bdb-1625-437f-9e8d-c3c41386143c-multus-daemon-config\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-log-socket\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-systemd\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566826 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-run\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-run-multus-certs\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566860 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-lib-modules\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566867 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-var-lib-kubelet\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566876 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-hostroot\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566910 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-cnibin\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.566969 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567027 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-etc-kubernetes\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.567436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-cnibin\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567159 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-os-release\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567185 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx7nx\" (UniqueName: \"kubernetes.io/projected/3e02cd99-3901-443d-81b4-a15d0e17c7a6-kube-api-access-fx7nx\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67skv\" (UniqueName: \"kubernetes.io/projected/ed18ee14-518a-4d42-b151-62c672753c42-kube-api-access-67skv\") pod \"node-resolver-ctb7x\" (UID: \"ed18ee14-518a-4d42-b151-62c672753c42\") " pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567271 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/958fef8c-f445-44ce-8c5f-6f80c528d394-cni-binary-copy\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ced04495-5f40-4e7d-ae5c-53efaeeec70f-serviceca\") pod \"node-ca-b525w\" (UID: \"ced04495-5f40-4e7d-ae5c-53efaeeec70f\") " pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567313 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-run-netns\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-etc-openvswitch\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567342 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-os-release\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-run-ovn-kubernetes\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-env-overrides\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-ovnkube-script-lib\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:08.567422 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567422 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/958fef8c-f445-44ce-8c5f-6f80c528d394-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567438 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6b29734-5571-4e06-a3b1-232d14cb2c02-iptables-alerter-script\") pod \"iptables-alerter-mgpc8\" (UID: \"d6b29734-5571-4e06-a3b1-232d14cb2c02\") " pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.568253 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567463 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-sysconfig\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-run-netns\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:08.567486 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs podName:a9a4d589-d1bc-4604-affa-2aa626fc7021 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:09.06745816 +0000 UTC m=+3.066529018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs") pod "network-metrics-daemon-l29jq" (UID: "a9a4d589-d1bc-4604-affa-2aa626fc7021") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-sysconfig\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567548 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-kubernetes\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/958fef8c-f445-44ce-8c5f-6f80c528d394-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/19bb936b-7cb7-4b1f-810c-00d367f83055-agent-certs\") pod \"konnectivity-agent-jf6z9\" (UID: \"19bb936b-7cb7-4b1f-810c-00d367f83055\") " pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567672 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-kubernetes\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-ovn-node-metrics-cert\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567733 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-modprobe-d\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567792 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-var-lib-kubelet\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567836 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-modprobe-d\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.567882 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-var-lib-kubelet\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568068 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6b29734-5571-4e06-a3b1-232d14cb2c02-iptables-alerter-script\") pod \"iptables-alerter-mgpc8\" (UID: \"d6b29734-5571-4e06-a3b1-232d14cb2c02\") " pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-registration-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.569039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568540 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-system-cni-dir\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568566 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8s44g\" (UniqueName: \"kubernetes.io/projected/af634bdb-1625-437f-9e8d-c3c41386143c-kube-api-access-8s44g\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568590 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-sysctl-conf\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568638 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-run-k8s-cni-cncf-io\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568661 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fea2333-d855-4c22-8eb4-89f7aa063cbe-tmp\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568682 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-var-lib-cni-bin\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568714 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-var-lib-cni-multus\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed18ee14-518a-4d42-b151-62c672753c42-tmp-dir\") pod \"node-resolver-ctb7x\" (UID: \"ed18ee14-518a-4d42-b151-62c672753c42\") " pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ced04495-5f40-4e7d-ae5c-53efaeeec70f-host\") pod \"node-ca-b525w\" (UID: \"ced04495-5f40-4e7d-ae5c-53efaeeec70f\") " pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-slash\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-run-openvswitch\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-run-k8s-cni-cncf-io\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-socket-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568882 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-system-cni-dir\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568885 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-system-cni-dir\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568907 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af634bdb-1625-437f-9e8d-c3c41386143c-cni-binary-copy\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568931 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-multus-conf-dir\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.569811 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed18ee14-518a-4d42-b151-62c672753c42-hosts-file\") pod \"node-resolver-ctb7x\" (UID: \"ed18ee14-518a-4d42-b151-62c672753c42\") " pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-node-log\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.568999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m87wp\" (UniqueName: \"kubernetes.io/projected/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-kube-api-access-m87wp\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569029 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6b29734-5571-4e06-a3b1-232d14cb2c02-host-slash\") pod \"iptables-alerter-mgpc8\" (UID: \"d6b29734-5571-4e06-a3b1-232d14cb2c02\") " pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569055 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-os-release\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569088 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzzgs\" (UniqueName: \"kubernetes.io/projected/958fef8c-f445-44ce-8c5f-6f80c528d394-kube-api-access-bzzgs\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569111 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-host\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569130 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-sysctl-conf\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569165 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-system-cni-dir\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569200 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fea2333-d855-4c22-8eb4-89f7aa063cbe-host\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-multus-conf-dir\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569483 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/958fef8c-f445-44ce-8c5f-6f80c528d394-os-release\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569525 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6b29734-5571-4e06-a3b1-232d14cb2c02-host-slash\") pod \"iptables-alerter-mgpc8\" (UID: \"d6b29734-5571-4e06-a3b1-232d14cb2c02\") " pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569666 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af634bdb-1625-437f-9e8d-c3c41386143c-cni-binary-copy\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569733 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-var-lib-cni-multus\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.570561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.569754 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af634bdb-1625-437f-9e8d-c3c41386143c-host-var-lib-cni-bin\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.571262 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.570616 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9fea2333-d855-4c22-8eb4-89f7aa063cbe-etc-tuned\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.571473 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.571456 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fea2333-d855-4c22-8eb4-89f7aa063cbe-tmp\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.582101 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.582072 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 09:38:07 +0000 UTC" deadline="2028-03-01 12:12:42.43931569 +0000 UTC" Jun 03 09:43:08.582101 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.582097 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15290h29m33.857221234s" Jun 03 09:43:08.582738 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:08.582526 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:08.582738 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:08.582549 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:08.582738 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:08.582560 2581 projected.go:194] Error preparing data for projected volume kube-api-access-npcgg for pod openshift-network-diagnostics/network-check-target-lnxjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:08.582738 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:08.582627 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg podName:5ec8422b-ffe2-4911-8290-6efa7a25a4b0 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:09.082609756 +0000 UTC m=+3.081680617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-npcgg" (UniqueName: "kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg") pod "network-check-target-lnxjc" (UID: "5ec8422b-ffe2-4911-8290-6efa7a25a4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:08.584712 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.584687 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfh4\" (UniqueName: \"kubernetes.io/projected/a9a4d589-d1bc-4604-affa-2aa626fc7021-kube-api-access-sgfh4\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:08.586027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.585984 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzzgs\" (UniqueName: \"kubernetes.io/projected/958fef8c-f445-44ce-8c5f-6f80c528d394-kube-api-access-bzzgs\") pod \"multus-additional-cni-plugins-qnrcx\" (UID: \"958fef8c-f445-44ce-8c5f-6f80c528d394\") " pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.587241 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.586684 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s44g\" (UniqueName: \"kubernetes.io/projected/af634bdb-1625-437f-9e8d-c3c41386143c-kube-api-access-8s44g\") pod \"multus-zzjpd\" (UID: \"af634bdb-1625-437f-9e8d-c3c41386143c\") " pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.587380 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.587358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pwg4\" (UniqueName: \"kubernetes.io/projected/9fea2333-d855-4c22-8eb4-89f7aa063cbe-kube-api-access-9pwg4\") pod \"tuned-49jlt\" (UID: \"9fea2333-d855-4c22-8eb4-89f7aa063cbe\") " pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.588113 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.588020 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t65c\" (UniqueName: \"kubernetes.io/projected/d6b29734-5571-4e06-a3b1-232d14cb2c02-kube-api-access-8t65c\") pod \"iptables-alerter-mgpc8\" (UID: \"d6b29734-5571-4e06-a3b1-232d14cb2c02\") " pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.589074 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.589027 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal" event={"ID":"4a81c4b353697dcd6d18eda03f48f2de","Type":"ContainerStarted","Data":"1644b24cddfc385455de60a8d9d6cc058a71da24c0b1b3d0fc69d3a0ef1266ca"} Jun 03 09:43:08.590537 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.590513 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" event={"ID":"8b947761e3a7fdae22c9238b5b9e04d7","Type":"ContainerStarted","Data":"8cf3d9e9c3765ca9817558dc79c84e29ab7cd439c294c1099deecd469eed6c20"} Jun 03 09:43:08.670254 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670220 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed18ee14-518a-4d42-b151-62c672753c42-hosts-file\") pod \"node-resolver-ctb7x\" (UID: \"ed18ee14-518a-4d42-b151-62c672753c42\") " pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.670383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670267 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-node-log\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670288 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m87wp\" (UniqueName: \"kubernetes.io/projected/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-kube-api-access-m87wp\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670307 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed18ee14-518a-4d42-b151-62c672753c42-hosts-file\") pod \"node-resolver-ctb7x\" (UID: \"ed18ee14-518a-4d42-b151-62c672753c42\") " pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.670383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670328 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-device-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.670383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670345 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-sys-fs\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.670383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-node-log\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670363 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-systemd-units\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670387 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-cni-bin\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670409 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-sys-fs\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670413 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-ovnkube-config\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-device-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-systemd-units\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670453 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47rc7\" (UniqueName: \"kubernetes.io/projected/ced04495-5f40-4e7d-ae5c-53efaeeec70f-kube-api-access-47rc7\") pod \"node-ca-b525w\" (UID: \"ced04495-5f40-4e7d-ae5c-53efaeeec70f\") " pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670472 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-cni-bin\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670484 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/19bb936b-7cb7-4b1f-810c-00d367f83055-konnectivity-ca\") pod \"konnectivity-agent-jf6z9\" (UID: \"19bb936b-7cb7-4b1f-810c-00d367f83055\") " pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670535 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-var-lib-openvswitch\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670568 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-kubelet\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670609 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-run-ovn\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-var-lib-openvswitch\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670637 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-cni-netd\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670656 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-kubelet\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670664 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-run-netns\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-run-ovn\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.670782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670691 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670711 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-cni-netd\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670717 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-run-netns\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670722 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-run-systemd\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670746 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-log-socket\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670756 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670786 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670793 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-run-systemd\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670812 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fx7nx\" (UniqueName: \"kubernetes.io/projected/3e02cd99-3901-443d-81b4-a15d0e17c7a6-kube-api-access-fx7nx\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-log-socket\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670836 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67skv\" (UniqueName: \"kubernetes.io/projected/ed18ee14-518a-4d42-b151-62c672753c42-kube-api-access-67skv\") pod \"node-resolver-ctb7x\" (UID: \"ed18ee14-518a-4d42-b151-62c672753c42\") " pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670855 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670860 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ced04495-5f40-4e7d-ae5c-53efaeeec70f-serviceca\") pod \"node-ca-b525w\" (UID: \"ced04495-5f40-4e7d-ae5c-53efaeeec70f\") " pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670916 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-etc-openvswitch\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670942 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-run-ovn-kubernetes\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670968 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-env-overrides\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.670990 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-ovnkube-script-lib\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.671561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671012 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-run-ovn-kubernetes\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671017 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-ovnkube-config\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671020 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/19bb936b-7cb7-4b1f-810c-00d367f83055-konnectivity-ca\") pod \"konnectivity-agent-jf6z9\" (UID: \"19bb936b-7cb7-4b1f-810c-00d367f83055\") " pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671046 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-etc-openvswitch\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671016 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/19bb936b-7cb7-4b1f-810c-00d367f83055-agent-certs\") pod \"konnectivity-agent-jf6z9\" (UID: \"19bb936b-7cb7-4b1f-810c-00d367f83055\") " pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671079 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671095 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-ovn-node-metrics-cert\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671113 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-registration-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671132 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed18ee14-518a-4d42-b151-62c672753c42-tmp-dir\") pod \"node-resolver-ctb7x\" (UID: \"ed18ee14-518a-4d42-b151-62c672753c42\") " pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671146 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ced04495-5f40-4e7d-ae5c-53efaeeec70f-host\") pod \"node-ca-b525w\" (UID: \"ced04495-5f40-4e7d-ae5c-53efaeeec70f\") " pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671144 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671182 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-registration-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671212 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-slash\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671238 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-run-openvswitch\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671261 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-socket-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ced04495-5f40-4e7d-ae5c-53efaeeec70f-serviceca\") pod \"node-ca-b525w\" (UID: \"ced04495-5f40-4e7d-ae5c-53efaeeec70f\") " pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-host-slash\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.672259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671373 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-run-openvswitch\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.672953 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671398 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e02cd99-3901-443d-81b4-a15d0e17c7a6-socket-dir\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.672953 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671410 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed18ee14-518a-4d42-b151-62c672753c42-tmp-dir\") pod \"node-resolver-ctb7x\" (UID: \"ed18ee14-518a-4d42-b151-62c672753c42\") " pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.672953 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671404 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ced04495-5f40-4e7d-ae5c-53efaeeec70f-host\") pod \"node-ca-b525w\" (UID: \"ced04495-5f40-4e7d-ae5c-53efaeeec70f\") " pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.672953 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671471 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-env-overrides\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.672953 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.671476 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-ovnkube-script-lib\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.673644 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.673627 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/19bb936b-7cb7-4b1f-810c-00d367f83055-agent-certs\") pod \"konnectivity-agent-jf6z9\" (UID: \"19bb936b-7cb7-4b1f-810c-00d367f83055\") " pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:08.673749 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.673736 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-ovn-node-metrics-cert\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.683671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.683583 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m87wp\" (UniqueName: \"kubernetes.io/projected/95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b-kube-api-access-m87wp\") pod \"ovnkube-node-nkws8\" (UID: \"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.686910 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.686891 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx7nx\" (UniqueName: \"kubernetes.io/projected/3e02cd99-3901-443d-81b4-a15d0e17c7a6-kube-api-access-fx7nx\") pod \"aws-ebs-csi-driver-node-5qgdz\" (UID: \"3e02cd99-3901-443d-81b4-a15d0e17c7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.687227 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.687212 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47rc7\" (UniqueName: \"kubernetes.io/projected/ced04495-5f40-4e7d-ae5c-53efaeeec70f-kube-api-access-47rc7\") pod \"node-ca-b525w\" (UID: \"ced04495-5f40-4e7d-ae5c-53efaeeec70f\") " pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.687299 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.687259 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67skv\" (UniqueName: \"kubernetes.io/projected/ed18ee14-518a-4d42-b151-62c672753c42-kube-api-access-67skv\") pod \"node-resolver-ctb7x\" (UID: \"ed18ee14-518a-4d42-b151-62c672753c42\") " pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.755454 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.755419 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" Jun 03 09:43:08.767309 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.767282 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mgpc8" Jun 03 09:43:08.776181 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.776160 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-49jlt" Jun 03 09:43:08.780701 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.780685 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zzjpd" Jun 03 09:43:08.788315 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.788298 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:08.796750 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.796732 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:08.805251 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.805234 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctb7x" Jun 03 09:43:08.812646 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.812628 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b525w" Jun 03 09:43:08.817138 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.817121 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" Jun 03 09:43:08.903559 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:08.903531 2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:09.073748 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.073719 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:09.073927 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:09.073851 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:09.073927 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:09.073912 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs podName:a9a4d589-d1bc-4604-affa-2aa626fc7021 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:10.07389936 +0000 UTC m=+4.072970198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs") pod "network-metrics-daemon-l29jq" (UID: "a9a4d589-d1bc-4604-affa-2aa626fc7021") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:09.174880 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.174831 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:09.175061 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:09.175024 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:09.175061 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:09.175044 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:09.175061 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:09.175056 2581 projected.go:194] Error preparing data for projected volume kube-api-access-npcgg for pod openshift-network-diagnostics/network-check-target-lnxjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:09.175210 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:09.175116 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg podName:5ec8422b-ffe2-4911-8290-6efa7a25a4b0 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:10.175096059 +0000 UTC m=+4.174166900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-npcgg" (UniqueName: "kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg") pod "network-check-target-lnxjc" (UID: "5ec8422b-ffe2-4911-8290-6efa7a25a4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:09.279473 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:09.279266 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e02cd99_3901_443d_81b4_a15d0e17c7a6.slice/crio-847efb9c9d15e15fdac0ca8d7c7e87a346386043bf3fd8c284dd19bf74ff95d7 WatchSource:0}: Error finding container 847efb9c9d15e15fdac0ca8d7c7e87a346386043bf3fd8c284dd19bf74ff95d7: Status 404 returned error can't find the container with id 847efb9c9d15e15fdac0ca8d7c7e87a346386043bf3fd8c284dd19bf74ff95d7 Jun 03 09:43:09.280662 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:09.280611 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded18ee14_518a_4d42_b151_62c672753c42.slice/crio-ee7c24dbaabbee2f4e3dbfc16dde99ee5e3ee9756ffb9f5e3e130419ad15cae5 WatchSource:0}: Error finding container ee7c24dbaabbee2f4e3dbfc16dde99ee5e3ee9756ffb9f5e3e130419ad15cae5: Status 404 returned error can't find the container with id ee7c24dbaabbee2f4e3dbfc16dde99ee5e3ee9756ffb9f5e3e130419ad15cae5 Jun 03 09:43:09.283995 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:09.283963 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19bb936b_7cb7_4b1f_810c_00d367f83055.slice/crio-40ab92620559ff37d1903fbb4df81403007c8f90f5f573864aa3bc0c7fa143a2 WatchSource:0}: Error finding container 40ab92620559ff37d1903fbb4df81403007c8f90f5f573864aa3bc0c7fa143a2: Status 404 returned error can't find the container with id 40ab92620559ff37d1903fbb4df81403007c8f90f5f573864aa3bc0c7fa143a2 Jun 03 09:43:09.284910 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:09.284886 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fea2333_d855_4c22_8eb4_89f7aa063cbe.slice/crio-e5ce219aa9aa0eada87820d92067dc6f46d4d9b9aaf7f10cf14cfd1cc19e70ce WatchSource:0}: Error finding container e5ce219aa9aa0eada87820d92067dc6f46d4d9b9aaf7f10cf14cfd1cc19e70ce: Status 404 returned error can't find the container with id e5ce219aa9aa0eada87820d92067dc6f46d4d9b9aaf7f10cf14cfd1cc19e70ce Jun 03 09:43:09.286018 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:09.285995 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bcc5ec_b3e4_4c77_9ed1_9d8ab062b40b.slice/crio-addfa3c525c5510dc09cd11d21b00d24dc1f73f00ec7b8097138afc3fdf8ffe9 WatchSource:0}: Error finding container addfa3c525c5510dc09cd11d21b00d24dc1f73f00ec7b8097138afc3fdf8ffe9: Status 404 returned error can't find the container with id addfa3c525c5510dc09cd11d21b00d24dc1f73f00ec7b8097138afc3fdf8ffe9 Jun 03 09:43:09.288744 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:09.288719 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf634bdb_1625_437f_9e8d_c3c41386143c.slice/crio-88e938d859fd4dc80ea97f20054cbbc191af1f590a47e20516e302a9b14eb20b WatchSource:0}: Error finding container 88e938d859fd4dc80ea97f20054cbbc191af1f590a47e20516e302a9b14eb20b: Status 404 returned error can't find the container with id 88e938d859fd4dc80ea97f20054cbbc191af1f590a47e20516e302a9b14eb20b Jun 03 09:43:09.289648 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:09.289623 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced04495_5f40_4e7d_ae5c_53efaeeec70f.slice/crio-57c4a805f867ebdb7c57c4cf513d18f0fa128fabac7b567a64adf302d662ae78 WatchSource:0}: Error finding container 57c4a805f867ebdb7c57c4cf513d18f0fa128fabac7b567a64adf302d662ae78: Status 404 returned error can't find the container with id 57c4a805f867ebdb7c57c4cf513d18f0fa128fabac7b567a64adf302d662ae78 Jun 03 09:43:09.290239 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:09.290126 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958fef8c_f445_44ce_8c5f_6f80c528d394.slice/crio-77d806a222c5956018b54335d1313dfe4b4bafde61e4b2be0f6cf7303904fb89 WatchSource:0}: Error finding container 77d806a222c5956018b54335d1313dfe4b4bafde61e4b2be0f6cf7303904fb89: Status 404 returned error can't find the container with id 77d806a222c5956018b54335d1313dfe4b4bafde61e4b2be0f6cf7303904fb89 Jun 03 09:43:09.291429 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:09.291396 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b29734_5571_4e06_a3b1_232d14cb2c02.slice/crio-d318c65d1d0f9f1279a2aa24ef94fd16de042271fcd22abaadafc953f6327df8 WatchSource:0}: Error finding container d318c65d1d0f9f1279a2aa24ef94fd16de042271fcd22abaadafc953f6327df8: Status 404 returned error can't find the container with id d318c65d1d0f9f1279a2aa24ef94fd16de042271fcd22abaadafc953f6327df8 Jun 03 09:43:09.582216 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.582181 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 09:38:07 +0000 UTC" deadline="2028-02-14 21:55:27.702932318 +0000 UTC" Jun 03 09:43:09.582216 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.582213 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14916h12m18.12072173s" Jun 03 09:43:09.584715 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.584694 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:09.584798 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.584694 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:09.584831 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:09.584788 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:09.584863 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:09.584850 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:09.593776 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.593754 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b525w" event={"ID":"ced04495-5f40-4e7d-ae5c-53efaeeec70f","Type":"ContainerStarted","Data":"57c4a805f867ebdb7c57c4cf513d18f0fa128fabac7b567a64adf302d662ae78"} Jun 03 09:43:09.594693 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.594662 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-49jlt" event={"ID":"9fea2333-d855-4c22-8eb4-89f7aa063cbe","Type":"ContainerStarted","Data":"e5ce219aa9aa0eada87820d92067dc6f46d4d9b9aaf7f10cf14cfd1cc19e70ce"} Jun 03 09:43:09.595574 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.595552 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" event={"ID":"3e02cd99-3901-443d-81b4-a15d0e17c7a6","Type":"ContainerStarted","Data":"847efb9c9d15e15fdac0ca8d7c7e87a346386043bf3fd8c284dd19bf74ff95d7"} Jun 03 09:43:09.597056 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.597038 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" event={"ID":"8b947761e3a7fdae22c9238b5b9e04d7","Type":"ContainerStarted","Data":"6ca5e36f423bdd09ab1fc48aecf23356c6920529ab3fb1097250b233e59d3a0e"} Jun 03 09:43:09.598039 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.598010 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mgpc8" event={"ID":"d6b29734-5571-4e06-a3b1-232d14cb2c02","Type":"ContainerStarted","Data":"d318c65d1d0f9f1279a2aa24ef94fd16de042271fcd22abaadafc953f6327df8"} Jun 03 09:43:09.598937 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.598920 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zzjpd" event={"ID":"af634bdb-1625-437f-9e8d-c3c41386143c","Type":"ContainerStarted","Data":"88e938d859fd4dc80ea97f20054cbbc191af1f590a47e20516e302a9b14eb20b"} Jun 03 09:43:09.599885 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.599858 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" event={"ID":"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b","Type":"ContainerStarted","Data":"addfa3c525c5510dc09cd11d21b00d24dc1f73f00ec7b8097138afc3fdf8ffe9"} Jun 03 09:43:09.600638 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.600618 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jf6z9" event={"ID":"19bb936b-7cb7-4b1f-810c-00d367f83055","Type":"ContainerStarted","Data":"40ab92620559ff37d1903fbb4df81403007c8f90f5f573864aa3bc0c7fa143a2"} Jun 03 09:43:09.601588 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.601570 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctb7x" event={"ID":"ed18ee14-518a-4d42-b151-62c672753c42","Type":"ContainerStarted","Data":"ee7c24dbaabbee2f4e3dbfc16dde99ee5e3ee9756ffb9f5e3e130419ad15cae5"} Jun 03 09:43:09.602865 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.602843 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal" event={"ID":"4a81c4b353697dcd6d18eda03f48f2de","Type":"ContainerStarted","Data":"57670d3f144c42c8ba711d1ae6296fd0eeb6db11fd8f412c281b3d652e8c082a"} Jun 03 09:43:09.603754 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.603736 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerStarted","Data":"77d806a222c5956018b54335d1313dfe4b4bafde61e4b2be0f6cf7303904fb89"} Jun 03 09:43:09.639113 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:09.639075 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-171.ec2.internal" podStartSLOduration=2.639062348 podStartE2EDuration="2.639062348s" podCreationTimestamp="2026-06-03 09:43:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:43:09.638838233 +0000 UTC m=+3.637909107" watchObservedRunningTime="2026-06-03 09:43:09.639062348 +0000 UTC m=+3.638133207" Jun 03 09:43:10.080856 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:10.080815 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:10.081026 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:10.080974 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:10.081106 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:10.081038 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs podName:a9a4d589-d1bc-4604-affa-2aa626fc7021 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:12.081018123 +0000 UTC m=+6.080088981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs") pod "network-metrics-daemon-l29jq" (UID: "a9a4d589-d1bc-4604-affa-2aa626fc7021") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:10.182090 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:10.182047 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:10.182373 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:10.182352 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:10.182456 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:10.182380 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:10.182456 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:10.182412 2581 projected.go:194] Error preparing data for projected volume kube-api-access-npcgg for pod openshift-network-diagnostics/network-check-target-lnxjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:10.182567 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:10.182474 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg podName:5ec8422b-ffe2-4911-8290-6efa7a25a4b0 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:12.182455801 +0000 UTC m=+6.181526657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-npcgg" (UniqueName: "kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg") pod "network-check-target-lnxjc" (UID: "5ec8422b-ffe2-4911-8290-6efa7a25a4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:10.616248 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:10.616207 2581 generic.go:358] "Generic (PLEG): container finished" podID="8b947761e3a7fdae22c9238b5b9e04d7" containerID="6ca5e36f423bdd09ab1fc48aecf23356c6920529ab3fb1097250b233e59d3a0e" exitCode=0 Jun 03 09:43:10.616735 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:10.616358 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" event={"ID":"8b947761e3a7fdae22c9238b5b9e04d7","Type":"ContainerDied","Data":"6ca5e36f423bdd09ab1fc48aecf23356c6920529ab3fb1097250b233e59d3a0e"} Jun 03 09:43:11.586184 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:11.585511 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:11.586184 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:11.585662 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:11.586184 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:11.586044 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:11.586184 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:11.586136 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:11.633624 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:11.633110 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" event={"ID":"8b947761e3a7fdae22c9238b5b9e04d7","Type":"ContainerStarted","Data":"472ad3cab8cde24cda2d0ce60855690313fcd81fa5439cb674660667b105a6c4"} Jun 03 09:43:12.097449 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:12.097409 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:12.097655 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:12.097560 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:12.097655 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:12.097639 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs podName:a9a4d589-d1bc-4604-affa-2aa626fc7021 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:16.097620321 +0000 UTC m=+10.096691162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs") pod "network-metrics-daemon-l29jq" (UID: "a9a4d589-d1bc-4604-affa-2aa626fc7021") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:12.198086 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:12.198048 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:12.198279 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:12.198258 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:12.198337 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:12.198287 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:12.198337 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:12.198301 2581 projected.go:194] Error preparing data for projected volume kube-api-access-npcgg for pod openshift-network-diagnostics/network-check-target-lnxjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:12.198437 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:12.198357 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg podName:5ec8422b-ffe2-4911-8290-6efa7a25a4b0 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:16.198338257 +0000 UTC m=+10.197409119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-npcgg" (UniqueName: "kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg") pod "network-check-target-lnxjc" (UID: "5ec8422b-ffe2-4911-8290-6efa7a25a4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:13.585000 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:13.584960 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:13.585433 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:13.585104 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:13.585530 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:13.585507 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:13.585673 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:13.585613 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:15.584761 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:15.584725 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:15.585365 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:15.584879 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:15.585365 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:15.584948 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:15.585365 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:15.585066 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:16.130308 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:16.130267 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:16.130522 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:16.130466 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:16.130588 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:16.130532 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs podName:a9a4d589-d1bc-4604-affa-2aa626fc7021 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:24.130511118 +0000 UTC m=+18.129581958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs") pod "network-metrics-daemon-l29jq" (UID: "a9a4d589-d1bc-4604-affa-2aa626fc7021") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:16.230732 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:16.230693 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:16.230931 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:16.230904 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:16.230981 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:16.230936 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:16.230981 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:16.230950 2581 projected.go:194] Error preparing data for projected volume kube-api-access-npcgg for pod openshift-network-diagnostics/network-check-target-lnxjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:16.231122 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:16.231055 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg podName:5ec8422b-ffe2-4911-8290-6efa7a25a4b0 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:24.23103439 +0000 UTC m=+18.230105237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-npcgg" (UniqueName: "kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg") pod "network-check-target-lnxjc" (UID: "5ec8422b-ffe2-4911-8290-6efa7a25a4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:17.585665 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:17.585620 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:17.585665 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:17.585672 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:17.586077 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:17.585779 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:17.586235 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:17.586191 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:19.585704 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:19.585068 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:19.585704 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:19.585204 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:19.585704 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:19.585545 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:19.585704 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:19.585654 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:21.585632 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:21.585549 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:21.586057 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:21.585688 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:21.586057 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:21.585753 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:21.586057 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:21.585860 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:23.584833 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:23.584801 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:23.584833 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:23.584825 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:23.585344 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:23.584923 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:23.585344 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:23.585052 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:24.183772 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:24.183738 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:24.183956 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:24.183852 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:24.183956 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:24.183914 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs podName:a9a4d589-d1bc-4604-affa-2aa626fc7021 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:40.183893671 +0000 UTC m=+34.182964515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs") pod "network-metrics-daemon-l29jq" (UID: "a9a4d589-d1bc-4604-affa-2aa626fc7021") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:24.284095 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:24.284061 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:24.284277 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:24.284256 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:24.284350 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:24.284285 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:24.284350 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:24.284298 2581 projected.go:194] Error preparing data for projected volume kube-api-access-npcgg for pod openshift-network-diagnostics/network-check-target-lnxjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:24.284436 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:24.284360 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg podName:5ec8422b-ffe2-4911-8290-6efa7a25a4b0 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:40.28434018 +0000 UTC m=+34.283411020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-npcgg" (UniqueName: "kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg") pod "network-check-target-lnxjc" (UID: "5ec8422b-ffe2-4911-8290-6efa7a25a4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:25.584915 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:25.584875 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:25.584915 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:25.584904 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:25.585403 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:25.585008 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:25.585403 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:25.585116 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:27.585497 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:27.585473 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:27.585859 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:27.585612 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:27.585859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:27.585642 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:27.585859 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:27.585773 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:27.666008 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:27.665392 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jf6z9" event={"ID":"19bb936b-7cb7-4b1f-810c-00d367f83055","Type":"ContainerStarted","Data":"09bf64e3a9e39558a5a7ea9c1e29af12496225b434a6424aff2e8e146f58f7ee"} Jun 03 09:43:27.669015 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:27.668986 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctb7x" event={"ID":"ed18ee14-518a-4d42-b151-62c672753c42","Type":"ContainerStarted","Data":"83df265fcdec17f7f785702609386a815c0a9b76b6da36436dd6450c06d50019"} Jun 03 09:43:27.688615 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:27.688523 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jf6z9" podStartSLOduration=11.541718798 podStartE2EDuration="21.688507619s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:09.285853409 +0000 UTC m=+3.284924252" lastFinishedPulling="2026-06-03 09:43:19.432642234 +0000 UTC m=+13.431713073" observedRunningTime="2026-06-03 09:43:27.68828689 +0000 UTC m=+21.687357753" watchObservedRunningTime="2026-06-03 09:43:27.688507619 +0000 UTC m=+21.687578480" Jun 03 09:43:27.688950 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:27.688856 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-171.ec2.internal" podStartSLOduration=20.688844929 podStartE2EDuration="20.688844929s" podCreationTimestamp="2026-06-03 09:43:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:43:11.654674082 +0000 UTC m=+5.653744962" watchObservedRunningTime="2026-06-03 09:43:27.688844929 +0000 UTC m=+21.687915790" Jun 03 09:43:27.716435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:27.716386 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ctb7x" podStartSLOduration=3.490544008 podStartE2EDuration="21.716370588s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:09.283081247 +0000 UTC m=+3.282152085" lastFinishedPulling="2026-06-03 09:43:27.508907816 +0000 UTC m=+21.507978665" observedRunningTime="2026-06-03 09:43:27.715962605 +0000 UTC m=+21.715033465" watchObservedRunningTime="2026-06-03 09:43:27.716370588 +0000 UTC m=+21.715441450" Jun 03 09:43:28.590715 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.590512 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 09:43:28.672169 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.672135 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zzjpd" event={"ID":"af634bdb-1625-437f-9e8d-c3c41386143c","Type":"ContainerStarted","Data":"bcdabc648c76a6ed71e53b4f4a7c9764ae75b8c116a396b404d35c14a1d976bc"} Jun 03 09:43:28.674808 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.674781 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" event={"ID":"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b","Type":"ContainerStarted","Data":"ff2264e63a86234343c7fabd64409b50cc939b7ce17c1de567e682930705c39b"} Jun 03 09:43:28.674883 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.674809 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" event={"ID":"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b","Type":"ContainerStarted","Data":"2f20cea9ed64f7047e43bddce136026fe5923bbd0783f1974240e42cd91e3e50"} Jun 03 09:43:28.674883 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.674823 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" event={"ID":"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b","Type":"ContainerStarted","Data":"f301ca1598195ae88e9a8835c8e40df57b6597213b4fa66911e5010813899592"} Jun 03 09:43:28.674883 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.674833 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" event={"ID":"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b","Type":"ContainerStarted","Data":"928eba7533cfa0d142c008d98163e80d8211e2baa8879f4782dca30da8d9f49c"} Jun 03 09:43:28.674883 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.674842 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" event={"ID":"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b","Type":"ContainerStarted","Data":"046c583620c2f04817ad0cd727123d21386ffaeaa83d68a20cd7226ac03a18d7"} Jun 03 09:43:28.674883 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.674853 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" event={"ID":"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b","Type":"ContainerStarted","Data":"ff128a2c21e546f4230b3043ad7c0dbe2f391488fcd7e6397faf437a01ae2988"} Jun 03 09:43:28.676041 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.676012 2581 generic.go:358] "Generic (PLEG): container finished" podID="958fef8c-f445-44ce-8c5f-6f80c528d394" containerID="4e128bdb4c4cb03f0c13360ab45a71cb30016ed2e20a9d32a04566aff4b285b9" exitCode=0 Jun 03 09:43:28.676140 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.676041 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerDied","Data":"4e128bdb4c4cb03f0c13360ab45a71cb30016ed2e20a9d32a04566aff4b285b9"} Jun 03 09:43:28.677399 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.677379 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b525w" event={"ID":"ced04495-5f40-4e7d-ae5c-53efaeeec70f","Type":"ContainerStarted","Data":"0ffe58275c0d2c6abd7526eed871cd323019ea64712f8e6094548c7d7f94e947"} Jun 03 09:43:28.678724 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.678695 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-49jlt" event={"ID":"9fea2333-d855-4c22-8eb4-89f7aa063cbe","Type":"ContainerStarted","Data":"f11f1d9c1a9fde0e9fbe9a69a6016b502a7b0fba399b4ff6874967d0a3f6ec27"} Jun 03 09:43:28.680173 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.680156 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" event={"ID":"3e02cd99-3901-443d-81b4-a15d0e17c7a6","Type":"ContainerStarted","Data":"23d490400f199d860dd47cb9242baecc52cf6f86baed22b9b269ea5ebf707cc7"} Jun 03 09:43:28.680245 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.680179 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" event={"ID":"3e02cd99-3901-443d-81b4-a15d0e17c7a6","Type":"ContainerStarted","Data":"6f77b2d23325bf373563e8bd643f35f8843950f176d8101caf611df5a30ef460"} Jun 03 09:43:28.695816 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.695781 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zzjpd" podStartSLOduration=4.436064158 podStartE2EDuration="22.695770211s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:09.290698542 +0000 UTC m=+3.289769380" lastFinishedPulling="2026-06-03 09:43:27.550404578 +0000 UTC m=+21.549475433" observedRunningTime="2026-06-03 09:43:28.695235202 +0000 UTC m=+22.694306065" watchObservedRunningTime="2026-06-03 09:43:28.695770211 +0000 UTC m=+22.694841071" Jun 03 09:43:28.736872 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.736833 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-49jlt" podStartSLOduration=4.514622976 podStartE2EDuration="22.736821416s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:09.286649713 +0000 UTC m=+3.285720550" lastFinishedPulling="2026-06-03 09:43:27.508848145 +0000 UTC m=+21.507918990" observedRunningTime="2026-06-03 09:43:28.736337488 +0000 UTC m=+22.735408350" watchObservedRunningTime="2026-06-03 09:43:28.736821416 +0000 UTC m=+22.735892300" Jun 03 09:43:28.756402 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:28.756368 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b525w" podStartSLOduration=4.56050675 podStartE2EDuration="22.75635833s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:09.292511486 +0000 UTC m=+3.291582324" lastFinishedPulling="2026-06-03 09:43:27.48836306 +0000 UTC m=+21.487433904" observedRunningTime="2026-06-03 09:43:28.756236558 +0000 UTC m=+22.755307418" watchObservedRunningTime="2026-06-03 09:43:28.75635833 +0000 UTC m=+22.755429189" Jun 03 09:43:29.520080 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:29.519992 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T09:43:28.590713256Z","UUID":"eefa30ce-be00-4560-9522-d43e9c83833a","Handler":null,"Name":"","Endpoint":""} Jun 03 09:43:29.521996 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:29.521965 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 09:43:29.522110 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:29.522016 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 09:43:29.585465 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:29.585435 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:29.585558 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:29.585471 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:29.585633 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:29.585564 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:29.585721 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:29.585695 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:29.682740 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:29.682710 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mgpc8" event={"ID":"d6b29734-5571-4e06-a3b1-232d14cb2c02","Type":"ContainerStarted","Data":"e51f44c98ab19bc6ae9e83e16de04316626c4ff60a0e18dbd3ba3ab1befab9e1"} Jun 03 09:43:29.684469 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:29.684441 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" event={"ID":"3e02cd99-3901-443d-81b4-a15d0e17c7a6","Type":"ContainerStarted","Data":"e94a19a5dd884deb3839b7b6a48909646c823c3e4f4e5f4677197c04c60165c6"} Jun 03 09:43:29.727142 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:29.727104 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mgpc8" podStartSLOduration=5.511846619 podStartE2EDuration="23.727092491s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:09.293462065 +0000 UTC m=+3.292532907" lastFinishedPulling="2026-06-03 09:43:27.508707927 +0000 UTC m=+21.507778779" observedRunningTime="2026-06-03 09:43:29.704260712 +0000 UTC m=+23.703331571" watchObservedRunningTime="2026-06-03 09:43:29.727092491 +0000 UTC m=+23.726163351" Jun 03 09:43:30.692110 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:30.691852 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" event={"ID":"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b","Type":"ContainerStarted","Data":"e97f7069ec884b95dbcce2261fa7fd2c658938b96e0f53a355c5d6ef1572f0f6"} Jun 03 09:43:31.585587 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:31.585557 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:31.585806 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:31.585632 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:31.585806 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:31.585726 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:31.585920 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:31.585855 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:32.269218 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:32.269179 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:32.269879 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:32.269860 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:32.288902 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:32.288863 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qgdz" podStartSLOduration=6.063703417 podStartE2EDuration="26.288851847s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:09.282139493 +0000 UTC m=+3.281210349" lastFinishedPulling="2026-06-03 09:43:29.507287927 +0000 UTC m=+23.506358779" observedRunningTime="2026-06-03 09:43:29.728240156 +0000 UTC m=+23.727311016" watchObservedRunningTime="2026-06-03 09:43:32.288851847 +0000 UTC m=+26.287922708" Jun 03 09:43:32.695827 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:32.695800 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:32.696319 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:32.696303 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jf6z9" Jun 03 09:43:33.585531 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:33.585361 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:33.586164 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:33.585361 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:33.586164 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:33.585628 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:33.586164 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:33.585685 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:33.700419 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:33.700379 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" event={"ID":"95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b","Type":"ContainerStarted","Data":"39ced01bc2e144a32a5cd165c537e93d98f2d22982b37ee6fe67345d1e7de01b"} Jun 03 09:43:33.700706 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:33.700687 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:33.700706 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:33.700715 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:33.704323 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:33.704295 2581 generic.go:358] "Generic (PLEG): container finished" podID="958fef8c-f445-44ce-8c5f-6f80c528d394" containerID="4eca992026ccb69ff03eb58cd0373c4f21e7faf428b9da0e5dbe6f50535596b7" exitCode=0 Jun 03 09:43:33.704403 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:33.704329 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerDied","Data":"4eca992026ccb69ff03eb58cd0373c4f21e7faf428b9da0e5dbe6f50535596b7"} Jun 03 09:43:33.717662 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:33.717642 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:33.734065 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:33.734028 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" podStartSLOduration=9.431361348 podStartE2EDuration="27.73401651s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:09.287693317 +0000 UTC m=+3.286764156" lastFinishedPulling="2026-06-03 09:43:27.590348478 +0000 UTC m=+21.589419318" observedRunningTime="2026-06-03 09:43:33.733929575 +0000 UTC m=+27.733000435" watchObservedRunningTime="2026-06-03 09:43:33.73401651 +0000 UTC m=+27.733087394" Jun 03 09:43:34.708669 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:34.708639 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerStarted","Data":"7b11d7f3ab62e95efdf72ad7532d9fb1068a5c447e89dc5b7598ed4923c7403a"} Jun 03 09:43:34.709573 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:34.709540 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:34.724156 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:34.724139 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:43:34.911564 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:34.911495 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l29jq"] Jun 03 09:43:34.911695 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:34.911644 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:34.911785 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:34.911761 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:34.914361 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:34.914341 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lnxjc"] Jun 03 09:43:34.914446 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:34.914437 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:34.914522 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:34.914504 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:35.711826 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:35.711785 2581 generic.go:358] "Generic (PLEG): container finished" podID="958fef8c-f445-44ce-8c5f-6f80c528d394" containerID="7b11d7f3ab62e95efdf72ad7532d9fb1068a5c447e89dc5b7598ed4923c7403a" exitCode=0 Jun 03 09:43:35.712178 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:35.711870 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerDied","Data":"7b11d7f3ab62e95efdf72ad7532d9fb1068a5c447e89dc5b7598ed4923c7403a"} Jun 03 09:43:36.586347 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:36.586177 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:36.586496 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:36.586260 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:36.586496 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:36.586411 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:36.586689 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:36.586502 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:37.717252 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:37.717216 2581 generic.go:358] "Generic (PLEG): container finished" podID="958fef8c-f445-44ce-8c5f-6f80c528d394" containerID="7516f8cc90b22df435c54b62e5e585710f7b9981b1480da8ddf0fe73cc4bcbff" exitCode=0 Jun 03 09:43:37.717968 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:37.717270 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerDied","Data":"7516f8cc90b22df435c54b62e5e585710f7b9981b1480da8ddf0fe73cc4bcbff"} Jun 03 09:43:38.585217 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:38.585187 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:38.585217 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:38.585211 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:38.585466 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:38.585302 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxjc" podUID="5ec8422b-ffe2-4911-8290-6efa7a25a4b0" Jun 03 09:43:38.585519 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:38.585456 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:43:40.198949 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.198911 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:40.199542 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.199067 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:40.199542 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.199146 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs podName:a9a4d589-d1bc-4604-affa-2aa626fc7021 nodeName:}" failed. No retries permitted until 2026-06-03 09:44:12.199123758 +0000 UTC m=+66.198194597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs") pod "network-metrics-daemon-l29jq" (UID: "a9a4d589-d1bc-4604-affa-2aa626fc7021") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:40.299847 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.299816 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:40.300031 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.299962 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:40.300031 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.299981 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:40.300031 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.299994 2581 projected.go:194] Error preparing data for projected volume kube-api-access-npcgg for pod openshift-network-diagnostics/network-check-target-lnxjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:40.300186 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.300059 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg podName:5ec8422b-ffe2-4911-8290-6efa7a25a4b0 nodeName:}" failed. No retries permitted until 2026-06-03 09:44:12.300038858 +0000 UTC m=+66.299109740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-npcgg" (UniqueName: "kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg") pod "network-check-target-lnxjc" (UID: "5ec8422b-ffe2-4911-8290-6efa7a25a4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:40.300612 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.300579 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-171.ec2.internal" event="NodeReady" Jun 03 09:43:40.300719 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.300708 2581 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 09:43:40.366459 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.366370 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dfnlh"] Jun 03 09:43:40.381939 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.381909 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x96pk"] Jun 03 09:43:40.382095 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.382075 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.384909 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.384722 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 09:43:40.384909 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.384726 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jmbp6\"" Jun 03 09:43:40.384909 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.384834 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 09:43:40.396028 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.396006 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dfnlh"] Jun 03 09:43:40.396028 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.396030 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x96pk"] Jun 03 09:43:40.396208 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.396121 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:40.399771 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.399529 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 09:43:40.399771 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.399585 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 09:43:40.400283 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.400114 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 09:43:40.400283 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.400225 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wwwqd\"" Jun 03 09:43:40.501542 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.501513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d304bac2-71de-4ae7-8340-db864e1e203f-tmp-dir\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.501731 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.501549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d304bac2-71de-4ae7-8340-db864e1e203f-config-volume\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.501731 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.501575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgzjn\" (UniqueName: \"kubernetes.io/projected/d304bac2-71de-4ae7-8340-db864e1e203f-kube-api-access-sgzjn\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.501731 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.501651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:40.501731 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.501705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.501731 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.501730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-882tp\" (UniqueName: \"kubernetes.io/projected/934562dd-9ed1-4387-9055-cb8b3e14aefc-kube-api-access-882tp\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:40.584984 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.584955 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:43:40.584984 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.584972 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:43:40.588455 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.587805 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q22z7\"" Jun 03 09:43:40.588455 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.588187 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwzs9\"" Jun 03 09:43:40.588455 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.588237 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 09:43:40.588455 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.588275 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 09:43:40.588455 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.588361 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 09:43:40.602128 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.602098 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d304bac2-71de-4ae7-8340-db864e1e203f-tmp-dir\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.602235 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.602131 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d304bac2-71de-4ae7-8340-db864e1e203f-config-volume\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.602235 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.602156 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgzjn\" (UniqueName: \"kubernetes.io/projected/d304bac2-71de-4ae7-8340-db864e1e203f-kube-api-access-sgzjn\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.602403 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.602364 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:40.602465 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.602430 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.602519 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.602464 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-882tp\" (UniqueName: \"kubernetes.io/projected/934562dd-9ed1-4387-9055-cb8b3e14aefc-kube-api-access-882tp\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:40.602519 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.602491 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:40.602644 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.602534 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert podName:934562dd-9ed1-4387-9055-cb8b3e14aefc nodeName:}" failed. No retries permitted until 2026-06-03 09:43:41.102520895 +0000 UTC m=+35.101591733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert") pod "ingress-canary-x96pk" (UID: "934562dd-9ed1-4387-9055-cb8b3e14aefc") : secret "canary-serving-cert" not found Jun 03 09:43:40.602727 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.602710 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:40.602828 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.602727 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d304bac2-71de-4ae7-8340-db864e1e203f-config-volume\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.602828 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:40.602760 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls podName:d304bac2-71de-4ae7-8340-db864e1e203f nodeName:}" failed. No retries permitted until 2026-06-03 09:43:41.102747468 +0000 UTC m=+35.101818468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls") pod "dns-default-dfnlh" (UID: "d304bac2-71de-4ae7-8340-db864e1e203f") : secret "dns-default-metrics-tls" not found Jun 03 09:43:40.602930 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.602915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d304bac2-71de-4ae7-8340-db864e1e203f-tmp-dir\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.613875 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.613855 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgzjn\" (UniqueName: \"kubernetes.io/projected/d304bac2-71de-4ae7-8340-db864e1e203f-kube-api-access-sgzjn\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:40.614047 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:40.614028 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-882tp\" (UniqueName: \"kubernetes.io/projected/934562dd-9ed1-4387-9055-cb8b3e14aefc-kube-api-access-882tp\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:41.106644 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:41.106572 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:41.106644 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:41.106640 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:41.106829 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:41.106718 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:41.106829 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:41.106735 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:41.106829 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:41.106782 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls podName:d304bac2-71de-4ae7-8340-db864e1e203f nodeName:}" failed. No retries permitted until 2026-06-03 09:43:42.106768218 +0000 UTC m=+36.105839057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls") pod "dns-default-dfnlh" (UID: "d304bac2-71de-4ae7-8340-db864e1e203f") : secret "dns-default-metrics-tls" not found Jun 03 09:43:41.106829 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:41.106794 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert podName:934562dd-9ed1-4387-9055-cb8b3e14aefc nodeName:}" failed. No retries permitted until 2026-06-03 09:43:42.106788197 +0000 UTC m=+36.105859035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert") pod "ingress-canary-x96pk" (UID: "934562dd-9ed1-4387-9055-cb8b3e14aefc") : secret "canary-serving-cert" not found Jun 03 09:43:42.113970 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:42.113920 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:42.114426 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:42.113990 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:42.114426 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:42.114082 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:42.114426 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:42.114098 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:42.114426 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:42.114151 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert podName:934562dd-9ed1-4387-9055-cb8b3e14aefc nodeName:}" failed. No retries permitted until 2026-06-03 09:43:44.114133969 +0000 UTC m=+38.113204814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert") pod "ingress-canary-x96pk" (UID: "934562dd-9ed1-4387-9055-cb8b3e14aefc") : secret "canary-serving-cert" not found Jun 03 09:43:42.114426 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:42.114170 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls podName:d304bac2-71de-4ae7-8340-db864e1e203f nodeName:}" failed. No retries permitted until 2026-06-03 09:43:44.11416194 +0000 UTC m=+38.113232782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls") pod "dns-default-dfnlh" (UID: "d304bac2-71de-4ae7-8340-db864e1e203f") : secret "dns-default-metrics-tls" not found Jun 03 09:43:43.732119 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:43.731844 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerStarted","Data":"5d1b668b010edf39b0703793d02de1ec1770aca9a40ede3f51947afbeed92930"} Jun 03 09:43:44.128298 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:44.128225 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:44.128298 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:44.128270 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:44.128461 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:44.128361 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:44.128461 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:44.128361 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:44.128461 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:44.128414 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert podName:934562dd-9ed1-4387-9055-cb8b3e14aefc nodeName:}" failed. No retries permitted until 2026-06-03 09:43:48.128399053 +0000 UTC m=+42.127469891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert") pod "ingress-canary-x96pk" (UID: "934562dd-9ed1-4387-9055-cb8b3e14aefc") : secret "canary-serving-cert" not found Jun 03 09:43:44.128461 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:44.128427 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls podName:d304bac2-71de-4ae7-8340-db864e1e203f nodeName:}" failed. No retries permitted until 2026-06-03 09:43:48.128421126 +0000 UTC m=+42.127491964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls") pod "dns-default-dfnlh" (UID: "d304bac2-71de-4ae7-8340-db864e1e203f") : secret "dns-default-metrics-tls" not found Jun 03 09:43:44.735330 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:44.735301 2581 generic.go:358] "Generic (PLEG): container finished" podID="958fef8c-f445-44ce-8c5f-6f80c528d394" containerID="5d1b668b010edf39b0703793d02de1ec1770aca9a40ede3f51947afbeed92930" exitCode=0 Jun 03 09:43:44.735704 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:44.735359 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerDied","Data":"5d1b668b010edf39b0703793d02de1ec1770aca9a40ede3f51947afbeed92930"} Jun 03 09:43:45.740410 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:45.740380 2581 generic.go:358] "Generic (PLEG): container finished" podID="958fef8c-f445-44ce-8c5f-6f80c528d394" containerID="a35f88544f0e8392b60d97517be2bade7e7621c39292e55c190219a2ee74628d" exitCode=0 Jun 03 09:43:45.740867 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:45.740425 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerDied","Data":"a35f88544f0e8392b60d97517be2bade7e7621c39292e55c190219a2ee74628d"} Jun 03 09:43:46.744415 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:46.744380 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" event={"ID":"958fef8c-f445-44ce-8c5f-6f80c528d394","Type":"ContainerStarted","Data":"f278c220ba1932fffd00b60d3902a73f352d2a82057f0b1053f5dc7e1d8c276f"} Jun 03 09:43:46.770303 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:46.770258 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qnrcx" podStartSLOduration=6.513130791 podStartE2EDuration="40.770245048s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:09.292448864 +0000 UTC m=+3.291519703" lastFinishedPulling="2026-06-03 09:43:43.549563108 +0000 UTC m=+37.548633960" observedRunningTime="2026-06-03 09:43:46.769766804 +0000 UTC m=+40.768837680" watchObservedRunningTime="2026-06-03 09:43:46.770245048 +0000 UTC m=+40.769315908" Jun 03 09:43:48.156995 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:48.156949 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:48.157389 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:48.157014 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:48.157389 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:48.157092 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:48.157389 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:48.157111 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:48.157389 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:48.157152 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert podName:934562dd-9ed1-4387-9055-cb8b3e14aefc nodeName:}" failed. No retries permitted until 2026-06-03 09:43:56.157136852 +0000 UTC m=+50.156207695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert") pod "ingress-canary-x96pk" (UID: "934562dd-9ed1-4387-9055-cb8b3e14aefc") : secret "canary-serving-cert" not found Jun 03 09:43:48.157389 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:48.157166 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls podName:d304bac2-71de-4ae7-8340-db864e1e203f nodeName:}" failed. No retries permitted until 2026-06-03 09:43:56.157159413 +0000 UTC m=+50.156230250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls") pod "dns-default-dfnlh" (UID: "d304bac2-71de-4ae7-8340-db864e1e203f") : secret "dns-default-metrics-tls" not found Jun 03 09:43:53.190742 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.190711 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9"] Jun 03 09:43:53.222407 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.222388 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" Jun 03 09:43:53.234152 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.234132 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9"] Jun 03 09:43:53.237456 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.237436 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-w6dd2\"" Jun 03 09:43:53.237456 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.237444 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 09:43:53.238303 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.238284 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 09:43:53.246880 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.246864 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 09:43:53.247623 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.247606 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 09:43:53.393837 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.393809 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fcqn\" (UniqueName: \"kubernetes.io/projected/1c9d7228-0983-4d86-aac8-6534a96f80de-kube-api-access-9fcqn\") pod \"managed-serviceaccount-addon-agent-6fd577d694-f52k9\" (UID: \"1c9d7228-0983-4d86-aac8-6534a96f80de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" Jun 03 09:43:53.393977 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.393847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c9d7228-0983-4d86-aac8-6534a96f80de-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6fd577d694-f52k9\" (UID: \"1c9d7228-0983-4d86-aac8-6534a96f80de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" Jun 03 09:43:53.494722 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.494693 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c9d7228-0983-4d86-aac8-6534a96f80de-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6fd577d694-f52k9\" (UID: \"1c9d7228-0983-4d86-aac8-6534a96f80de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" Jun 03 09:43:53.494855 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.494778 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fcqn\" (UniqueName: \"kubernetes.io/projected/1c9d7228-0983-4d86-aac8-6534a96f80de-kube-api-access-9fcqn\") pod \"managed-serviceaccount-addon-agent-6fd577d694-f52k9\" (UID: \"1c9d7228-0983-4d86-aac8-6534a96f80de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" Jun 03 09:43:53.512455 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.512429 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fcqn\" (UniqueName: \"kubernetes.io/projected/1c9d7228-0983-4d86-aac8-6534a96f80de-kube-api-access-9fcqn\") pod \"managed-serviceaccount-addon-agent-6fd577d694-f52k9\" (UID: \"1c9d7228-0983-4d86-aac8-6534a96f80de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" Jun 03 09:43:53.514581 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.514555 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c9d7228-0983-4d86-aac8-6534a96f80de-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6fd577d694-f52k9\" (UID: \"1c9d7228-0983-4d86-aac8-6534a96f80de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" Jun 03 09:43:53.545436 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.545416 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" Jun 03 09:43:53.695785 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.695748 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9"] Jun 03 09:43:53.699050 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:43:53.699021 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c9d7228_0983_4d86_aac8_6534a96f80de.slice/crio-ce11009cce21f1fb03979fa9a8050a270c5116886f0c88ad5e0a663d9bc73034 WatchSource:0}: Error finding container ce11009cce21f1fb03979fa9a8050a270c5116886f0c88ad5e0a663d9bc73034: Status 404 returned error can't find the container with id ce11009cce21f1fb03979fa9a8050a270c5116886f0c88ad5e0a663d9bc73034 Jun 03 09:43:53.758467 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:53.758403 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" event={"ID":"1c9d7228-0983-4d86-aac8-6534a96f80de","Type":"ContainerStarted","Data":"ce11009cce21f1fb03979fa9a8050a270c5116886f0c88ad5e0a663d9bc73034"} Jun 03 09:43:56.212371 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:56.212322 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:43:56.212932 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:56.212382 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:43:56.212932 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:56.212482 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:56.212932 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:56.212565 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert podName:934562dd-9ed1-4387-9055-cb8b3e14aefc nodeName:}" failed. No retries permitted until 2026-06-03 09:44:12.212542352 +0000 UTC m=+66.211613227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert") pod "ingress-canary-x96pk" (UID: "934562dd-9ed1-4387-9055-cb8b3e14aefc") : secret "canary-serving-cert" not found Jun 03 09:43:56.212932 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:56.212482 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:56.212932 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:43:56.212655 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls podName:d304bac2-71de-4ae7-8340-db864e1e203f nodeName:}" failed. No retries permitted until 2026-06-03 09:44:12.212638633 +0000 UTC m=+66.211709487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls") pod "dns-default-dfnlh" (UID: "d304bac2-71de-4ae7-8340-db864e1e203f") : secret "dns-default-metrics-tls" not found Jun 03 09:43:57.767871 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:57.767836 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" event={"ID":"1c9d7228-0983-4d86-aac8-6534a96f80de","Type":"ContainerStarted","Data":"65b4a01ed36e9ca6b119dc0675d1ad7630a3638718c0a5c1dcb4e2c7140b9079"} Jun 03 09:43:57.796848 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:43:57.796807 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fd577d694-f52k9" podStartSLOduration=1.752910309 podStartE2EDuration="4.796793431s" podCreationTimestamp="2026-06-03 09:43:53 +0000 UTC" firstStartedPulling="2026-06-03 09:43:53.700430748 +0000 UTC m=+47.699501589" lastFinishedPulling="2026-06-03 09:43:56.744313865 +0000 UTC m=+50.743384711" observedRunningTime="2026-06-03 09:43:57.795666039 +0000 UTC m=+51.794736901" watchObservedRunningTime="2026-06-03 09:43:57.796793431 +0000 UTC m=+51.795864290" Jun 03 09:44:06.723796 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:06.723765 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkws8" Jun 03 09:44:12.219404 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.219356 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:44:12.219404 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.219407 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:44:12.219859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.219453 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:44:12.219859 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:12.219523 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:44:12.219859 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:12.219559 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:44:12.219859 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:12.219583 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert podName:934562dd-9ed1-4387-9055-cb8b3e14aefc nodeName:}" failed. No retries permitted until 2026-06-03 09:44:44.219569038 +0000 UTC m=+98.218639877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert") pod "ingress-canary-x96pk" (UID: "934562dd-9ed1-4387-9055-cb8b3e14aefc") : secret "canary-serving-cert" not found Jun 03 09:44:12.219859 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:12.219633 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls podName:d304bac2-71de-4ae7-8340-db864e1e203f nodeName:}" failed. No retries permitted until 2026-06-03 09:44:44.219619509 +0000 UTC m=+98.218690352 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls") pod "dns-default-dfnlh" (UID: "d304bac2-71de-4ae7-8340-db864e1e203f") : secret "dns-default-metrics-tls" not found Jun 03 09:44:12.222184 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.222168 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 09:44:12.230336 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:12.230318 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 09:44:12.230384 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:12.230361 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs podName:a9a4d589-d1bc-4604-affa-2aa626fc7021 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:16.230348933 +0000 UTC m=+130.229419772 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs") pod "network-metrics-daemon-l29jq" (UID: "a9a4d589-d1bc-4604-affa-2aa626fc7021") : secret "metrics-daemon-secret" not found Jun 03 09:44:12.320565 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.320520 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:44:12.323604 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.323581 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 09:44:12.334003 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.333988 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 09:44:12.344100 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.344080 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npcgg\" (UniqueName: \"kubernetes.io/projected/5ec8422b-ffe2-4911-8290-6efa7a25a4b0-kube-api-access-npcgg\") pod \"network-check-target-lnxjc\" (UID: \"5ec8422b-ffe2-4911-8290-6efa7a25a4b0\") " pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:44:12.405228 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.405195 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q22z7\"" Jun 03 09:44:12.412578 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.412559 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:44:12.535236 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.535195 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lnxjc"] Jun 03 09:44:12.537430 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:44:12.537404 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec8422b_ffe2_4911_8290_6efa7a25a4b0.slice/crio-cfb29d7ef7f2197ca7e06b57d0dc77689824f7346835f22a13f4b1df199c87a6 WatchSource:0}: Error finding container cfb29d7ef7f2197ca7e06b57d0dc77689824f7346835f22a13f4b1df199c87a6: Status 404 returned error can't find the container with id cfb29d7ef7f2197ca7e06b57d0dc77689824f7346835f22a13f4b1df199c87a6 Jun 03 09:44:12.797446 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:12.797364 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lnxjc" event={"ID":"5ec8422b-ffe2-4911-8290-6efa7a25a4b0","Type":"ContainerStarted","Data":"cfb29d7ef7f2197ca7e06b57d0dc77689824f7346835f22a13f4b1df199c87a6"} Jun 03 09:44:15.804809 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:15.804771 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lnxjc" event={"ID":"5ec8422b-ffe2-4911-8290-6efa7a25a4b0","Type":"ContainerStarted","Data":"4979a62815db0f8715f342071200060b2666220b4536806d94666f794f939b74"} Jun 03 09:44:15.805277 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:15.805001 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:44:44.232925 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:44.232876 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:44:44.233384 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:44.232959 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:44:44.233384 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:44.233035 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:44:44.233384 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:44.233035 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:44:44.233384 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:44.233104 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls podName:d304bac2-71de-4ae7-8340-db864e1e203f nodeName:}" failed. No retries permitted until 2026-06-03 09:45:48.233083299 +0000 UTC m=+162.232154137 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls") pod "dns-default-dfnlh" (UID: "d304bac2-71de-4ae7-8340-db864e1e203f") : secret "dns-default-metrics-tls" not found Jun 03 09:44:44.233384 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:44:44.233120 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert podName:934562dd-9ed1-4387-9055-cb8b3e14aefc nodeName:}" failed. No retries permitted until 2026-06-03 09:45:48.233112062 +0000 UTC m=+162.232182900 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert") pod "ingress-canary-x96pk" (UID: "934562dd-9ed1-4387-9055-cb8b3e14aefc") : secret "canary-serving-cert" not found Jun 03 09:44:46.808409 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:46.808382 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lnxjc" Jun 03 09:44:46.826809 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:44:46.826767 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lnxjc" podStartSLOduration=98.296560472 podStartE2EDuration="1m40.826755069s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:44:12.53911869 +0000 UTC m=+66.538189529" lastFinishedPulling="2026-06-03 09:44:15.069313286 +0000 UTC m=+69.068384126" observedRunningTime="2026-06-03 09:44:15.830173492 +0000 UTC m=+69.829244352" watchObservedRunningTime="2026-06-03 09:44:46.826755069 +0000 UTC m=+100.825825932" Jun 03 09:45:15.467581 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.467539 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-db467c9c-84rmz"] Jun 03 09:45:15.470520 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.470498 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.473402 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.473379 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 09:45:15.473571 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.473539 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 09:45:15.473731 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.473693 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gsshg\"" Jun 03 09:45:15.473786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.473743 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 09:45:15.481461 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.481437 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 09:45:15.489047 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.489026 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-db467c9c-84rmz"] Jun 03 09:45:15.542782 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.542758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-ca-trust-extracted\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.542878 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.542785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-bound-sa-token\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.542878 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.542808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-installation-pull-secrets\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.542878 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.542835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-certificates\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.542984 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.542880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-trusted-ca\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.542984 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.542899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5mxr\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-kube-api-access-q5mxr\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.542984 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.542947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-image-registry-private-configuration\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.542984 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.542976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.565535 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.565511 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm"] Jun 03 09:45:15.568416 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.568400 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-p45xv"] Jun 03 09:45:15.568553 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.568538 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:15.570982 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.570966 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.571499 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.571486 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 09:45:15.571565 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.571517 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 09:45:15.571817 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.571734 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 09:45:15.572610 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.572579 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d9kvz\"" Jun 03 09:45:15.575611 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.575568 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 09:45:15.575695 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.575617 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 09:45:15.575695 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.575616 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qggnt\"" Jun 03 09:45:15.575873 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.575858 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 09:45:15.578152 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.578138 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 09:45:15.580966 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.580944 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 09:45:15.581279 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.581256 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm"] Jun 03 09:45:15.585153 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.585131 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-p45xv"] Jun 03 09:45:15.588516 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.588490 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 09:45:15.644219 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644192 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-bound-sa-token\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.644344 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644224 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-installation-pull-secrets\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.644344 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0897e30c-0823-4e83-bf4a-68703d4a5572-config\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.644344 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0897e30c-0823-4e83-bf4a-68703d4a5572-serving-cert\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.644344 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0897e30c-0823-4e83-bf4a-68703d4a5572-trusted-ca\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.644344 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644334 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-certificates\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.644583 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644370 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-trusted-ca\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.644583 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644393 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5mxr\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-kube-api-access-q5mxr\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.644583 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644422 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-image-registry-private-configuration\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.644583 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644450 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.644583 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63ea905b-6bb0-4117-a6f1-95928b3a59d7-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:15.644583 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:15.644583 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:15.644542 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 09:45:15.644583 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:15.644557 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-db467c9c-84rmz: secret "image-registry-tls" not found Jun 03 09:45:15.644583 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctvj\" (UniqueName: \"kubernetes.io/projected/63ea905b-6bb0-4117-a6f1-95928b3a59d7-kube-api-access-4ctvj\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:15.645045 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssbz7\" (UniqueName: \"kubernetes.io/projected/0897e30c-0823-4e83-bf4a-68703d4a5572-kube-api-access-ssbz7\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.645045 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:15.644642 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls podName:e608bbe1-ae9a-4e06-9125-a2cdf524dbf2 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:16.144623253 +0000 UTC m=+130.143694095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls") pod "image-registry-db467c9c-84rmz" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2") : secret "image-registry-tls" not found Jun 03 09:45:15.645045 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.644747 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-ca-trust-extracted\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.645197 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.645083 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-certificates\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.645307 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.645285 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-ca-trust-extracted\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.645465 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.645444 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-trusted-ca\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.646889 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.646873 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-installation-pull-secrets\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.646939 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.646919 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-image-registry-private-configuration\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.653701 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.653675 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54958dc7b5-snw5r"] Jun 03 09:45:15.656674 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.656660 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.658983 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.658960 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 09:45:15.659082 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.658990 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n6d4n\"" Jun 03 09:45:15.659145 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.659085 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 09:45:15.659145 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.659098 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 09:45:15.659145 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.659090 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 09:45:15.659145 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.659138 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 09:45:15.659320 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.659290 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 09:45:15.671710 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.671685 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54958dc7b5-snw5r"] Jun 03 09:45:15.672953 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.672933 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-bound-sa-token\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.674468 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.674449 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5mxr\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-kube-api-access-q5mxr\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:15.745910 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.745881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.746054 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.745950 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63ea905b-6bb0-4117-a6f1-95928b3a59d7-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:15.746054 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.745980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-default-certificate\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.746054 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.746054 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746040 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:15.746183 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746092 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctvj\" (UniqueName: \"kubernetes.io/projected/63ea905b-6bb0-4117-a6f1-95928b3a59d7-kube-api-access-4ctvj\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:15.746183 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:15.746123 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:15.746276 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746124 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssbz7\" (UniqueName: \"kubernetes.io/projected/0897e30c-0823-4e83-bf4a-68703d4a5572-kube-api-access-ssbz7\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.746276 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:15.746190 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls podName:63ea905b-6bb0-4117-a6f1-95928b3a59d7 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:16.246171481 +0000 UTC m=+130.245242338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gbdcm" (UID: "63ea905b-6bb0-4117-a6f1-95928b3a59d7") : secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:15.746276 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746259 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0897e30c-0823-4e83-bf4a-68703d4a5572-config\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.746432 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746286 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0897e30c-0823-4e83-bf4a-68703d4a5572-serving-cert\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.746432 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746311 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0897e30c-0823-4e83-bf4a-68703d4a5572-trusted-ca\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.746432 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdl5r\" (UniqueName: \"kubernetes.io/projected/9073f3d7-84c8-49bc-8978-88984a883160-kube-api-access-vdl5r\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.746432 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-stats-auth\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.746687 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746670 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63ea905b-6bb0-4117-a6f1-95928b3a59d7-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:15.746960 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.746940 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0897e30c-0823-4e83-bf4a-68703d4a5572-config\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.747034 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.747018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0897e30c-0823-4e83-bf4a-68703d4a5572-trusted-ca\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.748723 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.748709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0897e30c-0823-4e83-bf4a-68703d4a5572-serving-cert\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.757752 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.757733 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssbz7\" (UniqueName: \"kubernetes.io/projected/0897e30c-0823-4e83-bf4a-68703d4a5572-kube-api-access-ssbz7\") pod \"console-operator-86d7c6cc77-p45xv\" (UID: \"0897e30c-0823-4e83-bf4a-68703d4a5572\") " pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:15.757944 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.757928 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctvj\" (UniqueName: \"kubernetes.io/projected/63ea905b-6bb0-4117-a6f1-95928b3a59d7-kube-api-access-4ctvj\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:15.846887 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.846853 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-default-certificate\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.846887 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.846887 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.847103 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:15.846996 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:16.346981554 +0000 UTC m=+130.346052392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : configmap references non-existent config key: service-ca.crt Jun 03 09:45:15.847167 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.847140 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdl5r\" (UniqueName: \"kubernetes.io/projected/9073f3d7-84c8-49bc-8978-88984a883160-kube-api-access-vdl5r\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.847221 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.847180 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-stats-auth\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.847221 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.847209 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.847336 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:15.847319 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 09:45:15.847403 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:15.847393 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:16.347374315 +0000 UTC m=+130.346445171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : secret "router-metrics-certs-default" not found Jun 03 09:45:15.849320 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.849298 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-default-certificate\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.849417 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.849393 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-stats-auth\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.858454 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.858435 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdl5r\" (UniqueName: \"kubernetes.io/projected/9073f3d7-84c8-49bc-8978-88984a883160-kube-api-access-vdl5r\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:15.884889 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:15.884873 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:16.004458 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:16.004380 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-p45xv"] Jun 03 09:45:16.008651 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:45:16.008621 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0897e30c_0823_4e83_bf4a_68703d4a5572.slice/crio-8fd0f2c82c2655c63099320ba2545b3e984e4d002584c83e421447c3feb22a7e WatchSource:0}: Error finding container 8fd0f2c82c2655c63099320ba2545b3e984e4d002584c83e421447c3feb22a7e: Status 404 returned error can't find the container with id 8fd0f2c82c2655c63099320ba2545b3e984e4d002584c83e421447c3feb22a7e Jun 03 09:45:16.150218 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:16.150184 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:16.150408 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.150353 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 09:45:16.150408 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.150375 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-db467c9c-84rmz: secret "image-registry-tls" not found Jun 03 09:45:16.150518 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.150441 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls podName:e608bbe1-ae9a-4e06-9125-a2cdf524dbf2 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:17.150421329 +0000 UTC m=+131.149492169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls") pod "image-registry-db467c9c-84rmz" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2") : secret "image-registry-tls" not found Jun 03 09:45:16.250728 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:16.250694 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:16.250885 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:16.250737 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:45:16.250885 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.250841 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:16.250951 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.250898 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls podName:63ea905b-6bb0-4117-a6f1-95928b3a59d7 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:17.250881374 +0000 UTC m=+131.249952212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gbdcm" (UID: "63ea905b-6bb0-4117-a6f1-95928b3a59d7") : secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:16.250951 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.250845 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 09:45:16.251022 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.250959 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs podName:a9a4d589-d1bc-4604-affa-2aa626fc7021 nodeName:}" failed. No retries permitted until 2026-06-03 09:47:18.250948254 +0000 UTC m=+252.250019093 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs") pod "network-metrics-daemon-l29jq" (UID: "a9a4d589-d1bc-4604-affa-2aa626fc7021") : secret "metrics-daemon-secret" not found Jun 03 09:45:16.351701 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:16.351627 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:16.351701 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:16.351680 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:16.351866 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.351744 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 09:45:16.351866 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.351786 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:17.351772404 +0000 UTC m=+131.350843242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : configmap references non-existent config key: service-ca.crt Jun 03 09:45:16.351866 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:16.351800 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:17.351793967 +0000 UTC m=+131.350864804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : secret "router-metrics-certs-default" not found Jun 03 09:45:16.917822 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:16.917788 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" event={"ID":"0897e30c-0823-4e83-bf4a-68703d4a5572","Type":"ContainerStarted","Data":"8fd0f2c82c2655c63099320ba2545b3e984e4d002584c83e421447c3feb22a7e"} Jun 03 09:45:17.158420 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:17.158380 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:17.158588 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:17.158496 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 09:45:17.158588 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:17.158513 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-db467c9c-84rmz: secret "image-registry-tls" not found Jun 03 09:45:17.158588 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:17.158566 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls podName:e608bbe1-ae9a-4e06-9125-a2cdf524dbf2 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:19.158551619 +0000 UTC m=+133.157622457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls") pod "image-registry-db467c9c-84rmz" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2") : secret "image-registry-tls" not found Jun 03 09:45:17.258910 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:17.258878 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:17.259060 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:17.259013 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:17.259108 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:17.259075 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls podName:63ea905b-6bb0-4117-a6f1-95928b3a59d7 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:19.259059123 +0000 UTC m=+133.258129961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gbdcm" (UID: "63ea905b-6bb0-4117-a6f1-95928b3a59d7") : secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:17.360314 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:17.360281 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:17.360450 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:17.360379 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:17.360511 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:17.360443 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:19.3604186 +0000 UTC m=+133.359489452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : configmap references non-existent config key: service-ca.crt Jun 03 09:45:17.360511 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:17.360496 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 09:45:17.360582 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:17.360552 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:19.36053541 +0000 UTC m=+133.359606256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : secret "router-metrics-certs-default" not found Jun 03 09:45:18.923051 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:18.922964 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/0.log" Jun 03 09:45:18.923051 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:18.923012 2581 generic.go:358] "Generic (PLEG): container finished" podID="0897e30c-0823-4e83-bf4a-68703d4a5572" containerID="001044b7115eafc387cf5183ffd243d7025b613e2a5e94cabf6e9a93e3171795" exitCode=255 Jun 03 09:45:18.923506 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:18.923070 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" event={"ID":"0897e30c-0823-4e83-bf4a-68703d4a5572","Type":"ContainerDied","Data":"001044b7115eafc387cf5183ffd243d7025b613e2a5e94cabf6e9a93e3171795"} Jun 03 09:45:18.923506 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:18.923278 2581 scope.go:117] "RemoveContainer" containerID="001044b7115eafc387cf5183ffd243d7025b613e2a5e94cabf6e9a93e3171795" Jun 03 09:45:19.175932 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.175844 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:19.176055 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:19.175961 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 09:45:19.176055 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:19.175973 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-db467c9c-84rmz: secret "image-registry-tls" not found Jun 03 09:45:19.176055 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:19.176024 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls podName:e608bbe1-ae9a-4e06-9125-a2cdf524dbf2 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:23.176006755 +0000 UTC m=+137.175077613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls") pod "image-registry-db467c9c-84rmz" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2") : secret "image-registry-tls" not found Jun 03 09:45:19.276270 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.276231 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:19.276387 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:19.276370 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:19.276443 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:19.276434 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls podName:63ea905b-6bb0-4117-a6f1-95928b3a59d7 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:23.276416983 +0000 UTC m=+137.275487823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gbdcm" (UID: "63ea905b-6bb0-4117-a6f1-95928b3a59d7") : secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:19.377539 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.377509 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:19.377651 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.377634 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:19.377709 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:19.377695 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:23.37767687 +0000 UTC m=+137.376747728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : configmap references non-existent config key: service-ca.crt Jun 03 09:45:19.377767 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:19.377728 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 09:45:19.377767 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:19.377762 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:23.377751192 +0000 UTC m=+137.376822032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : secret "router-metrics-certs-default" not found Jun 03 09:45:19.926709 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.926681 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/1.log" Jun 03 09:45:19.927132 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.927065 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/0.log" Jun 03 09:45:19.927132 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.927097 2581 generic.go:358] "Generic (PLEG): container finished" podID="0897e30c-0823-4e83-bf4a-68703d4a5572" containerID="80c1651921d527ca13819f4aa3ba3d6853c9bc389be47cf92a534c17ae013e22" exitCode=255 Jun 03 09:45:19.927238 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.927127 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" event={"ID":"0897e30c-0823-4e83-bf4a-68703d4a5572","Type":"ContainerDied","Data":"80c1651921d527ca13819f4aa3ba3d6853c9bc389be47cf92a534c17ae013e22"} Jun 03 09:45:19.927238 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.927178 2581 scope.go:117] "RemoveContainer" containerID="001044b7115eafc387cf5183ffd243d7025b613e2a5e94cabf6e9a93e3171795" Jun 03 09:45:19.927470 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:19.927436 2581 scope.go:117] "RemoveContainer" containerID="80c1651921d527ca13819f4aa3ba3d6853c9bc389be47cf92a534c17ae013e22" Jun 03 09:45:19.927662 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:19.927643 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-p45xv_openshift-console-operator(0897e30c-0823-4e83-bf4a-68703d4a5572)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" podUID="0897e30c-0823-4e83-bf4a-68703d4a5572" Jun 03 09:45:20.929884 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:20.929851 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/1.log" Jun 03 09:45:20.930248 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:20.930167 2581 scope.go:117] "RemoveContainer" containerID="80c1651921d527ca13819f4aa3ba3d6853c9bc389be47cf92a534c17ae013e22" Jun 03 09:45:20.930342 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:20.930324 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-p45xv_openshift-console-operator(0897e30c-0823-4e83-bf4a-68703d4a5572)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" podUID="0897e30c-0823-4e83-bf4a-68703d4a5572" Jun 03 09:45:22.164264 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:22.164235 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctb7x_ed18ee14-518a-4d42-b151-62c672753c42/dns-node-resolver/0.log" Jun 03 09:45:22.951423 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:22.951397 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b525w_ced04495-5f40-4e7d-ae5c-53efaeeec70f/node-ca/0.log" Jun 03 09:45:23.207348 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:23.207256 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:23.207784 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:23.207358 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 09:45:23.207784 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:23.207369 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-db467c9c-84rmz: secret "image-registry-tls" not found Jun 03 09:45:23.207784 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:23.207415 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls podName:e608bbe1-ae9a-4e06-9125-a2cdf524dbf2 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:31.207401915 +0000 UTC m=+145.206472754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls") pod "image-registry-db467c9c-84rmz" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2") : secret "image-registry-tls" not found Jun 03 09:45:23.307912 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:23.307868 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:23.308052 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:23.308024 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:23.308094 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:23.308087 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls podName:63ea905b-6bb0-4117-a6f1-95928b3a59d7 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:31.308071892 +0000 UTC m=+145.307142729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gbdcm" (UID: "63ea905b-6bb0-4117-a6f1-95928b3a59d7") : secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:23.408923 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:23.408896 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:23.409054 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:23.408963 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:23.409117 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:23.409050 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 09:45:23.409117 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:23.409066 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:31.40904574 +0000 UTC m=+145.408116595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : configmap references non-existent config key: service-ca.crt Jun 03 09:45:23.409117 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:23.409092 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs podName:9073f3d7-84c8-49bc-8978-88984a883160 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:31.409081096 +0000 UTC m=+145.408151934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs") pod "router-default-54958dc7b5-snw5r" (UID: "9073f3d7-84c8-49bc-8978-88984a883160") : secret "router-metrics-certs-default" not found Jun 03 09:45:25.885687 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:25.885659 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:25.885687 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:25.885692 2581 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:25.886083 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:25.886021 2581 scope.go:117] "RemoveContainer" containerID="80c1651921d527ca13819f4aa3ba3d6853c9bc389be47cf92a534c17ae013e22" Jun 03 09:45:25.886185 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:25.886169 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-p45xv_openshift-console-operator(0897e30c-0823-4e83-bf4a-68703d4a5572)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" podUID="0897e30c-0823-4e83-bf4a-68703d4a5572" Jun 03 09:45:31.268712 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.268661 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:31.271140 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.271121 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") pod \"image-registry-db467c9c-84rmz\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:31.369272 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.369222 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:31.369424 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:31.369383 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:31.369460 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:31.369448 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls podName:63ea905b-6bb0-4117-a6f1-95928b3a59d7 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:47.369433741 +0000 UTC m=+161.368504580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gbdcm" (UID: "63ea905b-6bb0-4117-a6f1-95928b3a59d7") : secret "cluster-monitoring-operator-tls" not found Jun 03 09:45:31.378776 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.378755 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:31.470616 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.470568 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:31.470761 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.470655 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:31.471272 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.471249 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9073f3d7-84c8-49bc-8978-88984a883160-service-ca-bundle\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:31.473005 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.472987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9073f3d7-84c8-49bc-8978-88984a883160-metrics-certs\") pod \"router-default-54958dc7b5-snw5r\" (UID: \"9073f3d7-84c8-49bc-8978-88984a883160\") " pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:31.505961 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.505936 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-db467c9c-84rmz"] Jun 03 09:45:31.509076 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:45:31.509052 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode608bbe1_ae9a_4e06_9125_a2cdf524dbf2.slice/crio-bfdd30f72160794f97f2a3a23ce960af4ae31a9ec2f01500a6da34fd6e9559b6 WatchSource:0}: Error finding container bfdd30f72160794f97f2a3a23ce960af4ae31a9ec2f01500a6da34fd6e9559b6: Status 404 returned error can't find the container with id bfdd30f72160794f97f2a3a23ce960af4ae31a9ec2f01500a6da34fd6e9559b6 Jun 03 09:45:31.565641 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.565621 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:31.699435 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.699396 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54958dc7b5-snw5r"] Jun 03 09:45:31.702993 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:45:31.702963 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9073f3d7_84c8_49bc_8978_88984a883160.slice/crio-4453ffabb774592c73b83a3c681f074ced32f9c6935bb563f37570a9183476a2 WatchSource:0}: Error finding container 4453ffabb774592c73b83a3c681f074ced32f9c6935bb563f37570a9183476a2: Status 404 returned error can't find the container with id 4453ffabb774592c73b83a3c681f074ced32f9c6935bb563f37570a9183476a2 Jun 03 09:45:31.952981 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.952908 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54958dc7b5-snw5r" event={"ID":"9073f3d7-84c8-49bc-8978-88984a883160","Type":"ContainerStarted","Data":"f8ff3ec79c0775b623d06ead3905eeafd359fcbf9b5c7a148c3973604c1e76bc"} Jun 03 09:45:31.952981 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.952945 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54958dc7b5-snw5r" event={"ID":"9073f3d7-84c8-49bc-8978-88984a883160","Type":"ContainerStarted","Data":"4453ffabb774592c73b83a3c681f074ced32f9c6935bb563f37570a9183476a2"} Jun 03 09:45:31.954390 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.954366 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db467c9c-84rmz" event={"ID":"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2","Type":"ContainerStarted","Data":"1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b"} Jun 03 09:45:31.954501 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.954399 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db467c9c-84rmz" event={"ID":"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2","Type":"ContainerStarted","Data":"bfdd30f72160794f97f2a3a23ce960af4ae31a9ec2f01500a6da34fd6e9559b6"} Jun 03 09:45:31.954501 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.954488 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:31.976859 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.976820 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-54958dc7b5-snw5r" podStartSLOduration=16.976806782 podStartE2EDuration="16.976806782s" podCreationTimestamp="2026-06-03 09:45:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:45:31.976022438 +0000 UTC m=+145.975093301" watchObservedRunningTime="2026-06-03 09:45:31.976806782 +0000 UTC m=+145.975877641" Jun 03 09:45:31.994945 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:31.994905 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-db467c9c-84rmz" podStartSLOduration=16.994892087 podStartE2EDuration="16.994892087s" podCreationTimestamp="2026-06-03 09:45:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:45:31.994323482 +0000 UTC m=+145.993394348" watchObservedRunningTime="2026-06-03 09:45:31.994892087 +0000 UTC m=+145.993962946" Jun 03 09:45:32.566182 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:32.566147 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:32.568742 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:32.568721 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:32.957211 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:32.957120 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:32.958154 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:32.958134 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54958dc7b5-snw5r" Jun 03 09:45:41.585133 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:41.585096 2581 scope.go:117] "RemoveContainer" containerID="80c1651921d527ca13819f4aa3ba3d6853c9bc389be47cf92a534c17ae013e22" Jun 03 09:45:41.976326 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:41.976249 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/2.log" Jun 03 09:45:41.976642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:41.976627 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/1.log" Jun 03 09:45:41.976693 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:41.976660 2581 generic.go:358] "Generic (PLEG): container finished" podID="0897e30c-0823-4e83-bf4a-68703d4a5572" containerID="01b2c9315835345ec972227943cef251dac6a145e6b8c452e14ee80dda384a16" exitCode=255 Jun 03 09:45:41.976693 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:41.976685 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" event={"ID":"0897e30c-0823-4e83-bf4a-68703d4a5572","Type":"ContainerDied","Data":"01b2c9315835345ec972227943cef251dac6a145e6b8c452e14ee80dda384a16"} Jun 03 09:45:41.976765 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:41.976713 2581 scope.go:117] "RemoveContainer" containerID="80c1651921d527ca13819f4aa3ba3d6853c9bc389be47cf92a534c17ae013e22" Jun 03 09:45:41.977033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:41.977009 2581 scope.go:117] "RemoveContainer" containerID="01b2c9315835345ec972227943cef251dac6a145e6b8c452e14ee80dda384a16" Jun 03 09:45:41.977221 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:41.977203 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-p45xv_openshift-console-operator(0897e30c-0823-4e83-bf4a-68703d4a5572)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" podUID="0897e30c-0823-4e83-bf4a-68703d4a5572" Jun 03 09:45:42.980086 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:42.980057 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/2.log" Jun 03 09:45:43.395277 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:43.395243 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dfnlh" podUID="d304bac2-71de-4ae7-8340-db864e1e203f" Jun 03 09:45:43.406392 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:43.406357 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-x96pk" podUID="934562dd-9ed1-4387-9055-cb8b3e14aefc" Jun 03 09:45:43.597645 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:43.597611 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l29jq" podUID="a9a4d589-d1bc-4604-affa-2aa626fc7021" Jun 03 09:45:43.982114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:43.982049 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dfnlh" Jun 03 09:45:45.885176 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:45.885141 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:45.885176 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:45.885182 2581 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:45:45.885582 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:45.885489 2581 scope.go:117] "RemoveContainer" containerID="01b2c9315835345ec972227943cef251dac6a145e6b8c452e14ee80dda384a16" Jun 03 09:45:45.885687 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:45.885668 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-p45xv_openshift-console-operator(0897e30c-0823-4e83-bf4a-68703d4a5572)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" podUID="0897e30c-0823-4e83-bf4a-68703d4a5572" Jun 03 09:45:46.071237 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.071205 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-db467c9c-84rmz"] Jun 03 09:45:46.076616 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.076562 2581 patch_prober.go:28] interesting pod/image-registry-db467c9c-84rmz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 09:45:46.076745 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.076634 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-db467c9c-84rmz" podUID="e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 09:45:46.116024 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.115994 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b5dfc9945-w65p7"] Jun 03 09:45:46.118830 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.118815 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.132774 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.132743 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5dfc9945-w65p7"] Jun 03 09:45:46.230565 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.230540 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wv4z6"] Jun 03 09:45:46.233441 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.233424 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.236843 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.236801 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 09:45:46.236949 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.236855 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 09:45:46.236949 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.236914 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4xt2x\"" Jun 03 09:45:46.236949 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.236935 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 09:45:46.237384 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.237367 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 09:45:46.252877 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.252857 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wv4z6"] Jun 03 09:45:46.284938 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.284916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-bound-sa-token\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.285035 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.284953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-image-registry-private-configuration\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.285035 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.284985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-ca-trust-extracted\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.285035 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.285023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-installation-pull-secrets\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.285132 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.285093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-registry-tls\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.285164 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.285136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-registry-certificates\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.285196 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.285182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-trusted-ca\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.285233 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.285219 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqq26\" (UniqueName: \"kubernetes.io/projected/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-kube-api-access-tqq26\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.386249 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e034fd-70df-48c1-afcb-16a0dd85b730-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.386396 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386274 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-bound-sa-token\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.386396 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386298 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-image-registry-private-configuration\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.386396 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386339 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-ca-trust-extracted\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.386396 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386364 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-installation-pull-secrets\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.386396 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386389 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-registry-tls\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.386781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47e034fd-70df-48c1-afcb-16a0dd85b730-crio-socket\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.386781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e034fd-70df-48c1-afcb-16a0dd85b730-data-volume\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.386781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386520 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-registry-certificates\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.386781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386567 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-trusted-ca\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.386781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386624 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqq26\" (UniqueName: \"kubernetes.io/projected/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-kube-api-access-tqq26\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.386781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e034fd-70df-48c1-afcb-16a0dd85b730-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.386781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hgrx\" (UniqueName: \"kubernetes.io/projected/47e034fd-70df-48c1-afcb-16a0dd85b730-kube-api-access-8hgrx\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.387383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.386968 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-ca-trust-extracted\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.387771 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.387747 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-registry-certificates\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.387873 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.387769 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-trusted-ca\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.389051 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.389028 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-image-registry-private-configuration\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.389128 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.389064 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-registry-tls\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.389292 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.389274 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-installation-pull-secrets\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.395377 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.395350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqq26\" (UniqueName: \"kubernetes.io/projected/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-kube-api-access-tqq26\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.395458 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.395443 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c440a1ee-9fcb-416c-a423-5df6dacaf1e6-bound-sa-token\") pod \"image-registry-b5dfc9945-w65p7\" (UID: \"c440a1ee-9fcb-416c-a423-5df6dacaf1e6\") " pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.426308 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.426243 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:46.488037 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.487354 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47e034fd-70df-48c1-afcb-16a0dd85b730-crio-socket\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.488037 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.487400 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e034fd-70df-48c1-afcb-16a0dd85b730-data-volume\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.488037 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.487462 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e034fd-70df-48c1-afcb-16a0dd85b730-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.488037 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.487458 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47e034fd-70df-48c1-afcb-16a0dd85b730-crio-socket\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.488037 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.487526 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hgrx\" (UniqueName: \"kubernetes.io/projected/47e034fd-70df-48c1-afcb-16a0dd85b730-kube-api-access-8hgrx\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.488037 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.487569 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e034fd-70df-48c1-afcb-16a0dd85b730-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.488037 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.487742 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e034fd-70df-48c1-afcb-16a0dd85b730-data-volume\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.488037 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.487948 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e034fd-70df-48c1-afcb-16a0dd85b730-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.490103 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.490079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e034fd-70df-48c1-afcb-16a0dd85b730-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.508496 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.508473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hgrx\" (UniqueName: \"kubernetes.io/projected/47e034fd-70df-48c1-afcb-16a0dd85b730-kube-api-access-8hgrx\") pod \"insights-runtime-extractor-wv4z6\" (UID: \"47e034fd-70df-48c1-afcb-16a0dd85b730\") " pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.541981 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.541952 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wv4z6" Jun 03 09:45:46.553048 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.552987 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5dfc9945-w65p7"] Jun 03 09:45:46.556263 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:45:46.556241 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc440a1ee_9fcb_416c_a423_5df6dacaf1e6.slice/crio-b5aa49c6c32ae63d5196ae86f33bd35d859b438df71b8f489a638eab6365f1a5 WatchSource:0}: Error finding container b5aa49c6c32ae63d5196ae86f33bd35d859b438df71b8f489a638eab6365f1a5: Status 404 returned error can't find the container with id b5aa49c6c32ae63d5196ae86f33bd35d859b438df71b8f489a638eab6365f1a5 Jun 03 09:45:46.673106 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.673072 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wv4z6"] Jun 03 09:45:46.676210 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:45:46.676180 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e034fd_70df_48c1_afcb_16a0dd85b730.slice/crio-3487c6178be1101a24340e9a91264868f039437c103be8a56f3640bccdd4bfb5 WatchSource:0}: Error finding container 3487c6178be1101a24340e9a91264868f039437c103be8a56f3640bccdd4bfb5: Status 404 returned error can't find the container with id 3487c6178be1101a24340e9a91264868f039437c103be8a56f3640bccdd4bfb5 Jun 03 09:45:46.994559 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.994479 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wv4z6" event={"ID":"47e034fd-70df-48c1-afcb-16a0dd85b730","Type":"ContainerStarted","Data":"1aaa01ef750c20a9846dfa364e6786ede8fbd661d28174563535574fed4defde"} Jun 03 09:45:46.994559 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.994526 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wv4z6" event={"ID":"47e034fd-70df-48c1-afcb-16a0dd85b730","Type":"ContainerStarted","Data":"3487c6178be1101a24340e9a91264868f039437c103be8a56f3640bccdd4bfb5"} Jun 03 09:45:46.995748 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.995718 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" event={"ID":"c440a1ee-9fcb-416c-a423-5df6dacaf1e6","Type":"ContainerStarted","Data":"7968eb6f62f6c8c43a7051e01b6c0323e976dee1568cc79f82eb9366f89f4259"} Jun 03 09:45:46.995748 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.995747 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" event={"ID":"c440a1ee-9fcb-416c-a423-5df6dacaf1e6","Type":"ContainerStarted","Data":"b5aa49c6c32ae63d5196ae86f33bd35d859b438df71b8f489a638eab6365f1a5"} Jun 03 09:45:46.995853 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:46.995838 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:45:47.015905 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:47.015864 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" podStartSLOduration=1.015850885 podStartE2EDuration="1.015850885s" podCreationTimestamp="2026-06-03 09:45:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:45:47.015275246 +0000 UTC m=+161.014346121" watchObservedRunningTime="2026-06-03 09:45:47.015850885 +0000 UTC m=+161.014921744" Jun 03 09:45:47.395642 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:47.395550 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:47.398370 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:47.398341 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63ea905b-6bb0-4117-a6f1-95928b3a59d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gbdcm\" (UID: \"63ea905b-6bb0-4117-a6f1-95928b3a59d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:47.678330 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:47.678279 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" Jun 03 09:45:47.803497 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:47.803464 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm"] Jun 03 09:45:47.806752 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:45:47.806724 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ea905b_6bb0_4117_a6f1_95928b3a59d7.slice/crio-16a060f2c0b4f45ed4f2d0980a2c76430826acec155a4abbe6474fd593247689 WatchSource:0}: Error finding container 16a060f2c0b4f45ed4f2d0980a2c76430826acec155a4abbe6474fd593247689: Status 404 returned error can't find the container with id 16a060f2c0b4f45ed4f2d0980a2c76430826acec155a4abbe6474fd593247689 Jun 03 09:45:47.999677 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:47.999641 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wv4z6" event={"ID":"47e034fd-70df-48c1-afcb-16a0dd85b730","Type":"ContainerStarted","Data":"d529ff51393dfe3eaa486d3a0c45341c97030cf4db00a41cd43d6bea08b0f6c2"} Jun 03 09:45:48.000607 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:48.000564 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" event={"ID":"63ea905b-6bb0-4117-a6f1-95928b3a59d7","Type":"ContainerStarted","Data":"16a060f2c0b4f45ed4f2d0980a2c76430826acec155a4abbe6474fd593247689"} Jun 03 09:45:48.303360 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:48.303275 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:45:48.303360 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:48.303333 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:45:48.306106 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:48.306082 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d304bac2-71de-4ae7-8340-db864e1e203f-metrics-tls\") pod \"dns-default-dfnlh\" (UID: \"d304bac2-71de-4ae7-8340-db864e1e203f\") " pod="openshift-dns/dns-default-dfnlh" Jun 03 09:45:48.306235 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:48.306089 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/934562dd-9ed1-4387-9055-cb8b3e14aefc-cert\") pod \"ingress-canary-x96pk\" (UID: \"934562dd-9ed1-4387-9055-cb8b3e14aefc\") " pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:45:48.485788 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:48.485755 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jmbp6\"" Jun 03 09:45:48.493915 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:48.493893 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dfnlh" Jun 03 09:45:48.639162 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:48.639131 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dfnlh"] Jun 03 09:45:49.128399 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:45:49.128369 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd304bac2_71de_4ae7_8340_db864e1e203f.slice/crio-23add24243e9adf0554d587b9c0ae7f7275fffc9fe3793d2ad8ed7bd98f51627 WatchSource:0}: Error finding container 23add24243e9adf0554d587b9c0ae7f7275fffc9fe3793d2ad8ed7bd98f51627: Status 404 returned error can't find the container with id 23add24243e9adf0554d587b9c0ae7f7275fffc9fe3793d2ad8ed7bd98f51627 Jun 03 09:45:50.009434 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:50.009384 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wv4z6" event={"ID":"47e034fd-70df-48c1-afcb-16a0dd85b730","Type":"ContainerStarted","Data":"2e8428e6621a3320050cdd89d38f795aa41dbfc262f1e155574f3e9aff7ac704"} Jun 03 09:45:50.011269 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:50.011241 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" event={"ID":"63ea905b-6bb0-4117-a6f1-95928b3a59d7","Type":"ContainerStarted","Data":"83d7f72e8d77bfbffcf0efb2c1616387d0a5ee37b31d76334bab5b1022e628e5"} Jun 03 09:45:50.012475 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:50.012453 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dfnlh" event={"ID":"d304bac2-71de-4ae7-8340-db864e1e203f","Type":"ContainerStarted","Data":"23add24243e9adf0554d587b9c0ae7f7275fffc9fe3793d2ad8ed7bd98f51627"} Jun 03 09:45:50.077643 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:50.077575 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wv4z6" podStartSLOduration=1.643734292 podStartE2EDuration="4.077561622s" podCreationTimestamp="2026-06-03 09:45:46 +0000 UTC" firstStartedPulling="2026-06-03 09:45:46.740062779 +0000 UTC m=+160.739133621" lastFinishedPulling="2026-06-03 09:45:49.173890111 +0000 UTC m=+163.172960951" observedRunningTime="2026-06-03 09:45:50.048772512 +0000 UTC m=+164.047843371" watchObservedRunningTime="2026-06-03 09:45:50.077561622 +0000 UTC m=+164.076632482" Jun 03 09:45:51.016957 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:51.016888 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dfnlh" event={"ID":"d304bac2-71de-4ae7-8340-db864e1e203f","Type":"ContainerStarted","Data":"ab11e49a0a4f733f925831c70869a99ddc40441af991d5728337c683f33985fc"} Jun 03 09:45:51.016957 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:51.016926 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dfnlh" event={"ID":"d304bac2-71de-4ae7-8340-db864e1e203f","Type":"ContainerStarted","Data":"acf3306c0b10ed990b61d5ae1d06f4df2efe24d84643abfca8c0b87694dd5f71"} Jun 03 09:45:51.036094 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:51.036022 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gbdcm" podStartSLOduration=34.132371468 podStartE2EDuration="36.036007262s" podCreationTimestamp="2026-06-03 09:45:15 +0000 UTC" firstStartedPulling="2026-06-03 09:45:47.808490164 +0000 UTC m=+161.807561002" lastFinishedPulling="2026-06-03 09:45:49.712125957 +0000 UTC m=+163.711196796" observedRunningTime="2026-06-03 09:45:50.077468383 +0000 UTC m=+164.076539242" watchObservedRunningTime="2026-06-03 09:45:51.036007262 +0000 UTC m=+165.035078123" Jun 03 09:45:51.036751 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:51.036725 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-dfnlh" podStartSLOduration=129.408057715 podStartE2EDuration="2m11.036715093s" podCreationTimestamp="2026-06-03 09:43:40 +0000 UTC" firstStartedPulling="2026-06-03 09:45:49.130489479 +0000 UTC m=+163.129560321" lastFinishedPulling="2026-06-03 09:45:50.759146861 +0000 UTC m=+164.758217699" observedRunningTime="2026-06-03 09:45:51.035747539 +0000 UTC m=+165.034818401" watchObservedRunningTime="2026-06-03 09:45:51.036715093 +0000 UTC m=+165.035785953" Jun 03 09:45:52.019418 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:52.019376 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dfnlh" Jun 03 09:45:54.585245 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:54.585202 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:45:56.075295 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:56.075265 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:45:58.585366 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.585331 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:45:58.588029 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.588005 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wwwqd\"" Jun 03 09:45:58.596203 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.596186 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x96pk" Jun 03 09:45:58.738532 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.738502 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x96pk"] Jun 03 09:45:58.739587 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.739529 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q4sx8"] Jun 03 09:45:58.741565 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:45:58.741527 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934562dd_9ed1_4387_9055_cb8b3e14aefc.slice/crio-3eea6c1b5dc856339a4dbede025e5e68533234ed5fa246dbcb63a8d636b278fa WatchSource:0}: Error finding container 3eea6c1b5dc856339a4dbede025e5e68533234ed5fa246dbcb63a8d636b278fa: Status 404 returned error can't find the container with id 3eea6c1b5dc856339a4dbede025e5e68533234ed5fa246dbcb63a8d636b278fa Jun 03 09:45:58.744254 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.744211 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.752846 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.752798 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 09:45:58.753036 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.753014 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fmskq\"" Jun 03 09:45:58.753226 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.753209 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 09:45:58.753641 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.753625 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 09:45:58.753708 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.753665 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 09:45:58.778829 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.778807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-textfile\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.778944 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.778843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.778992 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.778939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-tls\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.779034 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.779021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b68e8542-aae3-434e-82d9-2c5c4d90d475-root\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.779089 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.779075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b68e8542-aae3-434e-82d9-2c5c4d90d475-sys\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.779126 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.779102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b68e8542-aae3-434e-82d9-2c5c4d90d475-metrics-client-ca\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.779181 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.779125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr96s\" (UniqueName: \"kubernetes.io/projected/b68e8542-aae3-434e-82d9-2c5c4d90d475-kube-api-access-tr96s\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.779284 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.779208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-wtmp\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.779284 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.779240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-accelerators-collector-config\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.879795 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.879708 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b68e8542-aae3-434e-82d9-2c5c4d90d475-root\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.879795 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.879764 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b68e8542-aae3-434e-82d9-2c5c4d90d475-sys\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.879795 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.879789 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b68e8542-aae3-434e-82d9-2c5c4d90d475-metrics-client-ca\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.879814 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tr96s\" (UniqueName: \"kubernetes.io/projected/b68e8542-aae3-434e-82d9-2c5c4d90d475-kube-api-access-tr96s\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.879762 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b68e8542-aae3-434e-82d9-2c5c4d90d475-root\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.879857 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b68e8542-aae3-434e-82d9-2c5c4d90d475-sys\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.879941 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-wtmp\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.879971 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-accelerators-collector-config\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.880030 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-textfile\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880316 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.880034 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-wtmp\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880316 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.880056 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880316 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.880146 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-tls\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880316 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:58.880260 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 09:45:58.880511 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:45:58.880325 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-tls podName:b68e8542-aae3-434e-82d9-2c5c4d90d475 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:59.380307696 +0000 UTC m=+173.379378535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-tls") pod "node-exporter-q4sx8" (UID: "b68e8542-aae3-434e-82d9-2c5c4d90d475") : secret "node-exporter-tls" not found Jun 03 09:45:58.880511 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.880371 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-textfile\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880511 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.880406 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b68e8542-aae3-434e-82d9-2c5c4d90d475-metrics-client-ca\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.880511 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.880468 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-accelerators-collector-config\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.882526 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.882506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:58.901946 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:58.901919 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr96s\" (UniqueName: \"kubernetes.io/projected/b68e8542-aae3-434e-82d9-2c5c4d90d475-kube-api-access-tr96s\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:59.036325 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:59.036290 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x96pk" event={"ID":"934562dd-9ed1-4387-9055-cb8b3e14aefc","Type":"ContainerStarted","Data":"3eea6c1b5dc856339a4dbede025e5e68533234ed5fa246dbcb63a8d636b278fa"} Jun 03 09:45:59.385320 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:59.385278 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-tls\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:59.388006 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:59.387980 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b68e8542-aae3-434e-82d9-2c5c4d90d475-node-exporter-tls\") pod \"node-exporter-q4sx8\" (UID: \"b68e8542-aae3-434e-82d9-2c5c4d90d475\") " pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:59.655851 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:45:59.655755 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q4sx8" Jun 03 09:45:59.668181 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:45:59.668152 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68e8542_aae3_434e_82d9_2c5c4d90d475.slice/crio-f5ae8e19a52fe99c56ec8cde44fc836ba9c063962ee61f99dc384a204d844eba WatchSource:0}: Error finding container f5ae8e19a52fe99c56ec8cde44fc836ba9c063962ee61f99dc384a204d844eba: Status 404 returned error can't find the container with id f5ae8e19a52fe99c56ec8cde44fc836ba9c063962ee61f99dc384a204d844eba Jun 03 09:46:00.039613 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:00.039558 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4sx8" event={"ID":"b68e8542-aae3-434e-82d9-2c5c4d90d475","Type":"ContainerStarted","Data":"f5ae8e19a52fe99c56ec8cde44fc836ba9c063962ee61f99dc384a204d844eba"} Jun 03 09:46:00.586134 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:00.586067 2581 scope.go:117] "RemoveContainer" containerID="01b2c9315835345ec972227943cef251dac6a145e6b8c452e14ee80dda384a16" Jun 03 09:46:00.586326 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:46:00.586270 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-p45xv_openshift-console-operator(0897e30c-0823-4e83-bf4a-68703d4a5572)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" podUID="0897e30c-0823-4e83-bf4a-68703d4a5572" Jun 03 09:46:01.043789 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:01.043757 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x96pk" event={"ID":"934562dd-9ed1-4387-9055-cb8b3e14aefc","Type":"ContainerStarted","Data":"e4f8cd0eb5383adf4d6adf4f3b3a60b05e684c060fe69bb06ed062b5355e751d"} Jun 03 09:46:01.045140 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:01.045115 2581 generic.go:358] "Generic (PLEG): container finished" podID="b68e8542-aae3-434e-82d9-2c5c4d90d475" containerID="cf313b380e8766c7b7654d8f3a30e2369d62e2d833f3fb4bcde844ad7e16619a" exitCode=0 Jun 03 09:46:01.045236 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:01.045200 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4sx8" event={"ID":"b68e8542-aae3-434e-82d9-2c5c4d90d475","Type":"ContainerDied","Data":"cf313b380e8766c7b7654d8f3a30e2369d62e2d833f3fb4bcde844ad7e16619a"} Jun 03 09:46:01.061078 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:01.061039 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x96pk" podStartSLOduration=139.555498121 podStartE2EDuration="2m21.061026622s" podCreationTimestamp="2026-06-03 09:43:40 +0000 UTC" firstStartedPulling="2026-06-03 09:45:58.74344449 +0000 UTC m=+172.742515328" lastFinishedPulling="2026-06-03 09:46:00.248972979 +0000 UTC m=+174.248043829" observedRunningTime="2026-06-03 09:46:01.05999196 +0000 UTC m=+175.059062820" watchObservedRunningTime="2026-06-03 09:46:01.061026622 +0000 UTC m=+175.060097479" Jun 03 09:46:02.023387 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:02.023356 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dfnlh" Jun 03 09:46:02.049665 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:02.049623 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4sx8" event={"ID":"b68e8542-aae3-434e-82d9-2c5c4d90d475","Type":"ContainerStarted","Data":"b23f7ec789cb5e7a9fe54265b29606128ec2bbba49d2abae3dd5581932689f49"} Jun 03 09:46:02.050133 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:02.049667 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4sx8" event={"ID":"b68e8542-aae3-434e-82d9-2c5c4d90d475","Type":"ContainerStarted","Data":"dbad85dfe258663abaddb9ca5a18cb48c5c01c0f704f89c6eb4218733f3584a8"} Jun 03 09:46:02.071273 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:02.071215 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q4sx8" podStartSLOduration=2.970449909 podStartE2EDuration="4.071196545s" podCreationTimestamp="2026-06-03 09:45:58 +0000 UTC" firstStartedPulling="2026-06-03 09:45:59.670811447 +0000 UTC m=+173.669882289" lastFinishedPulling="2026-06-03 09:46:00.771558085 +0000 UTC m=+174.770628925" observedRunningTime="2026-06-03 09:46:02.070395448 +0000 UTC m=+176.069466308" watchObservedRunningTime="2026-06-03 09:46:02.071196545 +0000 UTC m=+176.070267408" Jun 03 09:46:03.485080 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:03.485047 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn"] Jun 03 09:46:03.488448 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:03.488430 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" Jun 03 09:46:03.491971 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:03.491946 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 09:46:03.492073 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:03.492054 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-567nl\"" Jun 03 09:46:03.497947 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:03.497925 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn"] Jun 03 09:46:03.517072 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:03.517040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a560ec05-ad68-4046-bb69-1eff9fa94d29-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-gw9fn\" (UID: \"a560ec05-ad68-4046-bb69-1eff9fa94d29\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" Jun 03 09:46:03.618265 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:03.618226 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a560ec05-ad68-4046-bb69-1eff9fa94d29-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-gw9fn\" (UID: \"a560ec05-ad68-4046-bb69-1eff9fa94d29\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" Jun 03 09:46:03.618438 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:46:03.618364 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 09:46:03.618478 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:46:03.618440 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a560ec05-ad68-4046-bb69-1eff9fa94d29-monitoring-plugin-cert podName:a560ec05-ad68-4046-bb69-1eff9fa94d29 nodeName:}" failed. No retries permitted until 2026-06-03 09:46:04.118422745 +0000 UTC m=+178.117493586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a560ec05-ad68-4046-bb69-1eff9fa94d29-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-gw9fn" (UID: "a560ec05-ad68-4046-bb69-1eff9fa94d29") : secret "monitoring-plugin-cert" not found Jun 03 09:46:04.031150 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.031115 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf"] Jun 03 09:46:04.034071 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.034056 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.039254 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.039225 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 09:46:04.039254 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.039225 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 09:46:04.039428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.039315 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 09:46:04.039428 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.039416 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 09:46:04.040432 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.040411 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j8z26\"" Jun 03 09:46:04.041451 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.041424 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 09:46:04.045899 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.045881 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 09:46:04.057924 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.057902 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf"] Jun 03 09:46:04.123173 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.123144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.123315 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.123195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25c696b9-7a4a-44b7-a042-93bca09a7eae-metrics-client-ca\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.123315 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.123242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptlxz\" (UniqueName: \"kubernetes.io/projected/25c696b9-7a4a-44b7-a042-93bca09a7eae-kube-api-access-ptlxz\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.123315 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.123274 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-telemeter-client-tls\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.123315 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.123294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25c696b9-7a4a-44b7-a042-93bca09a7eae-serving-certs-ca-bundle\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.123442 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.123316 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a560ec05-ad68-4046-bb69-1eff9fa94d29-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-gw9fn\" (UID: \"a560ec05-ad68-4046-bb69-1eff9fa94d29\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" Jun 03 09:46:04.123442 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.123384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-federate-client-tls\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.123442 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.123416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-secret-telemeter-client\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.123528 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.123444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25c696b9-7a4a-44b7-a042-93bca09a7eae-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.125970 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.125939 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a560ec05-ad68-4046-bb69-1eff9fa94d29-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-gw9fn\" (UID: \"a560ec05-ad68-4046-bb69-1eff9fa94d29\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" Jun 03 09:46:04.224678 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.224654 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-secret-telemeter-client\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.224798 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.224685 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25c696b9-7a4a-44b7-a042-93bca09a7eae-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.224798 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.224706 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.224798 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.224743 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25c696b9-7a4a-44b7-a042-93bca09a7eae-metrics-client-ca\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.224798 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.224777 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptlxz\" (UniqueName: \"kubernetes.io/projected/25c696b9-7a4a-44b7-a042-93bca09a7eae-kube-api-access-ptlxz\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.225038 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.224821 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-telemeter-client-tls\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.225038 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.224851 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25c696b9-7a4a-44b7-a042-93bca09a7eae-serving-certs-ca-bundle\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.225038 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.224882 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-federate-client-tls\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.225532 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.225504 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25c696b9-7a4a-44b7-a042-93bca09a7eae-metrics-client-ca\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.225692 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.225667 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25c696b9-7a4a-44b7-a042-93bca09a7eae-serving-certs-ca-bundle\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.225856 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.225838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25c696b9-7a4a-44b7-a042-93bca09a7eae-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.227544 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.227518 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-federate-client-tls\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.227637 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.227585 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-telemeter-client-tls\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.227789 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.227766 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.228241 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.228220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/25c696b9-7a4a-44b7-a042-93bca09a7eae-secret-telemeter-client\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.232810 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.232791 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptlxz\" (UniqueName: \"kubernetes.io/projected/25c696b9-7a4a-44b7-a042-93bca09a7eae-kube-api-access-ptlxz\") pod \"telemeter-client-6df7f4ddc9-t8gsf\" (UID: \"25c696b9-7a4a-44b7-a042-93bca09a7eae\") " pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.343396 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.343309 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" Jun 03 09:46:04.396816 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.396790 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" Jun 03 09:46:04.485560 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.485532 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf"] Jun 03 09:46:04.491286 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:46:04.491261 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c696b9_7a4a_44b7_a042_93bca09a7eae.slice/crio-1d9595ee21615f0b7d1a891f4fb292886534a7aa37a290509c82f388d57dd815 WatchSource:0}: Error finding container 1d9595ee21615f0b7d1a891f4fb292886534a7aa37a290509c82f388d57dd815: Status 404 returned error can't find the container with id 1d9595ee21615f0b7d1a891f4fb292886534a7aa37a290509c82f388d57dd815 Jun 03 09:46:04.527231 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:04.527202 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn"] Jun 03 09:46:04.530124 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:46:04.530103 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda560ec05_ad68_4046_bb69_1eff9fa94d29.slice/crio-9a3c381f873fa1bccb23426f799b2c6a69c01e77d494b505092bfb08cb83e264 WatchSource:0}: Error finding container 9a3c381f873fa1bccb23426f799b2c6a69c01e77d494b505092bfb08cb83e264: Status 404 returned error can't find the container with id 9a3c381f873fa1bccb23426f799b2c6a69c01e77d494b505092bfb08cb83e264 Jun 03 09:46:05.008107 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.008075 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 09:46:05.011804 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.011780 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.015716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.015691 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 09:46:05.015835 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.015722 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 09:46:05.016060 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.016042 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 09:46:05.016112 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.016097 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 09:46:05.016158 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.016134 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 09:46:05.016685 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.016664 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 09:46:05.018194 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.017208 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 09:46:05.018194 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.017383 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 09:46:05.018194 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.017499 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 09:46:05.018194 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.017224 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 09:46:05.018194 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.017904 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3st8d4jtvpjrp\"" Jun 03 09:46:05.018465 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.018346 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 09:46:05.019020 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.018999 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mhs26\"" Jun 03 09:46:05.025613 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.025580 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 09:46:05.026614 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.026586 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 09:46:05.032273 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.032255 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 09:46:05.058662 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.058623 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" event={"ID":"a560ec05-ad68-4046-bb69-1eff9fa94d29","Type":"ContainerStarted","Data":"9a3c381f873fa1bccb23426f799b2c6a69c01e77d494b505092bfb08cb83e264"} Jun 03 09:46:05.059906 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.059878 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" event={"ID":"25c696b9-7a4a-44b7-a042-93bca09a7eae","Type":"ContainerStarted","Data":"1d9595ee21615f0b7d1a891f4fb292886534a7aa37a290509c82f388d57dd815"} Jun 03 09:46:05.131819 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.131775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.131979 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.131827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.131979 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.131855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.131979 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.131949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132151 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.131993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132151 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132151 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132151 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zw2\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-kube-api-access-d2zw2\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132151 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132385 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-config\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132385 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132185 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132385 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132385 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132385 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132385 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132385 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132721 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.132721 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.132440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233216 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233170 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233224 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233264 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233294 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233319 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233351 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233395 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233382 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233407 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233452 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233481 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233510 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233530 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233545 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zw2\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-kube-api-access-d2zw2\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233561 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233590 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-config\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233631 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233656 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.233716 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.233704 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.234885 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.234550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.234885 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.234701 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.235697 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.235671 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.236239 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.236431 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.238651 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.238972 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.239110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.239586 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.239940 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.240187 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.242140 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.242421 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.242947 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.243114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.243019 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-config\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.244168 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.243949 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.245125 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.245102 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.251134 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.251095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zw2\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-kube-api-access-d2zw2\") pod \"prometheus-k8s-0\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.324781 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.324695 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:46:05.461687 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:05.461632 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 09:46:05.467087 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:46:05.467052 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45911006_c21d_45bf_bea4_13388929b3ef.slice/crio-18a31a5c760bc98256519346aadc94d7254b31fa744b528869c1ffd8385c1523 WatchSource:0}: Error finding container 18a31a5c760bc98256519346aadc94d7254b31fa744b528869c1ffd8385c1523: Status 404 returned error can't find the container with id 18a31a5c760bc98256519346aadc94d7254b31fa744b528869c1ffd8385c1523 Jun 03 09:46:06.064583 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:06.064536 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" event={"ID":"a560ec05-ad68-4046-bb69-1eff9fa94d29","Type":"ContainerStarted","Data":"b27aa1ccd338d97fa94d1060f65704e9a40d8dc3af54c6120cdb81dd53c9cf91"} Jun 03 09:46:06.065001 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:06.064918 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" Jun 03 09:46:06.065887 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:06.065858 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerStarted","Data":"18a31a5c760bc98256519346aadc94d7254b31fa744b528869c1ffd8385c1523"} Jun 03 09:46:06.071240 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:06.071218 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" Jun 03 09:46:06.082534 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:06.082490 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gw9fn" podStartSLOduration=1.689108932 podStartE2EDuration="3.08247816s" podCreationTimestamp="2026-06-03 09:46:03 +0000 UTC" firstStartedPulling="2026-06-03 09:46:04.531892503 +0000 UTC m=+178.530963341" lastFinishedPulling="2026-06-03 09:46:05.92526172 +0000 UTC m=+179.924332569" observedRunningTime="2026-06-03 09:46:06.081686095 +0000 UTC m=+180.080756956" watchObservedRunningTime="2026-06-03 09:46:06.08247816 +0000 UTC m=+180.081549020" Jun 03 09:46:08.005043 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:08.005016 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b5dfc9945-w65p7" Jun 03 09:46:08.074527 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:08.074488 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" event={"ID":"25c696b9-7a4a-44b7-a042-93bca09a7eae","Type":"ContainerStarted","Data":"b96805c120abc3bc94fa8883ee41f1eb094f1b6cb7606ee18b2e413640649dd1"} Jun 03 09:46:08.074527 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:08.074524 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" event={"ID":"25c696b9-7a4a-44b7-a042-93bca09a7eae","Type":"ContainerStarted","Data":"69cc1a8447cdc78042b72df09ba036b5b9f29ba920cc10d92bb9328e843e51ba"} Jun 03 09:46:08.074749 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:08.074538 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" event={"ID":"25c696b9-7a4a-44b7-a042-93bca09a7eae","Type":"ContainerStarted","Data":"07adcc8bc9f7af5d09883873ba21764e4fdf632dbd96e8678d61f4d761819b3a"} Jun 03 09:46:08.075962 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:08.075936 2581 generic.go:358] "Generic (PLEG): container finished" podID="45911006-c21d-45bf-bea4-13388929b3ef" containerID="d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8" exitCode=0 Jun 03 09:46:08.076084 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:08.076013 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerDied","Data":"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8"} Jun 03 09:46:08.109394 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:08.109341 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6df7f4ddc9-t8gsf" podStartSLOduration=2.587032119 podStartE2EDuration="5.109329562s" podCreationTimestamp="2026-06-03 09:46:03 +0000 UTC" firstStartedPulling="2026-06-03 09:46:04.493701581 +0000 UTC m=+178.492772419" lastFinishedPulling="2026-06-03 09:46:07.015999007 +0000 UTC m=+181.015069862" observedRunningTime="2026-06-03 09:46:08.10786851 +0000 UTC m=+182.106939372" watchObservedRunningTime="2026-06-03 09:46:08.109329562 +0000 UTC m=+182.108400422" Jun 03 09:46:11.095670 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.095610 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-db467c9c-84rmz" podUID="e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" containerName="registry" containerID="cri-o://1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b" gracePeriod=30 Jun 03 09:46:11.331794 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.331765 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:46:11.388027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.387285 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-bound-sa-token\") pod \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " Jun 03 09:46:11.388027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.387353 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") pod \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " Jun 03 09:46:11.388027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.387384 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-installation-pull-secrets\") pod \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " Jun 03 09:46:11.388027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.387434 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-image-registry-private-configuration\") pod \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " Jun 03 09:46:11.388027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.387487 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-certificates\") pod \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " Jun 03 09:46:11.388027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.387520 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-ca-trust-extracted\") pod \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " Jun 03 09:46:11.388027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.387542 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-trusted-ca\") pod \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " Jun 03 09:46:11.388027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.387622 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5mxr\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-kube-api-access-q5mxr\") pod \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\" (UID: \"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2\") " Jun 03 09:46:11.388539 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.388033 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:46:11.390003 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.389974 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:46:11.391714 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.391649 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 09:46:11.391997 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.391964 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 09:46:11.392445 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.392412 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-kube-api-access-q5mxr" (OuterVolumeSpecName: "kube-api-access-q5mxr") pod "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2"). InnerVolumeSpecName "kube-api-access-q5mxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 09:46:11.392445 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.392412 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:46:11.392696 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.392634 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:46:11.400867 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.400840 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" (UID: "e608bbe1-ae9a-4e06-9125-a2cdf524dbf2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 09:46:11.488468 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.488435 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-certificates\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:46:11.488468 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.488464 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-ca-trust-extracted\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:46:11.488468 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.488474 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-trusted-ca\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:46:11.488706 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.488482 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5mxr\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-kube-api-access-q5mxr\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:46:11.488706 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.488492 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-bound-sa-token\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:46:11.488706 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.488500 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-registry-tls\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:46:11.488706 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.488529 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-installation-pull-secrets\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:46:11.488706 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:11.488540 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2-image-registry-private-configuration\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:46:12.091671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.091631 2581 generic.go:358] "Generic (PLEG): container finished" podID="e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" containerID="1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b" exitCode=0 Jun 03 09:46:12.091852 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.091716 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-db467c9c-84rmz" Jun 03 09:46:12.091852 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.091717 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db467c9c-84rmz" event={"ID":"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2","Type":"ContainerDied","Data":"1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b"} Jun 03 09:46:12.091852 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.091773 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db467c9c-84rmz" event={"ID":"e608bbe1-ae9a-4e06-9125-a2cdf524dbf2","Type":"ContainerDied","Data":"bfdd30f72160794f97f2a3a23ce960af4ae31a9ec2f01500a6da34fd6e9559b6"} Jun 03 09:46:12.091852 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.091793 2581 scope.go:117] "RemoveContainer" containerID="1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b" Jun 03 09:46:12.094027 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.093999 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerStarted","Data":"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912"} Jun 03 09:46:12.094149 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.094036 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerStarted","Data":"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44"} Jun 03 09:46:12.101309 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.101093 2581 scope.go:117] "RemoveContainer" containerID="1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b" Jun 03 09:46:12.101845 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:46:12.101385 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b\": container with ID starting with 1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b not found: ID does not exist" containerID="1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b" Jun 03 09:46:12.101845 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.101424 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b"} err="failed to get container status \"1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b\": rpc error: code = NotFound desc = could not find container \"1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b\": container with ID starting with 1c2f2c7b67651424222add9fa45e82b58f1d18d35017130dedb8de2926f5354b not found: ID does not exist" Jun 03 09:46:12.114434 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.114410 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-db467c9c-84rmz"] Jun 03 09:46:12.118350 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.118328 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-db467c9c-84rmz"] Jun 03 09:46:12.586024 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.585989 2581 scope.go:117] "RemoveContainer" containerID="01b2c9315835345ec972227943cef251dac6a145e6b8c452e14ee80dda384a16" Jun 03 09:46:12.591208 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:12.591164 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" path="/var/lib/kubelet/pods/e608bbe1-ae9a-4e06-9125-a2cdf524dbf2/volumes" Jun 03 09:46:13.102126 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:13.102109 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/2.log" Jun 03 09:46:13.102463 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:13.102238 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" event={"ID":"0897e30c-0823-4e83-bf4a-68703d4a5572","Type":"ContainerStarted","Data":"cb401cc1f21519f0e0a4aa2e840f8f4bd660f1346a8c25dad8def70db1d92d2d"} Jun 03 09:46:13.104343 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:13.104051 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:46:13.121109 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:13.121068 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" podStartSLOduration=55.607316813 podStartE2EDuration="58.121053258s" podCreationTimestamp="2026-06-03 09:45:15 +0000 UTC" firstStartedPulling="2026-06-03 09:45:16.010417016 +0000 UTC m=+130.009487853" lastFinishedPulling="2026-06-03 09:45:18.52415346 +0000 UTC m=+132.523224298" observedRunningTime="2026-06-03 09:46:13.119029138 +0000 UTC m=+187.118099999" watchObservedRunningTime="2026-06-03 09:46:13.121053258 +0000 UTC m=+187.120124171" Jun 03 09:46:13.580316 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:13.580238 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-p45xv" Jun 03 09:46:14.108609 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:14.108571 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerStarted","Data":"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca"} Jun 03 09:46:14.108984 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:14.108624 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerStarted","Data":"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f"} Jun 03 09:46:14.108984 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:14.108635 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerStarted","Data":"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d"} Jun 03 09:46:14.108984 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:14.108643 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerStarted","Data":"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a"} Jun 03 09:46:14.142768 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:14.142726 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.581353649 podStartE2EDuration="10.142713194s" podCreationTimestamp="2026-06-03 09:46:04 +0000 UTC" firstStartedPulling="2026-06-03 09:46:05.470682564 +0000 UTC m=+179.469753406" lastFinishedPulling="2026-06-03 09:46:13.032042111 +0000 UTC m=+187.031112951" observedRunningTime="2026-06-03 09:46:14.1409268 +0000 UTC m=+188.139997660" watchObservedRunningTime="2026-06-03 09:46:14.142713194 +0000 UTC m=+188.141784053" Jun 03 09:46:15.325286 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:46:15.325256 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:05.325870 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:05.325839 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:05.341936 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:05.341911 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:06.264671 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:06.264643 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:18.337294 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:18.337215 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:47:18.339699 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:18.339682 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9a4d589-d1bc-4604-affa-2aa626fc7021-metrics-certs\") pod \"network-metrics-daemon-l29jq\" (UID: \"a9a4d589-d1bc-4604-affa-2aa626fc7021\") " pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:47:18.588209 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:18.588135 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwzs9\"" Jun 03 09:47:18.596423 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:18.596403 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l29jq" Jun 03 09:47:18.725503 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:18.725470 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l29jq"] Jun 03 09:47:18.728400 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:47:18.728372 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a4d589_d1bc_4604_affa_2aa626fc7021.slice/crio-0c07fceb537e586a1460d6372dc3e32d7e1f09db822a52d987a4e584fc9502fa WatchSource:0}: Error finding container 0c07fceb537e586a1460d6372dc3e32d7e1f09db822a52d987a4e584fc9502fa: Status 404 returned error can't find the container with id 0c07fceb537e586a1460d6372dc3e32d7e1f09db822a52d987a4e584fc9502fa Jun 03 09:47:19.285475 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:19.285426 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l29jq" event={"ID":"a9a4d589-d1bc-4604-affa-2aa626fc7021","Type":"ContainerStarted","Data":"0c07fceb537e586a1460d6372dc3e32d7e1f09db822a52d987a4e584fc9502fa"} Jun 03 09:47:20.289505 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:20.289468 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l29jq" event={"ID":"a9a4d589-d1bc-4604-affa-2aa626fc7021","Type":"ContainerStarted","Data":"6b6b9812265975f49e9a2ac0d0eb2cd500be8d5a0cf2e9f9ec93239fd5e5a1c3"} Jun 03 09:47:20.289505 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:20.289506 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l29jq" event={"ID":"a9a4d589-d1bc-4604-affa-2aa626fc7021","Type":"ContainerStarted","Data":"b5f5a5bc83472d743b6be6fcbba3577e7b3215600980926652e54fff80923cbf"} Jun 03 09:47:20.305862 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:20.305808 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l29jq" podStartSLOduration=253.252748529 podStartE2EDuration="4m14.30579147s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:47:18.730219935 +0000 UTC m=+252.729290773" lastFinishedPulling="2026-06-03 09:47:19.783262877 +0000 UTC m=+253.782333714" observedRunningTime="2026-06-03 09:47:20.304843178 +0000 UTC m=+254.303914039" watchObservedRunningTime="2026-06-03 09:47:20.30579147 +0000 UTC m=+254.304862337" Jun 03 09:47:23.447680 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.447631 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 09:47:23.448131 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.448099 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="prometheus" containerID="cri-o://64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" gracePeriod=600 Jun 03 09:47:23.448204 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.448139 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy" containerID="cri-o://3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" gracePeriod=600 Jun 03 09:47:23.448258 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.448207 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy-web" containerID="cri-o://75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" gracePeriod=600 Jun 03 09:47:23.448258 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.448231 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="config-reloader" containerID="cri-o://29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" gracePeriod=600 Jun 03 09:47:23.448356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.448265 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" gracePeriod=600 Jun 03 09:47:23.448356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.448159 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="thanos-sidecar" containerID="cri-o://7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" gracePeriod=600 Jun 03 09:47:23.682406 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.682384 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:23.786198 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786166 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-kubelet-serving-ca-bundle\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786214 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-thanos-prometheus-http-client-file\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786235 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786264 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-metrics-client-certs\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786297 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-grpc-tls\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786320 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-kube-rbac-proxy\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786356 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786352 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-tls-assets\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786678 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786385 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786678 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786650 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:47:23.786796 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786781 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2zw2\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-kube-api-access-d2zw2\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786849 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786815 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-config\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786907 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786855 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-tls\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.786907 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786885 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-serving-certs-ca-bundle\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.787006 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786913 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-web-config\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.787006 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.786962 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-rulefiles-0\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.787099 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.787006 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-trusted-ca-bundle\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.787099 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.787043 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-metrics-client-ca\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.787099 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.787074 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-db\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.787247 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.787100 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-config-out\") pod \"45911006-c21d-45bf-bea4-13388929b3ef\" (UID: \"45911006-c21d-45bf-bea4-13388929b3ef\") " Jun 03 09:47:23.787809 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.787332 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:47:23.787809 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.787647 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.787809 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.787669 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.789323 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.789293 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:23.789752 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.789713 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:47:23.790067 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.789994 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-config" (OuterVolumeSpecName: "config") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:23.790194 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.790049 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:23.790310 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.790265 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 09:47:23.790469 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.790436 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:47:23.790826 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.790790 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:23.790939 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.790909 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:23.791069 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.791046 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:47:23.791215 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.791196 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:23.791293 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.791232 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:23.791453 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.791437 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-config-out" (OuterVolumeSpecName: "config-out") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 09:47:23.791510 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.791457 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 09:47:23.791979 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.791960 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:23.792554 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.792536 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-kube-api-access-d2zw2" (OuterVolumeSpecName: "kube-api-access-d2zw2") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "kube-api-access-d2zw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 09:47:23.801514 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.801496 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-web-config" (OuterVolumeSpecName: "web-config") pod "45911006-c21d-45bf-bea4-13388929b3ef" (UID: "45911006-c21d-45bf-bea4-13388929b3ef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:23.888181 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888151 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-metrics-client-certs\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888181 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888175 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-grpc-tls\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888181 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888185 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-kube-rbac-proxy\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888194 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-tls-assets\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888204 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888214 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2zw2\" (UniqueName: \"kubernetes.io/projected/45911006-c21d-45bf-bea4-13388929b3ef-kube-api-access-d2zw2\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888222 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-config\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888231 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888241 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-web-config\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888250 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888259 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888267 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45911006-c21d-45bf-bea4-13388929b3ef-configmap-metrics-client-ca\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888287 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-prometheus-k8s-db\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888297 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45911006-c21d-45bf-bea4-13388929b3ef-config-out\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888306 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:23.888375 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:23.888315 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45911006-c21d-45bf-bea4-13388929b3ef-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-171.ec2.internal\" DevicePath \"\"" Jun 03 09:47:24.306178 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306147 2581 generic.go:358] "Generic (PLEG): container finished" podID="45911006-c21d-45bf-bea4-13388929b3ef" containerID="e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" exitCode=0 Jun 03 09:47:24.306178 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306171 2581 generic.go:358] "Generic (PLEG): container finished" podID="45911006-c21d-45bf-bea4-13388929b3ef" containerID="3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" exitCode=0 Jun 03 09:47:24.306178 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306177 2581 generic.go:358] "Generic (PLEG): container finished" podID="45911006-c21d-45bf-bea4-13388929b3ef" containerID="75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" exitCode=0 Jun 03 09:47:24.306178 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306184 2581 generic.go:358] "Generic (PLEG): container finished" podID="45911006-c21d-45bf-bea4-13388929b3ef" containerID="7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" exitCode=0 Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306190 2581 generic.go:358] "Generic (PLEG): container finished" podID="45911006-c21d-45bf-bea4-13388929b3ef" containerID="29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" exitCode=0 Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306195 2581 generic.go:358] "Generic (PLEG): container finished" podID="45911006-c21d-45bf-bea4-13388929b3ef" containerID="64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" exitCode=0 Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306217 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerDied","Data":"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f"} Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306247 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerDied","Data":"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d"} Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306258 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerDied","Data":"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a"} Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306267 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerDied","Data":"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca"} Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306277 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerDied","Data":"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912"} Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306285 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerDied","Data":"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44"} Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306299 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45911006-c21d-45bf-bea4-13388929b3ef","Type":"ContainerDied","Data":"18a31a5c760bc98256519346aadc94d7254b31fa744b528869c1ffd8385c1523"} Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306305 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.306424 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.306323 2581 scope.go:117] "RemoveContainer" containerID="e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" Jun 03 09:47:24.314136 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.314125 2581 scope.go:117] "RemoveContainer" containerID="3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" Jun 03 09:47:24.320887 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.320871 2581 scope.go:117] "RemoveContainer" containerID="75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" Jun 03 09:47:24.326774 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.326755 2581 scope.go:117] "RemoveContainer" containerID="7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" Jun 03 09:47:24.330937 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.330915 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 09:47:24.333337 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.333308 2581 scope.go:117] "RemoveContainer" containerID="29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" Jun 03 09:47:24.334824 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.334804 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 09:47:24.339821 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.339807 2581 scope.go:117] "RemoveContainer" containerID="64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" Jun 03 09:47:24.346468 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.346452 2581 scope.go:117] "RemoveContainer" containerID="d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8" Jun 03 09:47:24.352364 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.352348 2581 scope.go:117] "RemoveContainer" containerID="e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" Jun 03 09:47:24.352626 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:47:24.352590 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": container with ID starting with e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f not found: ID does not exist" containerID="e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" Jun 03 09:47:24.352691 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.352636 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f"} err="failed to get container status \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": rpc error: code = NotFound desc = could not find container \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": container with ID starting with e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f not found: ID does not exist" Jun 03 09:47:24.352691 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.352654 2581 scope.go:117] "RemoveContainer" containerID="3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" Jun 03 09:47:24.352929 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:47:24.352910 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": container with ID starting with 3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d not found: ID does not exist" containerID="3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" Jun 03 09:47:24.352987 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.352934 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d"} err="failed to get container status \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": rpc error: code = NotFound desc = could not find container \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": container with ID starting with 3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d not found: ID does not exist" Jun 03 09:47:24.352987 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.352950 2581 scope.go:117] "RemoveContainer" containerID="75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" Jun 03 09:47:24.353243 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:47:24.353181 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": container with ID starting with 75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a not found: ID does not exist" containerID="75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" Jun 03 09:47:24.353243 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.353211 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a"} err="failed to get container status \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": rpc error: code = NotFound desc = could not find container \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": container with ID starting with 75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a not found: ID does not exist" Jun 03 09:47:24.353243 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.353236 2581 scope.go:117] "RemoveContainer" containerID="7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" Jun 03 09:47:24.353478 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:47:24.353463 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": container with ID starting with 7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca not found: ID does not exist" containerID="7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" Jun 03 09:47:24.353513 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.353481 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca"} err="failed to get container status \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": rpc error: code = NotFound desc = could not find container \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": container with ID starting with 7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca not found: ID does not exist" Jun 03 09:47:24.353513 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.353503 2581 scope.go:117] "RemoveContainer" containerID="29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" Jun 03 09:47:24.353712 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:47:24.353690 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": container with ID starting with 29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912 not found: ID does not exist" containerID="29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" Jun 03 09:47:24.353780 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.353721 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912"} err="failed to get container status \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": rpc error: code = NotFound desc = could not find container \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": container with ID starting with 29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912 not found: ID does not exist" Jun 03 09:47:24.353780 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.353736 2581 scope.go:117] "RemoveContainer" containerID="64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" Jun 03 09:47:24.353966 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:47:24.353949 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": container with ID starting with 64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44 not found: ID does not exist" containerID="64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" Jun 03 09:47:24.354004 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.353981 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44"} err="failed to get container status \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": rpc error: code = NotFound desc = could not find container \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": container with ID starting with 64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44 not found: ID does not exist" Jun 03 09:47:24.354004 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.353995 2581 scope.go:117] "RemoveContainer" containerID="d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8" Jun 03 09:47:24.354189 ip-10-0-135-171 kubenswrapper[2581]: E0603 09:47:24.354174 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": container with ID starting with d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8 not found: ID does not exist" containerID="d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8" Jun 03 09:47:24.354223 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.354194 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8"} err="failed to get container status \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": rpc error: code = NotFound desc = could not find container \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": container with ID starting with d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8 not found: ID does not exist" Jun 03 09:47:24.354223 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.354211 2581 scope.go:117] "RemoveContainer" containerID="e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" Jun 03 09:47:24.354410 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.354393 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f"} err="failed to get container status \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": rpc error: code = NotFound desc = could not find container \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": container with ID starting with e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f not found: ID does not exist" Jun 03 09:47:24.354455 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.354410 2581 scope.go:117] "RemoveContainer" containerID="3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" Jun 03 09:47:24.354588 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.354573 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d"} err="failed to get container status \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": rpc error: code = NotFound desc = could not find container \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": container with ID starting with 3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d not found: ID does not exist" Jun 03 09:47:24.354588 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.354587 2581 scope.go:117] "RemoveContainer" containerID="75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" Jun 03 09:47:24.354826 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.354808 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a"} err="failed to get container status \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": rpc error: code = NotFound desc = could not find container \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": container with ID starting with 75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a not found: ID does not exist" Jun 03 09:47:24.354867 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.354826 2581 scope.go:117] "RemoveContainer" containerID="7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" Jun 03 09:47:24.355009 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.354990 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca"} err="failed to get container status \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": rpc error: code = NotFound desc = could not find container \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": container with ID starting with 7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca not found: ID does not exist" Jun 03 09:47:24.355079 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.355012 2581 scope.go:117] "RemoveContainer" containerID="29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" Jun 03 09:47:24.355204 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.355189 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912"} err="failed to get container status \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": rpc error: code = NotFound desc = could not find container \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": container with ID starting with 29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912 not found: ID does not exist" Jun 03 09:47:24.355245 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.355205 2581 scope.go:117] "RemoveContainer" containerID="64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" Jun 03 09:47:24.355383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.355361 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44"} err="failed to get container status \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": rpc error: code = NotFound desc = could not find container \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": container with ID starting with 64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44 not found: ID does not exist" Jun 03 09:47:24.355383 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.355378 2581 scope.go:117] "RemoveContainer" containerID="d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8" Jun 03 09:47:24.355620 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.355585 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8"} err="failed to get container status \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": rpc error: code = NotFound desc = could not find container \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": container with ID starting with d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8 not found: ID does not exist" Jun 03 09:47:24.355680 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.355621 2581 scope.go:117] "RemoveContainer" containerID="e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" Jun 03 09:47:24.355830 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.355814 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f"} err="failed to get container status \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": rpc error: code = NotFound desc = could not find container \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": container with ID starting with e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f not found: ID does not exist" Jun 03 09:47:24.355830 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.355830 2581 scope.go:117] "RemoveContainer" containerID="3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" Jun 03 09:47:24.356042 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356025 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d"} err="failed to get container status \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": rpc error: code = NotFound desc = could not find container \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": container with ID starting with 3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d not found: ID does not exist" Jun 03 09:47:24.356086 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356043 2581 scope.go:117] "RemoveContainer" containerID="75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" Jun 03 09:47:24.356241 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356224 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a"} err="failed to get container status \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": rpc error: code = NotFound desc = could not find container \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": container with ID starting with 75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a not found: ID does not exist" Jun 03 09:47:24.356281 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356242 2581 scope.go:117] "RemoveContainer" containerID="7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" Jun 03 09:47:24.356464 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356448 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca"} err="failed to get container status \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": rpc error: code = NotFound desc = could not find container \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": container with ID starting with 7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca not found: ID does not exist" Jun 03 09:47:24.356504 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356464 2581 scope.go:117] "RemoveContainer" containerID="29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" Jun 03 09:47:24.356675 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356660 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912"} err="failed to get container status \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": rpc error: code = NotFound desc = could not find container \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": container with ID starting with 29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912 not found: ID does not exist" Jun 03 09:47:24.356675 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356674 2581 scope.go:117] "RemoveContainer" containerID="64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" Jun 03 09:47:24.356864 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356849 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44"} err="failed to get container status \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": rpc error: code = NotFound desc = could not find container \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": container with ID starting with 64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44 not found: ID does not exist" Jun 03 09:47:24.356864 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.356864 2581 scope.go:117] "RemoveContainer" containerID="d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8" Jun 03 09:47:24.357037 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357020 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8"} err="failed to get container status \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": rpc error: code = NotFound desc = could not find container \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": container with ID starting with d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8 not found: ID does not exist" Jun 03 09:47:24.357073 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357036 2581 scope.go:117] "RemoveContainer" containerID="e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" Jun 03 09:47:24.357199 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357184 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f"} err="failed to get container status \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": rpc error: code = NotFound desc = could not find container \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": container with ID starting with e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f not found: ID does not exist" Jun 03 09:47:24.357241 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357198 2581 scope.go:117] "RemoveContainer" containerID="3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" Jun 03 09:47:24.357377 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357361 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d"} err="failed to get container status \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": rpc error: code = NotFound desc = could not find container \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": container with ID starting with 3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d not found: ID does not exist" Jun 03 09:47:24.357415 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357376 2581 scope.go:117] "RemoveContainer" containerID="75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" Jun 03 09:47:24.357561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357546 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a"} err="failed to get container status \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": rpc error: code = NotFound desc = could not find container \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": container with ID starting with 75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a not found: ID does not exist" Jun 03 09:47:24.357561 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357559 2581 scope.go:117] "RemoveContainer" containerID="7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" Jun 03 09:47:24.357758 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357742 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca"} err="failed to get container status \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": rpc error: code = NotFound desc = could not find container \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": container with ID starting with 7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca not found: ID does not exist" Jun 03 09:47:24.357812 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357757 2581 scope.go:117] "RemoveContainer" containerID="29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" Jun 03 09:47:24.357941 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357923 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912"} err="failed to get container status \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": rpc error: code = NotFound desc = could not find container \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": container with ID starting with 29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912 not found: ID does not exist" Jun 03 09:47:24.358009 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.357943 2581 scope.go:117] "RemoveContainer" containerID="64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" Jun 03 09:47:24.358152 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.358138 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44"} err="failed to get container status \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": rpc error: code = NotFound desc = could not find container \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": container with ID starting with 64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44 not found: ID does not exist" Jun 03 09:47:24.358196 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.358154 2581 scope.go:117] "RemoveContainer" containerID="d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8" Jun 03 09:47:24.358333 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.358315 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8"} err="failed to get container status \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": rpc error: code = NotFound desc = could not find container \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": container with ID starting with d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8 not found: ID does not exist" Jun 03 09:47:24.358408 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.358334 2581 scope.go:117] "RemoveContainer" containerID="e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" Jun 03 09:47:24.358567 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.358548 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f"} err="failed to get container status \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": rpc error: code = NotFound desc = could not find container \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": container with ID starting with e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f not found: ID does not exist" Jun 03 09:47:24.358633 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.358568 2581 scope.go:117] "RemoveContainer" containerID="3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" Jun 03 09:47:24.358831 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.358809 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d"} err="failed to get container status \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": rpc error: code = NotFound desc = could not find container \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": container with ID starting with 3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d not found: ID does not exist" Jun 03 09:47:24.358903 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.358834 2581 scope.go:117] "RemoveContainer" containerID="75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" Jun 03 09:47:24.359014 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.358994 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a"} err="failed to get container status \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": rpc error: code = NotFound desc = could not find container \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": container with ID starting with 75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a not found: ID does not exist" Jun 03 09:47:24.359058 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.359014 2581 scope.go:117] "RemoveContainer" containerID="7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" Jun 03 09:47:24.359190 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.359174 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca"} err="failed to get container status \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": rpc error: code = NotFound desc = could not find container \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": container with ID starting with 7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca not found: ID does not exist" Jun 03 09:47:24.359256 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.359192 2581 scope.go:117] "RemoveContainer" containerID="29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" Jun 03 09:47:24.359390 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.359376 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912"} err="failed to get container status \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": rpc error: code = NotFound desc = could not find container \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": container with ID starting with 29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912 not found: ID does not exist" Jun 03 09:47:24.359439 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.359390 2581 scope.go:117] "RemoveContainer" containerID="64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" Jun 03 09:47:24.359577 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.359561 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44"} err="failed to get container status \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": rpc error: code = NotFound desc = could not find container \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": container with ID starting with 64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44 not found: ID does not exist" Jun 03 09:47:24.359663 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.359578 2581 scope.go:117] "RemoveContainer" containerID="d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8" Jun 03 09:47:24.359839 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.359820 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8"} err="failed to get container status \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": rpc error: code = NotFound desc = could not find container \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": container with ID starting with d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8 not found: ID does not exist" Jun 03 09:47:24.359878 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.359840 2581 scope.go:117] "RemoveContainer" containerID="e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f" Jun 03 09:47:24.360042 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360021 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f"} err="failed to get container status \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": rpc error: code = NotFound desc = could not find container \"e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f\": container with ID starting with e68419b9e89e156b989b735be1d0d41729a906eb9a2eb8942d3d896f3f65b59f not found: ID does not exist" Jun 03 09:47:24.360108 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360043 2581 scope.go:117] "RemoveContainer" containerID="3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d" Jun 03 09:47:24.360226 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360211 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d"} err="failed to get container status \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": rpc error: code = NotFound desc = could not find container \"3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d\": container with ID starting with 3223d53351194401f9ada3a7050d3034e15e7c366007b86d261c45efbdc3c32d not found: ID does not exist" Jun 03 09:47:24.360281 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360226 2581 scope.go:117] "RemoveContainer" containerID="75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a" Jun 03 09:47:24.360393 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360377 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a"} err="failed to get container status \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": rpc error: code = NotFound desc = could not find container \"75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a\": container with ID starting with 75d6b4fbe825dee80cc538ab20a8db40c7d4f56574a66c09e28b4eefcc93f09a not found: ID does not exist" Jun 03 09:47:24.360465 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360394 2581 scope.go:117] "RemoveContainer" containerID="7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca" Jun 03 09:47:24.360586 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360569 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca"} err="failed to get container status \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": rpc error: code = NotFound desc = could not find container \"7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca\": container with ID starting with 7ca5e4b3df44fbeaaab71cc8bbe3bb37779ca8a65b0d5546973ce0081cf149ca not found: ID does not exist" Jun 03 09:47:24.360655 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360587 2581 scope.go:117] "RemoveContainer" containerID="29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912" Jun 03 09:47:24.360802 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360782 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912"} err="failed to get container status \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": rpc error: code = NotFound desc = could not find container \"29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912\": container with ID starting with 29e3e0f4b8e23b6be6a185db92518d758932ce8ac4e45a8db4861e3a546df912 not found: ID does not exist" Jun 03 09:47:24.360844 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360803 2581 scope.go:117] "RemoveContainer" containerID="64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44" Jun 03 09:47:24.361000 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.360983 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44"} err="failed to get container status \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": rpc error: code = NotFound desc = could not find container \"64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44\": container with ID starting with 64a7d7d72d2c31825cf076f5948c0ae6fbc5ff529e23a27dd6fc2207a384bc44 not found: ID does not exist" Jun 03 09:47:24.361063 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.361002 2581 scope.go:117] "RemoveContainer" containerID="d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8" Jun 03 09:47:24.361174 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.361157 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8"} err="failed to get container status \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": rpc error: code = NotFound desc = could not find container \"d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8\": container with ID starting with d48cddb1ee4cf9c4d8ea47fed5fa0a411ca8ecb0cf93a3d44fe53bc0f285c0b8 not found: ID does not exist" Jun 03 09:47:24.366232 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366213 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 09:47:24.366534 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366521 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="thanos-sidecar" Jun 03 09:47:24.366577 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366537 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="thanos-sidecar" Jun 03 09:47:24.366577 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366554 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="prometheus" Jun 03 09:47:24.366577 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366564 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="prometheus" Jun 03 09:47:24.366577 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366575 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy-thanos" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366585 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy-thanos" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366622 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy-web" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366631 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy-web" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366646 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366655 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366664 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" containerName="registry" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366672 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" containerName="registry" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366681 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="config-reloader" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366688 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="config-reloader" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366700 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="init-config-reloader" Jun 03 09:47:24.366726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366707 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="init-config-reloader" Jun 03 09:47:24.367033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366763 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="config-reloader" Jun 03 09:47:24.367033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366774 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy" Jun 03 09:47:24.367033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366785 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="e608bbe1-ae9a-4e06-9125-a2cdf524dbf2" containerName="registry" Jun 03 09:47:24.367033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366796 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="prometheus" Jun 03 09:47:24.367033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366804 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy-thanos" Jun 03 09:47:24.367033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366815 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="thanos-sidecar" Jun 03 09:47:24.367033 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.366824 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="45911006-c21d-45bf-bea4-13388929b3ef" containerName="kube-rbac-proxy-web" Jun 03 09:47:24.370829 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.370815 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.373277 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.373259 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mhs26\"" Jun 03 09:47:24.373368 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.373323 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 09:47:24.373501 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.373488 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 09:47:24.373562 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.373522 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 09:47:24.373684 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.373646 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 09:47:24.373762 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.373747 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 09:47:24.373947 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.373933 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 09:47:24.374231 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.374216 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 09:47:24.374899 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.374882 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3st8d4jtvpjrp\"" Jun 03 09:47:24.374975 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.374883 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 09:47:24.375028 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.375001 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 09:47:24.375110 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.375094 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 09:47:24.375359 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.375341 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 09:47:24.377736 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.377716 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 09:47:24.380079 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.380061 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 09:47:24.382728 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.382708 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 09:47:24.493259 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-config\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493353 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33128ee8-36cd-4b35-b161-edf349fdc0c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33128ee8-36cd-4b35-b161-edf349fdc0c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493459 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493546 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493854 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs546\" (UniqueName: \"kubernetes.io/projected/33128ee8-36cd-4b35-b161-edf349fdc0c7-kube-api-access-bs546\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493854 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493854 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493854 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493854 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33128ee8-36cd-4b35-b161-edf349fdc0c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493854 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493854 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.493854 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.493758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.588915 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.588855 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45911006-c21d-45bf-bea4-13388929b3ef" path="/var/lib/kubelet/pods/45911006-c21d-45bf-bea4-13388929b3ef/volumes" Jun 03 09:47:24.594386 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.594360 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.594453 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.594399 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.594453 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.594420 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.594559 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.594542 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.594612 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.594576 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-config\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.594656 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.594631 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.594709 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.594661 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.594709 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.594684 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.594799 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.594708 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33128ee8-36cd-4b35-b161-edf349fdc0c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.595078 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.595054 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33128ee8-36cd-4b35-b161-edf349fdc0c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.595777 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.595749 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.595861 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.595805 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33128ee8-36cd-4b35-b161-edf349fdc0c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.595861 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.595851 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.595971 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.595894 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.595971 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.595919 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.595971 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.595947 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bs546\" (UniqueName: \"kubernetes.io/projected/33128ee8-36cd-4b35-b161-edf349fdc0c7-kube-api-access-bs546\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.596120 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.595984 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.596120 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.596014 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.596120 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.596041 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.596120 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.596069 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33128ee8-36cd-4b35-b161-edf349fdc0c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.596452 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.596431 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.597484 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.597462 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.597628 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.597580 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.597727 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.597545 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.597813 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.597722 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.598073 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.598047 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.598829 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.598448 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.598829 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.598454 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-config\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.598829 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.598819 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33128ee8-36cd-4b35-b161-edf349fdc0c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.599466 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.599441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33128ee8-36cd-4b35-b161-edf349fdc0c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.599897 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.599862 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33128ee8-36cd-4b35-b161-edf349fdc0c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.600779 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.600760 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.600879 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.600857 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.600927 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.600870 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.601092 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.601076 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33128ee8-36cd-4b35-b161-edf349fdc0c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.607166 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.607148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs546\" (UniqueName: \"kubernetes.io/projected/33128ee8-36cd-4b35-b161-edf349fdc0c7-kube-api-access-bs546\") pod \"prometheus-k8s-0\" (UID: \"33128ee8-36cd-4b35-b161-edf349fdc0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.682116 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.682087 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:24.819182 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:24.819157 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 09:47:24.821532 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:47:24.821505 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33128ee8_36cd_4b35_b161_edf349fdc0c7.slice/crio-593a00f89e70ef7aff8d096241431b9cf751beb2575f9cf52129c574bb7704b0 WatchSource:0}: Error finding container 593a00f89e70ef7aff8d096241431b9cf751beb2575f9cf52129c574bb7704b0: Status 404 returned error can't find the container with id 593a00f89e70ef7aff8d096241431b9cf751beb2575f9cf52129c574bb7704b0 Jun 03 09:47:25.311632 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:25.311581 2581 generic.go:358] "Generic (PLEG): container finished" podID="33128ee8-36cd-4b35-b161-edf349fdc0c7" containerID="2c631243511a8885bce040326e8e219bf971c1c3e8ead7b90fd5db21b3e7a9ea" exitCode=0 Jun 03 09:47:25.311766 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:25.311648 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33128ee8-36cd-4b35-b161-edf349fdc0c7","Type":"ContainerDied","Data":"2c631243511a8885bce040326e8e219bf971c1c3e8ead7b90fd5db21b3e7a9ea"} Jun 03 09:47:25.311766 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:25.311667 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33128ee8-36cd-4b35-b161-edf349fdc0c7","Type":"ContainerStarted","Data":"593a00f89e70ef7aff8d096241431b9cf751beb2575f9cf52129c574bb7704b0"} Jun 03 09:47:26.317786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:26.317753 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33128ee8-36cd-4b35-b161-edf349fdc0c7","Type":"ContainerStarted","Data":"0ca60f3b7b037633df18e1670d99b9ab444e152dc0778b7d62ed837c8dacdb83"} Jun 03 09:47:26.317786 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:26.317789 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33128ee8-36cd-4b35-b161-edf349fdc0c7","Type":"ContainerStarted","Data":"93bec3e036c4274ed00c2bb264f734bc9988d33d7ba95e27136c8f7588a5ec87"} Jun 03 09:47:26.318180 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:26.317801 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33128ee8-36cd-4b35-b161-edf349fdc0c7","Type":"ContainerStarted","Data":"664513809cf7fdd4292c2d1cf975fdd6382ca78ab3b4e74fdea0a7965607f716"} Jun 03 09:47:26.318180 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:26.317811 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33128ee8-36cd-4b35-b161-edf349fdc0c7","Type":"ContainerStarted","Data":"305ae3939883472efde823603d86c99987d86226d1b63468900d147720c3cc61"} Jun 03 09:47:26.318180 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:26.317819 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33128ee8-36cd-4b35-b161-edf349fdc0c7","Type":"ContainerStarted","Data":"6a8282a168d017c6efc093842edad7a77b0d805ccfe8ac72519875818930bb4a"} Jun 03 09:47:26.318180 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:26.317826 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33128ee8-36cd-4b35-b161-edf349fdc0c7","Type":"ContainerStarted","Data":"9f96248d457050997a06b2d6f01964a2e320236ea5bb896ebff44a1d9e824a4a"} Jun 03 09:47:26.346643 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:26.346580 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.346566449 podStartE2EDuration="2.346566449s" podCreationTimestamp="2026-06-03 09:47:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:47:26.345114522 +0000 UTC m=+260.344185381" watchObservedRunningTime="2026-06-03 09:47:26.346566449 +0000 UTC m=+260.345637309" Jun 03 09:47:29.683026 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:29.682987 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:47:59.270220 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.270179 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9xkvq"] Jun 03 09:47:59.272515 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.272493 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.274726 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.274706 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 09:47:59.278572 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.278538 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xkvq"] Jun 03 09:47:59.350707 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.350681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72f3b69f-9eae-496e-9d6f-2f560dd6384a-kubelet-config\") pod \"global-pull-secret-syncer-9xkvq\" (UID: \"72f3b69f-9eae-496e-9d6f-2f560dd6384a\") " pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.350815 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.350779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72f3b69f-9eae-496e-9d6f-2f560dd6384a-original-pull-secret\") pod \"global-pull-secret-syncer-9xkvq\" (UID: \"72f3b69f-9eae-496e-9d6f-2f560dd6384a\") " pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.350815 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.350799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72f3b69f-9eae-496e-9d6f-2f560dd6384a-dbus\") pod \"global-pull-secret-syncer-9xkvq\" (UID: \"72f3b69f-9eae-496e-9d6f-2f560dd6384a\") " pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.451631 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.451591 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72f3b69f-9eae-496e-9d6f-2f560dd6384a-original-pull-secret\") pod \"global-pull-secret-syncer-9xkvq\" (UID: \"72f3b69f-9eae-496e-9d6f-2f560dd6384a\") " pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.451739 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.451635 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72f3b69f-9eae-496e-9d6f-2f560dd6384a-dbus\") pod \"global-pull-secret-syncer-9xkvq\" (UID: \"72f3b69f-9eae-496e-9d6f-2f560dd6384a\") " pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.451739 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.451659 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72f3b69f-9eae-496e-9d6f-2f560dd6384a-kubelet-config\") pod \"global-pull-secret-syncer-9xkvq\" (UID: \"72f3b69f-9eae-496e-9d6f-2f560dd6384a\") " pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.451814 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.451761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72f3b69f-9eae-496e-9d6f-2f560dd6384a-kubelet-config\") pod \"global-pull-secret-syncer-9xkvq\" (UID: \"72f3b69f-9eae-496e-9d6f-2f560dd6384a\") " pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.451814 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.451781 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72f3b69f-9eae-496e-9d6f-2f560dd6384a-dbus\") pod \"global-pull-secret-syncer-9xkvq\" (UID: \"72f3b69f-9eae-496e-9d6f-2f560dd6384a\") " pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.453994 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.453978 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72f3b69f-9eae-496e-9d6f-2f560dd6384a-original-pull-secret\") pod \"global-pull-secret-syncer-9xkvq\" (UID: \"72f3b69f-9eae-496e-9d6f-2f560dd6384a\") " pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.582034 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.581980 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xkvq" Jun 03 09:47:59.701835 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:47:59.701805 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xkvq"] Jun 03 09:47:59.704826 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:47:59.704793 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f3b69f_9eae_496e_9d6f_2f560dd6384a.slice/crio-9e431b2fded505955f8c62fb27dff2ec61100606e3e12b469a04fbe6470254d4 WatchSource:0}: Error finding container 9e431b2fded505955f8c62fb27dff2ec61100606e3e12b469a04fbe6470254d4: Status 404 returned error can't find the container with id 9e431b2fded505955f8c62fb27dff2ec61100606e3e12b469a04fbe6470254d4 Jun 03 09:48:00.413808 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:00.413774 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xkvq" event={"ID":"72f3b69f-9eae-496e-9d6f-2f560dd6384a","Type":"ContainerStarted","Data":"9e431b2fded505955f8c62fb27dff2ec61100606e3e12b469a04fbe6470254d4"} Jun 03 09:48:04.426069 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:04.426037 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xkvq" event={"ID":"72f3b69f-9eae-496e-9d6f-2f560dd6384a","Type":"ContainerStarted","Data":"457095fbe9a0fbce6f721534fcf1ed96cf6de3e3ff7151855d3d3f42de9bf2f0"} Jun 03 09:48:04.441050 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:04.441007 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9xkvq" podStartSLOduration=1.344626636 podStartE2EDuration="5.440992618s" podCreationTimestamp="2026-06-03 09:47:59 +0000 UTC" firstStartedPulling="2026-06-03 09:47:59.706521485 +0000 UTC m=+293.705592338" lastFinishedPulling="2026-06-03 09:48:03.802887469 +0000 UTC m=+297.801958320" observedRunningTime="2026-06-03 09:48:04.439942845 +0000 UTC m=+298.439013705" watchObservedRunningTime="2026-06-03 09:48:04.440992618 +0000 UTC m=+298.440063476" Jun 03 09:48:06.466571 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:06.466543 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/2.log" Jun 03 09:48:06.467053 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:06.466577 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/2.log" Jun 03 09:48:06.477322 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:06.477297 2581 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 09:48:24.683061 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:24.683026 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:48:24.699180 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:24.699152 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:48:25.503357 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:25.503329 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 09:48:47.608208 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:47.608182 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9xkvq_72f3b69f-9eae-496e-9d6f-2f560dd6384a/global-pull-secret-syncer/0.log" Jun 03 09:48:47.791999 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:47.791964 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jf6z9_19bb936b-7cb7-4b1f-810c-00d367f83055/konnectivity-agent/0.log" Jun 03 09:48:47.862590 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:47.862509 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-171.ec2.internal_4a81c4b353697dcd6d18eda03f48f2de/haproxy/0.log" Jun 03 09:48:50.983114 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:50.983077 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-gbdcm_63ea905b-6bb0-4117-a6f1-95928b3a59d7/cluster-monitoring-operator/0.log" Jun 03 09:48:51.106830 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.106755 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-gw9fn_a560ec05-ad68-4046-bb69-1eff9fa94d29/monitoring-plugin/0.log" Jun 03 09:48:51.317848 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.317820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q4sx8_b68e8542-aae3-434e-82d9-2c5c4d90d475/node-exporter/0.log" Jun 03 09:48:51.337482 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.337458 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q4sx8_b68e8542-aae3-434e-82d9-2c5c4d90d475/kube-rbac-proxy/0.log" Jun 03 09:48:51.358144 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.358064 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q4sx8_b68e8542-aae3-434e-82d9-2c5c4d90d475/init-textfile/0.log" Jun 03 09:48:51.468473 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.468445 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33128ee8-36cd-4b35-b161-edf349fdc0c7/prometheus/0.log" Jun 03 09:48:51.488224 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.488203 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33128ee8-36cd-4b35-b161-edf349fdc0c7/config-reloader/0.log" Jun 03 09:48:51.512865 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.512845 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33128ee8-36cd-4b35-b161-edf349fdc0c7/thanos-sidecar/0.log" Jun 03 09:48:51.534873 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.534845 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33128ee8-36cd-4b35-b161-edf349fdc0c7/kube-rbac-proxy-web/0.log" Jun 03 09:48:51.559109 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.559066 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33128ee8-36cd-4b35-b161-edf349fdc0c7/kube-rbac-proxy/0.log" Jun 03 09:48:51.587526 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.587482 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33128ee8-36cd-4b35-b161-edf349fdc0c7/kube-rbac-proxy-thanos/0.log" Jun 03 09:48:51.609047 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.608956 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33128ee8-36cd-4b35-b161-edf349fdc0c7/init-config-reloader/0.log" Jun 03 09:48:51.728605 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.728556 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6df7f4ddc9-t8gsf_25c696b9-7a4a-44b7-a042-93bca09a7eae/telemeter-client/0.log" Jun 03 09:48:51.756653 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.756623 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6df7f4ddc9-t8gsf_25c696b9-7a4a-44b7-a042-93bca09a7eae/reload/0.log" Jun 03 09:48:51.777634 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:51.777614 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6df7f4ddc9-t8gsf_25c696b9-7a4a-44b7-a042-93bca09a7eae/kube-rbac-proxy/0.log" Jun 03 09:48:53.435774 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:53.435747 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/2.log" Jun 03 09:48:53.441849 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:53.441829 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-p45xv_0897e30c-0823-4e83-bf4a-68703d4a5572/console-operator/3.log" Jun 03 09:48:54.330660 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.330629 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f"] Jun 03 09:48:54.332812 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.332797 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.335250 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.335227 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4q4fr\"/\"openshift-service-ca.crt\"" Jun 03 09:48:54.336128 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.336111 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4q4fr\"/\"default-dockercfg-kftqc\"" Jun 03 09:48:54.336232 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.336153 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4q4fr\"/\"kube-root-ca.crt\"" Jun 03 09:48:54.340205 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.340184 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f"] Jun 03 09:48:54.403214 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.403189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkg54\" (UniqueName: \"kubernetes.io/projected/91f87b0b-6014-49af-aabe-050fadcbbf6f-kube-api-access-pkg54\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.403341 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.403239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-sys\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.403341 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.403263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-proc\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.403341 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.403322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-lib-modules\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.403443 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.403368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-podres\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.504654 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.504630 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkg54\" (UniqueName: \"kubernetes.io/projected/91f87b0b-6014-49af-aabe-050fadcbbf6f-kube-api-access-pkg54\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.504969 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.504692 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-sys\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.504969 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.504719 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-proc\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.504969 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.504751 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-lib-modules\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.504969 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.504827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-sys\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.504969 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.504834 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-proc\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.504969 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.504877 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-podres\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.504969 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.504878 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-lib-modules\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.504969 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.504940 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91f87b0b-6014-49af-aabe-050fadcbbf6f-podres\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.512301 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.512271 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkg54\" (UniqueName: \"kubernetes.io/projected/91f87b0b-6014-49af-aabe-050fadcbbf6f-kube-api-access-pkg54\") pod \"perf-node-gather-daemonset-55x9f\" (UID: \"91f87b0b-6014-49af-aabe-050fadcbbf6f\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.661575 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.661504 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:54.786085 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.786055 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f"] Jun 03 09:48:54.788529 ip-10-0-135-171 kubenswrapper[2581]: W0603 09:48:54.788502 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod91f87b0b_6014_49af_aabe_050fadcbbf6f.slice/crio-2a5adbd13e764f8683041dd5a359472a8320a9553a2c3bc56f8860bf06707af2 WatchSource:0}: Error finding container 2a5adbd13e764f8683041dd5a359472a8320a9553a2c3bc56f8860bf06707af2: Status 404 returned error can't find the container with id 2a5adbd13e764f8683041dd5a359472a8320a9553a2c3bc56f8860bf06707af2 Jun 03 09:48:54.790399 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.790380 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 09:48:54.856243 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.856221 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dfnlh_d304bac2-71de-4ae7-8340-db864e1e203f/dns/0.log" Jun 03 09:48:54.875698 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.875674 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dfnlh_d304bac2-71de-4ae7-8340-db864e1e203f/kube-rbac-proxy/0.log" Jun 03 09:48:54.977769 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:54.977689 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctb7x_ed18ee14-518a-4d42-b151-62c672753c42/dns-node-resolver/0.log" Jun 03 09:48:55.365228 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:55.365204 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b5dfc9945-w65p7_c440a1ee-9fcb-416c-a423-5df6dacaf1e6/registry/0.log" Jun 03 09:48:55.387261 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:55.387233 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b525w_ced04495-5f40-4e7d-ae5c-53efaeeec70f/node-ca/0.log" Jun 03 09:48:55.568979 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:55.568938 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" event={"ID":"91f87b0b-6014-49af-aabe-050fadcbbf6f","Type":"ContainerStarted","Data":"b664c0005e59c41c1684cccd3fe09c46a84058549da19c31472e44a5e11e66dd"} Jun 03 09:48:55.568979 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:55.568968 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" event={"ID":"91f87b0b-6014-49af-aabe-050fadcbbf6f","Type":"ContainerStarted","Data":"2a5adbd13e764f8683041dd5a359472a8320a9553a2c3bc56f8860bf06707af2"} Jun 03 09:48:55.569462 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:55.569063 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:48:55.584730 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:55.584685 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" podStartSLOduration=1.5846708029999999 podStartE2EDuration="1.584670803s" podCreationTimestamp="2026-06-03 09:48:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:48:55.583635755 +0000 UTC m=+349.582706611" watchObservedRunningTime="2026-06-03 09:48:55.584670803 +0000 UTC m=+349.583741665" Jun 03 09:48:56.130680 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:56.130650 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54958dc7b5-snw5r_9073f3d7-84c8-49bc-8978-88984a883160/router/0.log" Jun 03 09:48:56.520117 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:56.520086 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x96pk_934562dd-9ed1-4387-9055-cb8b3e14aefc/serve-healthcheck-canary/0.log" Jun 03 09:48:57.047303 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:57.047269 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wv4z6_47e034fd-70df-48c1-afcb-16a0dd85b730/kube-rbac-proxy/0.log" Jun 03 09:48:57.068173 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:57.068155 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wv4z6_47e034fd-70df-48c1-afcb-16a0dd85b730/exporter/0.log" Jun 03 09:48:57.089316 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:48:57.089299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wv4z6_47e034fd-70df-48c1-afcb-16a0dd85b730/extractor/0.log" Jun 03 09:49:01.581979 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:01.581953 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-55x9f" Jun 03 09:49:02.505006 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:02.504974 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnrcx_958fef8c-f445-44ce-8c5f-6f80c528d394/kube-multus-additional-cni-plugins/0.log" Jun 03 09:49:02.530104 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:02.530078 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnrcx_958fef8c-f445-44ce-8c5f-6f80c528d394/egress-router-binary-copy/0.log" Jun 03 09:49:02.563797 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:02.563767 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnrcx_958fef8c-f445-44ce-8c5f-6f80c528d394/cni-plugins/0.log" Jun 03 09:49:02.588414 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:02.588392 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnrcx_958fef8c-f445-44ce-8c5f-6f80c528d394/bond-cni-plugin/0.log" Jun 03 09:49:02.616797 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:02.616771 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnrcx_958fef8c-f445-44ce-8c5f-6f80c528d394/routeoverride-cni/0.log" Jun 03 09:49:02.646971 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:02.646941 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnrcx_958fef8c-f445-44ce-8c5f-6f80c528d394/whereabouts-cni-bincopy/0.log" Jun 03 09:49:02.671670 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:02.671622 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnrcx_958fef8c-f445-44ce-8c5f-6f80c528d394/whereabouts-cni/0.log" Jun 03 09:49:02.952368 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:02.952341 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zzjpd_af634bdb-1625-437f-9e8d-c3c41386143c/kube-multus/0.log" Jun 03 09:49:03.093309 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:03.093243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l29jq_a9a4d589-d1bc-4604-affa-2aa626fc7021/network-metrics-daemon/0.log" Jun 03 09:49:03.118896 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:03.118871 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l29jq_a9a4d589-d1bc-4604-affa-2aa626fc7021/kube-rbac-proxy/0.log" Jun 03 09:49:04.508584 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:04.508553 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkws8_95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b/ovn-controller/0.log" Jun 03 09:49:04.533350 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:04.533300 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkws8_95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b/ovn-acl-logging/0.log" Jun 03 09:49:04.559022 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:04.558991 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkws8_95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b/kube-rbac-proxy-node/0.log" Jun 03 09:49:04.583052 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:04.583021 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkws8_95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 09:49:04.601548 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:04.601526 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkws8_95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b/northd/0.log" Jun 03 09:49:04.624147 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:04.624116 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkws8_95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b/nbdb/0.log" Jun 03 09:49:04.646659 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:04.646626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkws8_95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b/sbdb/0.log" Jun 03 09:49:04.799182 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:04.799108 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkws8_95bcc5ec-b3e4-4c77-9ed1-9d8ab062b40b/ovnkube-controller/0.log" Jun 03 09:49:05.864604 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:05.864577 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lnxjc_5ec8422b-ffe2-4911-8290-6efa7a25a4b0/network-check-target-container/0.log" Jun 03 09:49:06.799398 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:06.799370 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-mgpc8_d6b29734-5571-4e06-a3b1-232d14cb2c02/iptables-alerter/0.log" Jun 03 09:49:07.413334 ip-10-0-135-171 kubenswrapper[2581]: I0603 09:49:07.413303 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-49jlt_9fea2333-d855-4c22-8eb4-89f7aa063cbe/tuned/0.log"