May 21 01:45:06.907215 ip-10-0-136-250 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 01:45:06.907227 ip-10-0-136-250 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 01:45:06.907236 ip-10-0-136-250 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 01:45:06.907871 ip-10-0-136-250 systemd[1]: Failed to start Kubernetes Kubelet. May 21 01:45:15.340334 ip-10-0-136-250 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. May 21 01:45:15.340348 ip-10-0-136-250 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 190b3841f8d54e46aa973438b07b1687 -- May 21 01:47:11.184593 ip-10-0-136-250 systemd[1]: Starting Kubernetes Kubelet... May 21 01:47:11.703738 ip-10-0-136-250 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 01:47:11.703738 ip-10-0-136-250 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 01:47:11.704118 ip-10-0-136-250 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 01:47:11.704118 ip-10-0-136-250 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 01:47:11.704118 ip-10-0-136-250 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 01:47:11.704679 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.704610 2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 01:47:11.712040 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712019 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 01:47:11.712040 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712036 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 01:47:11.712040 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712041 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 01:47:11.712040 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712044 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 01:47:11.712040 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712047 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712050 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712053 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712056 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712059 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712061 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712064 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712067 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712070 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712073 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712075 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712078 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712082 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712085 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712087 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712090 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712093 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712096 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712098 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712101 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 01:47:11.712215 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712103 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712106 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712108 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712111 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712113 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712116 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712127 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712130 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712133 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712135 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712138 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712140 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712143 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712146 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712150 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712154 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712157 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712160 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712163 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 01:47:11.712702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712166 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712169 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712171 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712177 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712180 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712182 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712184 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712187 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712190 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712192 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712195 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712197 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712200 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712202 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712205 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712208 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712211 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712213 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712216 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712219 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 01:47:11.713180 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712221 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712224 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712227 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712229 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712232 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712235 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712237 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712242 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712246 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712250 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712270 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712272 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712275 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712278 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712281 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712284 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712287 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712290 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712292 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 01:47:11.713722 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712295 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712298 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712300 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712303 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712656 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712661 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712664 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712667 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712669 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712672 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712675 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712678 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712680 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712683 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712685 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712688 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712692 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712696 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712699 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 01:47:11.714171 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712701 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712704 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712707 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712710 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712713 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712716 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712718 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712721 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712723 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712727 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712729 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712732 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712734 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712737 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712740 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712742 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712745 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712748 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712750 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712753 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 01:47:11.714640 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712756 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712759 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712762 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712764 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712767 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712769 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712772 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712774 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712776 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712780 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712782 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712785 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712788 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712792 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712795 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712799 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712802 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712804 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712808 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 01:47:11.715122 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712810 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712813 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712816 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712819 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712821 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712824 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712826 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712828 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712831 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712833 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712836 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712838 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712841 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712843 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712845 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712848 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712850 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712853 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712856 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712859 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 01:47:11.715604 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712862 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712864 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712867 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712870 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712872 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712875 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712877 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712880 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712882 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712885 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712887 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.712890 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713619 2562 flags.go:64] FLAG: --address="0.0.0.0" May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713628 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713634 2562 flags.go:64] FLAG: --anonymous-auth="true" May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713639 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713643 2562 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713647 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713651 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713655 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713658 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 01:47:11.716112 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713661 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713665 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713669 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713672 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713675 2562 flags.go:64] FLAG: --cgroup-root="" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713677 2562 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713681 2562 flags.go:64] FLAG: --client-ca-file="" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713684 2562 flags.go:64] FLAG: --cloud-config="" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713686 2562 flags.go:64] FLAG: --cloud-provider="external" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713690 2562 flags.go:64] FLAG: --cluster-dns="[]" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713694 2562 flags.go:64] FLAG: --cluster-domain="" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713697 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713700 2562 flags.go:64] FLAG: --config-dir="" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713703 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713706 2562 flags.go:64] FLAG: --container-log-max-files="5" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713710 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713713 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713716 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713720 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713723 2562 flags.go:64] FLAG: --contention-profiling="false" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713726 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713729 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713732 2562 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713735 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713739 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 01:47:11.716639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713742 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713745 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713748 2562 flags.go:64] FLAG: --enable-load-reader="false" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713752 2562 flags.go:64] FLAG: --enable-server="true" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713755 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713759 2562 flags.go:64] FLAG: --event-burst="100" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713762 2562 flags.go:64] FLAG: --event-qps="50" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713765 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713768 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713771 2562 flags.go:64] FLAG: --eviction-hard="" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713775 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713778 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713781 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713784 2562 flags.go:64] FLAG: --eviction-soft="" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713787 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713790 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713793 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713796 2562 flags.go:64] FLAG: --experimental-mounter-path="" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713799 2562 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713802 2562 flags.go:64] FLAG: --fail-swap-on="true" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713805 2562 flags.go:64] FLAG: --feature-gates="" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713809 2562 flags.go:64] FLAG: --file-check-frequency="20s" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713812 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713815 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713818 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713821 2562 flags.go:64] FLAG: --healthz-port="10248" May 21 01:47:11.717233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713824 2562 flags.go:64] FLAG: --help="false" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713827 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-136-250.ec2.internal" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713830 2562 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713840 2562 flags.go:64] FLAG: --http-check-frequency="20s" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713843 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713847 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713851 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713854 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713857 2562 flags.go:64] FLAG: --image-service-endpoint="" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713860 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713863 2562 flags.go:64] FLAG: --kube-api-burst="100" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713866 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713869 2562 flags.go:64] FLAG: --kube-api-qps="50" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713872 2562 flags.go:64] FLAG: --kube-reserved="" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713876 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713878 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713882 2562 flags.go:64] FLAG: --kubelet-cgroups="" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713885 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713888 2562 flags.go:64] FLAG: --lock-file="" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713890 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713893 2562 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713896 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713901 2562 flags.go:64] FLAG: --log-json-split-stream="false" May 21 01:47:11.717880 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713905 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713908 2562 flags.go:64] FLAG: --log-text-split-stream="false" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713911 2562 flags.go:64] FLAG: --logging-format="text" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713914 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713917 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713920 2562 flags.go:64] FLAG: --manifest-url="" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713923 2562 flags.go:64] FLAG: --manifest-url-header="" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713927 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713930 2562 flags.go:64] FLAG: --max-open-files="1000000" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713934 2562 flags.go:64] FLAG: --max-pods="110" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713938 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713940 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713943 2562 flags.go:64] FLAG: --memory-manager-policy="None" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713946 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713949 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713953 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713956 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713962 2562 flags.go:64] FLAG: --node-status-max-images="50" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713965 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713968 2562 flags.go:64] FLAG: --oom-score-adj="-999" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713971 2562 flags.go:64] FLAG: --pod-cidr="" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713975 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713979 2562 flags.go:64] FLAG: --pod-manifest-path="" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713986 2562 flags.go:64] FLAG: --pod-max-pids="-1" May 21 01:47:11.718484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713989 2562 flags.go:64] FLAG: --pods-per-core="0" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713992 2562 flags.go:64] FLAG: --port="10250" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713995 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.713998 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0de4f529b5b31309c" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714001 2562 flags.go:64] FLAG: --qos-reserved="" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714004 2562 flags.go:64] FLAG: --read-only-port="10255" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714006 2562 flags.go:64] FLAG: --register-node="true" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714011 2562 flags.go:64] FLAG: --register-schedulable="true" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714014 2562 flags.go:64] FLAG: --register-with-taints="" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714017 2562 flags.go:64] FLAG: --registry-burst="10" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714020 2562 flags.go:64] FLAG: --registry-qps="5" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714023 2562 flags.go:64] FLAG: --reserved-cpus="" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714026 2562 flags.go:64] FLAG: --reserved-memory="" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714034 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714037 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714040 2562 flags.go:64] FLAG: --rotate-certificates="false" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714043 2562 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714045 2562 flags.go:64] FLAG: --runonce="false" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714048 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714051 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714054 2562 flags.go:64] FLAG: --seccomp-default="false" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714057 2562 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714060 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714062 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714065 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714068 2562 flags.go:64] FLAG: --storage-driver-password="root" May 21 01:47:11.719064 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714071 2562 flags.go:64] FLAG: --storage-driver-secure="false" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714074 2562 flags.go:64] FLAG: --storage-driver-table="stats" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714077 2562 flags.go:64] FLAG: --storage-driver-user="root" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714080 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714083 2562 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714088 2562 flags.go:64] FLAG: --system-cgroups="" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714090 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714096 2562 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714099 2562 flags.go:64] FLAG: --tls-cert-file="" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714102 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714105 2562 flags.go:64] FLAG: --tls-min-version="" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714108 2562 flags.go:64] FLAG: --tls-private-key-file="" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714111 2562 flags.go:64] FLAG: --topology-manager-policy="none" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714115 2562 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714118 2562 flags.go:64] FLAG: --topology-manager-scope="container" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714121 2562 flags.go:64] FLAG: --v="2" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714125 2562 flags.go:64] FLAG: --version="false" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714129 2562 flags.go:64] FLAG: --vmodule="" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714133 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.714136 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714219 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714222 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714226 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714228 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 01:47:11.719691 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714232 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714235 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714238 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714240 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714243 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714246 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714249 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714251 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714265 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714268 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714271 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714273 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714277 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714281 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714285 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714288 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714291 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714293 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714296 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714298 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 01:47:11.720305 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714301 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714304 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714307 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714309 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714312 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714314 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714317 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714319 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714322 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714325 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714328 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714330 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714333 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714335 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714338 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714341 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714343 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714346 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714348 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714351 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 01:47:11.720804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714354 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714356 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714358 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714361 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714364 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714368 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714371 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714373 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714376 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714378 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714381 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714383 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714387 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714391 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714394 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714397 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714400 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714403 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714405 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714408 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 01:47:11.721320 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714411 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714413 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714416 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714419 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714421 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714424 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714427 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714429 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714431 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714434 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714436 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714439 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714442 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714444 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714447 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714449 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714452 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714456 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714459 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 01:47:11.721804 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714462 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714464 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.714467 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.715324 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.721377 2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.721466 2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721513 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721517 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721521 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721524 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721527 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721530 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721534 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721537 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721540 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721542 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 01:47:11.722276 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721545 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721548 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721551 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721554 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721556 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721559 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721562 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721564 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721567 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721569 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721572 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721575 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721578 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721580 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721582 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721586 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721588 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721591 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721594 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 01:47:11.722674 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721598 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721601 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721606 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721610 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721613 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721616 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721618 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721621 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721624 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721626 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721629 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721631 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721634 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721638 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721640 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721643 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721645 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721648 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721650 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 01:47:11.723129 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721653 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721655 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721657 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721660 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721663 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721665 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721668 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721670 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721673 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721675 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721678 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721681 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721683 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721686 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721689 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721692 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721695 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721698 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721700 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721703 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 01:47:11.723634 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721705 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721708 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721710 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721713 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721715 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721718 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721720 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721722 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721725 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721727 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721730 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721732 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721735 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721737 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721740 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721742 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721745 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 01:47:11.724126 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721747 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.721752 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721853 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721857 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721860 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721863 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721866 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721869 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721872 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721874 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721877 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721879 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721882 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721885 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721887 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721890 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 01:47:11.724549 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721892 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721895 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721897 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721900 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721902 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721905 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721907 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721909 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721912 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721914 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721917 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721919 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721922 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721924 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721927 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721929 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721931 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721934 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721937 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721939 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 01:47:11.724979 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721941 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721944 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721948 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721951 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721954 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721957 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721960 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721963 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721965 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721968 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721971 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721975 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721977 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721980 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721982 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721984 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721987 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721989 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721992 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 01:47:11.725481 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721994 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721997 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.721999 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722002 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722004 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722006 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722009 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722011 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722014 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722016 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722019 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722021 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722023 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722026 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722028 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722031 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722033 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722036 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722039 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722041 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 01:47:11.725940 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722044 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722046 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722049 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722051 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722054 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722056 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722059 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722061 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722064 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722066 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722069 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722071 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:11.722074 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.722078 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.722824 2562 server.go:962] "Client rotation is on, will bootstrap in background" May 21 01:47:11.726535 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.725735 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 01:47:11.726899 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.726768 2562 server.go:1019] "Starting client certificate rotation" May 21 01:47:11.726899 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.726863 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 01:47:11.726899 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.726896 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 01:47:11.757182 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.757168 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 01:47:11.759811 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.759796 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 01:47:11.772144 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.772126 2562 log.go:25] "Validated CRI v1 runtime API" May 21 01:47:11.778906 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.778883 2562 log.go:25] "Validated CRI v1 image API" May 21 01:47:11.781149 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.781127 2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 01:47:11.785457 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.785433 2562 fs.go:135] Filesystem UUIDs: map[73519a73-01b2-464a-88f4-17b3b749930f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f38dd5d5-38e3-426c-84fa-51e5961cd06f:/dev/nvme0n1p3] May 21 01:47:11.785528 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.785457 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 01:47:11.789893 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.789767 2562 manager.go:217] Machine: {Timestamp:2026-05-21 01:47:11.789291067 +0000 UTC m=+0.466066804 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097698 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20559192047c57b427a405e34b0940 SystemUUID:ec205591-9204-7c57-b427-a405e34b0940 BootID:190b3841-f8d5-4e46-aa97-3438b07b1687 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:37:99:a7:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:37:99:a7:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:3f:ac:1b:6f:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 01:47:11.789893 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.789880 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 01:47:11.790048 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.789970 2562 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 01:47:11.791024 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.791005 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 01:47:11.792063 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.792036 2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 01:47:11.792189 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.792065 2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 01:47:11.792233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.792198 2562 topology_manager.go:138] "Creating topology manager with none policy" May 21 01:47:11.792233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.792206 2562 container_manager_linux.go:306] "Creating device plugin manager" May 21 01:47:11.792233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.792213 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 01:47:11.792233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.792228 2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 01:47:11.794570 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.794558 2562 state_mem.go:36] "Initialized new in-memory state store" May 21 01:47:11.794675 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.794665 2562 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 01:47:11.797430 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.797422 2562 kubelet.go:491] "Attempting to sync node with API server" May 21 01:47:11.797462 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.797434 2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 01:47:11.798053 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.798044 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 01:47:11.798088 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.798057 2562 kubelet.go:397] "Adding apiserver pod source" May 21 01:47:11.798088 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.798066 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 01:47:11.799398 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.799383 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 01:47:11.799458 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.799409 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 01:47:11.802991 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.802976 2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 01:47:11.805286 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.805272 2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 01:47:11.806210 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806197 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 01:47:11.806276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806219 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 01:47:11.806276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806227 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 01:47:11.806276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806232 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 01:47:11.806276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806239 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 01:47:11.806276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806245 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 01:47:11.806276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806250 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 01:47:11.806276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806268 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 01:47:11.806466 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806286 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 01:47:11.806466 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806292 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 01:47:11.806466 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806304 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 01:47:11.806729 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.806721 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 01:47:11.807766 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.807754 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 01:47:11.807766 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.807764 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 01:47:11.810405 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.810382 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 01:47:11.810486 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.810423 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 01:47:11.810795 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.810783 2562 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 01:47:11.810828 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.810819 2562 server.go:1295] "Started kubelet" May 21 01:47:11.810931 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.810900 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 01:47:11.811217 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.811126 2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 01:47:11.811357 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.811342 2562 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 01:47:11.811589 ip-10-0-136-250 systemd[1]: Started Kubernetes Kubelet. May 21 01:47:11.812823 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.812796 2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 01:47:11.814108 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.814092 2562 server.go:317] "Adding debug handlers to kubelet server" May 21 01:47:11.821423 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.821405 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 01:47:11.821508 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.821424 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 01:47:11.821561 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.821527 2562 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 01:47:11.821561 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.821542 2562 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 01:47:11.821660 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.821624 2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 01:47:11.821928 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.821796 2562 reconstruct.go:97] "Volume reconstruction finished" May 21 01:47:11.821928 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.821815 2562 reconciler.go:26] "Reconciler: start to sync state" May 21 01:47:11.823774 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.823759 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:11.824576 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.819939 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-250.ec2.internal.18b1716aeafa3ab6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-250.ec2.internal,UID:ip-10-0-136-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-250.ec2.internal,},FirstTimestamp:2026-05-21 01:47:11.810796214 +0000 UTC m=+0.487571950,LastTimestamp:2026-05-21 01:47:11.810796214 +0000 UTC m=+0.487571950,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-250.ec2.internal,}" May 21 01:47:11.825476 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.825451 2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 01:47:11.825620 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.825562 2562 factory.go:153] Registering CRI-O factory May 21 01:47:11.825696 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.825625 2562 factory.go:223] Registration of the crio container factory successfully May 21 01:47:11.825696 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.825676 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 01:47:11.825696 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.825684 2562 factory.go:55] Registering systemd factory May 21 01:47:11.825696 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.825693 2562 factory.go:223] Registration of the systemd container factory successfully May 21 01:47:11.825894 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.825708 2562 factory.go:103] Registering Raw factory May 21 01:47:11.825894 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.825720 2562 manager.go:1196] Started watching for new ooms in manager May 21 01:47:11.826155 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.826138 2562 manager.go:319] Starting recovery of all containers May 21 01:47:11.827588 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.827560 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 01:47:11.827872 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.827853 2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 01:47:11.827943 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.827867 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 01:47:11.830241 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.830213 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xh4q" May 21 01:47:11.836746 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.836730 2562 manager.go:324] Recovery completed May 21 01:47:11.839363 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.839347 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xh4q" May 21 01:47:11.841144 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.841128 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 01:47:11.842774 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.842759 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" May 21 01:47:11.842842 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.842789 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" May 21 01:47:11.842842 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.842803 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" May 21 01:47:11.843324 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.843307 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 01:47:11.843324 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.843323 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 01:47:11.843417 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.843350 2562 state_mem.go:36] "Initialized new in-memory state store" May 21 01:47:11.844565 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.844508 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-250.ec2.internal.18b1716aece226f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-250.ec2.internal,UID:ip-10-0-136-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-250.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-250.ec2.internal,},FirstTimestamp:2026-05-21 01:47:11.842772729 +0000 UTC m=+0.519548466,LastTimestamp:2026-05-21 01:47:11.842772729 +0000 UTC m=+0.519548466,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-250.ec2.internal,}" May 21 01:47:11.847320 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.847303 2562 policy_none.go:49] "None policy: Start" May 21 01:47:11.847320 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.847319 2562 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 01:47:11.847421 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.847329 2562 state_mem.go:35] "Initializing new in-memory state store" May 21 01:47:11.882790 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.882774 2562 manager.go:341] "Starting Device Plugin manager" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.882834 2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.882848 2562 server.go:85] "Starting device plugin registration server" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.883076 2562 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.883089 2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.883186 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.883271 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.883301 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.883676 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.883710 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.892543 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.893583 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.894272 2562 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.894300 2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.894311 2562 kubelet.go:2451] "Starting kubelet main sync loop" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.894358 2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 01:47:11.909360 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.896280 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 01:47:11.983392 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.983340 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 01:47:11.984155 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.984140 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" May 21 01:47:11.984237 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.984168 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" May 21 01:47:11.984237 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.984180 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" May 21 01:47:11.984237 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.984199 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-250.ec2.internal" May 21 01:47:11.992863 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.992848 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-250.ec2.internal" May 21 01:47:11.992905 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:11.992871 2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-250.ec2.internal\": node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:11.994998 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.994982 2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal"] May 21 01:47:11.995046 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.995037 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 01:47:11.995813 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.995796 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" May 21 01:47:11.995873 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.995828 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" May 21 01:47:11.995873 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.995838 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" May 21 01:47:11.998425 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.998404 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 01:47:11.998585 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.998553 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" May 21 01:47:11.998938 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.998925 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 01:47:11.999417 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.999401 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" May 21 01:47:11.999494 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.999427 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" May 21 01:47:11.999494 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.999403 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" May 21 01:47:11.999494 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.999459 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" May 21 01:47:11.999494 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.999469 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" May 21 01:47:11.999630 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:11.999438 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" May 21 01:47:12.001722 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.001707 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" May 21 01:47:12.001797 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.001732 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 01:47:12.002368 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.002350 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" May 21 01:47:12.002458 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.002383 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" May 21 01:47:12.002458 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.002400 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" May 21 01:47:12.018950 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.018935 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.022925 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.022909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ff51d37359e6e6b6ad59d1d313d5818-config\") pod \"kube-apiserver-proxy-ip-10-0-136-250.ec2.internal\" (UID: \"9ff51d37359e6e6b6ad59d1d313d5818\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" May 21 01:47:12.023001 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.022937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f4d0d564f2a56568222b3d7dd9c6173d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"f4d0d564f2a56568222b3d7dd9c6173d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" May 21 01:47:12.023001 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.022963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4d0d564f2a56568222b3d7dd9c6173d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"f4d0d564f2a56568222b3d7dd9c6173d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" May 21 01:47:12.034865 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.034843 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-250.ec2.internal\" not found" node="ip-10-0-136-250.ec2.internal" May 21 01:47:12.038940 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.038926 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-250.ec2.internal\" not found" node="ip-10-0-136-250.ec2.internal" May 21 01:47:12.119109 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.119095 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.123332 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.123319 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f4d0d564f2a56568222b3d7dd9c6173d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"f4d0d564f2a56568222b3d7dd9c6173d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" May 21 01:47:12.123404 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.123342 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4d0d564f2a56568222b3d7dd9c6173d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"f4d0d564f2a56568222b3d7dd9c6173d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" May 21 01:47:12.123404 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.123359 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ff51d37359e6e6b6ad59d1d313d5818-config\") pod \"kube-apiserver-proxy-ip-10-0-136-250.ec2.internal\" (UID: \"9ff51d37359e6e6b6ad59d1d313d5818\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" May 21 01:47:12.123404 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.123395 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ff51d37359e6e6b6ad59d1d313d5818-config\") pod \"kube-apiserver-proxy-ip-10-0-136-250.ec2.internal\" (UID: \"9ff51d37359e6e6b6ad59d1d313d5818\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" May 21 01:47:12.123499 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.123418 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f4d0d564f2a56568222b3d7dd9c6173d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"f4d0d564f2a56568222b3d7dd9c6173d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" May 21 01:47:12.123499 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.123430 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4d0d564f2a56568222b3d7dd9c6173d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"f4d0d564f2a56568222b3d7dd9c6173d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" May 21 01:47:12.219500 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.219466 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.320236 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.320189 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.338629 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.338608 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" May 21 01:47:12.342300 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.342283 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" May 21 01:47:12.420616 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.420592 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.521041 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.521016 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.621460 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.621413 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.721850 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.721826 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.727197 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.727165 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 01:47:12.727341 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.727324 2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 01:47:12.821790 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.821755 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 01:47:12.822204 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.822185 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.841268 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.841241 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 01:47:12.841348 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.841318 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 01:42:11 +0000 UTC" deadline="2027-12-26 22:29:26.657394256 +0000 UTC" May 21 01:47:12.841348 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.841341 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14036h42m13.816055362s" May 21 01:47:12.857303 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.857280 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2kwfh" May 21 01:47:12.861214 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:12.861190 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d0d564f2a56568222b3d7dd9c6173d.slice/crio-657e7dc1acb8195ff5612773a4a1cf2ea3c60fcd8f7f593210a8479071e86f21 WatchSource:0}: Error finding container 657e7dc1acb8195ff5612773a4a1cf2ea3c60fcd8f7f593210a8479071e86f21: Status 404 returned error can't find the container with id 657e7dc1acb8195ff5612773a4a1cf2ea3c60fcd8f7f593210a8479071e86f21 May 21 01:47:12.861492 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:12.861468 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff51d37359e6e6b6ad59d1d313d5818.slice/crio-dd1b3f3b575922cb4c213fd525fbdbcb3d3ab71d11b9836ff69f0190cd252b7a WatchSource:0}: Error finding container dd1b3f3b575922cb4c213fd525fbdbcb3d3ab71d11b9836ff69f0190cd252b7a: Status 404 returned error can't find the container with id dd1b3f3b575922cb4c213fd525fbdbcb3d3ab71d11b9836ff69f0190cd252b7a May 21 01:47:12.864343 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.864297 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2kwfh" May 21 01:47:12.864763 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.864747 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 01:47:12.897369 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.897303 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" event={"ID":"f4d0d564f2a56568222b3d7dd9c6173d","Type":"ContainerStarted","Data":"657e7dc1acb8195ff5612773a4a1cf2ea3c60fcd8f7f593210a8479071e86f21"} May 21 01:47:12.898141 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.898122 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" event={"ID":"9ff51d37359e6e6b6ad59d1d313d5818","Type":"ContainerStarted","Data":"dd1b3f3b575922cb4c213fd525fbdbcb3d3ab71d11b9836ff69f0190cd252b7a"} May 21 01:47:12.922311 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:12.922293 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:12.976175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:12.976159 2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 01:47:13.022411 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:13.022390 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:13.043025 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.043006 2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 01:47:13.123166 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:13.123145 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:13.223612 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:13.223559 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" May 21 01:47:13.231142 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.231121 2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 01:47:13.322602 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.322573 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" May 21 01:47:13.335306 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.335284 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 01:47:13.336707 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.336510 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" May 21 01:47:13.344444 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.344425 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 01:47:13.781814 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.781784 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 01:47:13.798867 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.798844 2562 apiserver.go:52] "Watching apiserver" May 21 01:47:13.806400 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.806374 2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 01:47:13.807694 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.807666 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-b7rnz","openshift-multus/multus-c52gm","openshift-network-operator/iptables-alerter-zjlx4","openshift-ovn-kubernetes/ovnkube-node-p285b","kube-system/konnectivity-agent-nkqd4","kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5","openshift-cluster-node-tuning-operator/tuned-m8n8p","openshift-dns/node-resolver-bjxff","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal","openshift-multus/network-metrics-daemon-zspbw","openshift-network-diagnostics/network-check-target-6mcwq","openshift-image-registry/node-ca-wgpnr"] May 21 01:47:13.810269 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.810236 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.812705 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.812373 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c52gm" May 21 01:47:13.813203 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.812992 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 01:47:13.813203 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.813026 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 01:47:13.813203 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.813026 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 01:47:13.813687 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.813656 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mdkkf\"" May 21 01:47:13.814604 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.814575 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 01:47:13.814766 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.814698 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.814939 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.814917 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 01:47:13.815032 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.814968 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 01:47:13.815383 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.815219 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 01:47:13.816041 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.816020 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhdzl\"" May 21 01:47:13.816951 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.816894 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 01:47:13.817812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.817194 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 01:47:13.817812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.817590 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 01:47:13.817812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.817772 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dxvp2\"" May 21 01:47:13.819869 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.819849 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.819943 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.819892 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:13.822421 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.822176 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 01:47:13.822579 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.822328 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.822670 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.822395 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sxmmq\"" May 21 01:47:13.822670 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.822395 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 01:47:13.823843 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.823616 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 01:47:13.823843 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.823625 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 01:47:13.823843 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.823674 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z68sv\"" May 21 01:47:13.823843 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.823679 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 01:47:13.823843 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.823626 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 01:47:13.823843 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.823728 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 01:47:13.823843 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.823683 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 01:47:13.824773 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.824754 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 01:47:13.824946 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.824933 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 01:47:13.825000 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.824959 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kfshk\"" May 21 01:47:13.825723 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.825704 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.828211 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.827947 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 01:47:13.828211 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.827977 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bjxff" May 21 01:47:13.828211 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.828069 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 01:47:13.828211 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.828082 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrjsj\"" May 21 01:47:13.830376 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.830359 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 01:47:13.830521 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.830507 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xk5qj\"" May 21 01:47:13.830635 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.830364 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 01:47:13.832608 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7e39fc-84d1-4096-970c-2215e2b4c3fe-cni-binary-copy\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.832698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-run-k8s-cni-cncf-io\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.832698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-conf-dir\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.832698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-kubelet\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.832698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-slash\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.832895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832706 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-system-cni-dir\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.832895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-registration-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.832895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832772 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:13.832895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-run-ovn\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.832895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-node-log\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.832895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-log-socket\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.832895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-cnibin\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.832895 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:13.832838 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:13.832895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/365078df-0ea9-49f4-a965-d444e88d9046-cni-binary-copy\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832895 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7dh\" (UniqueName: \"kubernetes.io/projected/be7e39fc-84d1-4096-970c-2215e2b4c3fe-kube-api-access-sb7dh\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj49m\" (UniqueName: \"kubernetes.io/projected/1696709a-c17b-4d1f-a156-8bca1c668589-kube-api-access-bj49m\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:13.832969 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.832993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-socket-dir-parent\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-var-lib-cni-bin\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-hostroot\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1696709a-c17b-4d1f-a156-8bca1c668589-ovnkube-config\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f29962f2-67c8-411b-87c2-a3950a8a189f-konnectivity-ca\") pod \"konnectivity-agent-nkqd4\" (UID: \"f29962f2-67c8-411b-87c2-a3950a8a189f\") " pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-socket-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-system-cni-dir\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833197 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-var-lib-cni-multus\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-run-ovn-kubernetes\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.833339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-var-lib-openvswitch\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-cni-netd\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1696709a-c17b-4d1f-a156-8bca1c668589-ovn-node-metrics-cert\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1696709a-c17b-4d1f-a156-8bca1c668589-ovnkube-script-lib\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833429 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/365078df-0ea9-49f4-a965-d444e88d9046-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-cnibin\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-var-lib-kubelet\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d04bd9da-ce17-432c-8d3f-fdd80d1130ca-iptables-alerter-script\") pod \"iptables-alerter-zjlx4\" (UID: \"d04bd9da-ce17-432c-8d3f-fdd80d1130ca\") " pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833530 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-run-netns\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2p57\" (UniqueName: \"kubernetes.io/projected/365078df-0ea9-49f4-a965-d444e88d9046-kube-api-access-h2p57\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-etc-selinux\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-cni-bin\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-run-multus-certs\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zphfr\" (UniqueName: \"kubernetes.io/projected/d04bd9da-ce17-432c-8d3f-fdd80d1130ca-kube-api-access-zphfr\") pod \"iptables-alerter-zjlx4\" (UID: \"d04bd9da-ce17-432c-8d3f-fdd80d1130ca\") " pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-systemd-units\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f29962f2-67c8-411b-87c2-a3950a8a189f-agent-certs\") pod \"konnectivity-agent-nkqd4\" (UID: \"f29962f2-67c8-411b-87c2-a3950a8a189f\") " pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:13.834034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-run-netns\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-etc-openvswitch\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833777 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-os-release\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833831 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d04bd9da-ce17-432c-8d3f-fdd80d1130ca-host-slash\") pod \"iptables-alerter-zjlx4\" (UID: \"d04bd9da-ce17-432c-8d3f-fdd80d1130ca\") " pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-device-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-sys-fs\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klv2s\" (UniqueName: \"kubernetes.io/projected/831b0097-02d1-4335-94ac-31b7929e0df1-kube-api-access-klv2s\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1696709a-c17b-4d1f-a156-8bca1c668589-env-overrides\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-cni-dir\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-os-release\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.833968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/365078df-0ea9-49f4-a965-d444e88d9046-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.834015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-daemon-config\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.834051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-etc-kubernetes\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.834118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-run-systemd\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.834161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-run-openvswitch\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.834812 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.834207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.835575 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.835184 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:13.837470 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.837449 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 01:47:13.837697 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.837574 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 01:47:13.837697 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.837643 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gnnmk\"" May 21 01:47:13.837697 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.837676 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 01:47:13.865264 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.865226 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 01:42:12 +0000 UTC" deadline="2028-01-22 13:25:10.361569756 +0000 UTC" May 21 01:47:13.865344 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.865265 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14675h37m56.496321394s" May 21 01:47:13.922657 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.922637 2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 01:47:13.934427 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e42179a-8792-4a3b-80eb-e63a5a16ace9-tmp-dir\") pod \"node-resolver-bjxff\" (UID: \"8e42179a-8792-4a3b-80eb-e63a5a16ace9\") " pod="openshift-dns/node-resolver-bjxff" May 21 01:47:13.934524 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn6qc\" (UniqueName: \"kubernetes.io/projected/81894662-3585-4174-aa1a-a1d0343177b4-kube-api-access-nn6qc\") pod \"node-ca-wgpnr\" (UID: \"81894662-3585-4174-aa1a-a1d0343177b4\") " pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:13.934524 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-modprobe-d\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.934605 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-run\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.934605 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934561 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1696709a-c17b-4d1f-a156-8bca1c668589-env-overrides\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.934605 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934578 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-cni-dir\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.934605 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-lib-modules\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.934778 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:13.934778 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934623 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-os-release\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.934778 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934639 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/365078df-0ea9-49f4-a965-d444e88d9046-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.934778 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934680 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-daemon-config\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.934778 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934716 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-etc-kubernetes\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.934778 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934734 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-run-systemd\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.934778 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934686 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-cni-dir\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.934778 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934749 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-run-openvswitch\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.934778 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-os-release\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934789 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934806 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7e39fc-84d1-4096-970c-2215e2b4c3fe-cni-binary-copy\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-etc-kubernetes\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-run-systemd\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934877 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-run-k8s-cni-cncf-io\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-run-openvswitch\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934955 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-conf-dir\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.934978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-run-k8s-cni-cncf-io\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-conf-dir\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx4lj\" (UniqueName: \"kubernetes.io/projected/8e42179a-8792-4a3b-80eb-e63a5a16ace9-kube-api-access-vx4lj\") pod \"node-resolver-bjxff\" (UID: \"8e42179a-8792-4a3b-80eb-e63a5a16ace9\") " pod="openshift-dns/node-resolver-bjxff" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81894662-3585-4174-aa1a-a1d0343177b4-serviceca\") pod \"node-ca-wgpnr\" (UID: \"81894662-3585-4174-aa1a-a1d0343177b4\") " pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935090 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-kubelet\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1696709a-c17b-4d1f-a156-8bca1c668589-env-overrides\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935119 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-kubelet\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935120 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-slash\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935166 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-slash\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935194 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935200 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-system-cni-dir\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/365078df-0ea9-49f4-a965-d444e88d9046-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935242 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-registration-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-system-cni-dir\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-systemd\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-registration-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-daemon-config\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-host\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935456 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-run-ovn\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935484 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-node-log\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935528 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-log-socket\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935537 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-run-ovn\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935560 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-cnibin\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935586 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/365078df-0ea9-49f4-a965-d444e88d9046-cni-binary-copy\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-node-log\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935612 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-log-socket\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935619 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7dh\" (UniqueName: \"kubernetes.io/projected/be7e39fc-84d1-4096-970c-2215e2b4c3fe-kube-api-access-sb7dh\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.935977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7e39fc-84d1-4096-970c-2215e2b4c3fe-cni-binary-copy\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935677 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-cnibin\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-tuned\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnd9p\" (UniqueName: \"kubernetes.io/projected/1c6834d1-efc1-4e66-9d81-9fe9a703a274-kube-api-access-cnd9p\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935781 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bj49m\" (UniqueName: \"kubernetes.io/projected/1696709a-c17b-4d1f-a156-8bca1c668589-kube-api-access-bj49m\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935822 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-socket-dir-parent\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935857 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-var-lib-cni-bin\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935876 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-multus-socket-dir-parent\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c6834d1-efc1-4e66-9d81-9fe9a703a274-tmp\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.935971 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-var-lib-cni-bin\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936005 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-hostroot\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936046 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1696709a-c17b-4d1f-a156-8bca1c668589-ovnkube-config\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936050 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-hostroot\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936123 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f29962f2-67c8-411b-87c2-a3950a8a189f-konnectivity-ca\") pod \"konnectivity-agent-nkqd4\" (UID: \"f29962f2-67c8-411b-87c2-a3950a8a189f\") " pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936145 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-socket-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936223 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-system-cni-dir\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-socket-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.936698 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936245 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-var-lib-cni-multus\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936306 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-var-lib-cni-multus\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-system-cni-dir\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/365078df-0ea9-49f4-a965-d444e88d9046-cni-binary-copy\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936317 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-run-ovn-kubernetes\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-run-ovn-kubernetes\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936392 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-sysconfig\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-sysctl-conf\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936495 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-var-lib-openvswitch\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936503 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1696709a-c17b-4d1f-a156-8bca1c668589-ovnkube-config\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936514 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/365078df-0ea9-49f4-a965-d444e88d9046-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936521 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-cni-netd\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936553 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1696709a-c17b-4d1f-a156-8bca1c668589-ovn-node-metrics-cert\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936586 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1696709a-c17b-4d1f-a156-8bca1c668589-ovnkube-script-lib\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936611 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f29962f2-67c8-411b-87c2-a3950a8a189f-konnectivity-ca\") pod \"konnectivity-agent-nkqd4\" (UID: \"f29962f2-67c8-411b-87c2-a3950a8a189f\") " pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:13.937509 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-kubernetes\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-var-lib-openvswitch\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936557 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-cni-netd\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936644 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/365078df-0ea9-49f4-a965-d444e88d9046-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936675 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-cnibin\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936717 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-var-lib-kubelet\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936742 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-cnibin\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936744 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81894662-3585-4174-aa1a-a1d0343177b4-host\") pod \"node-ca-wgpnr\" (UID: \"81894662-3585-4174-aa1a-a1d0343177b4\") " pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-var-lib-kubelet\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936797 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d04bd9da-ce17-432c-8d3f-fdd80d1130ca-iptables-alerter-script\") pod \"iptables-alerter-zjlx4\" (UID: \"d04bd9da-ce17-432c-8d3f-fdd80d1130ca\") " pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936826 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-run-netns\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936853 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2p57\" (UniqueName: \"kubernetes.io/projected/365078df-0ea9-49f4-a965-d444e88d9046-kube-api-access-h2p57\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936873 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-run-netns\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-etc-selinux\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.936881 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-etc-selinux\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937005 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-cni-bin\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937033 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-run-multus-certs\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.938234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e42179a-8792-4a3b-80eb-e63a5a16ace9-hosts-file\") pod \"node-resolver-bjxff\" (UID: \"8e42179a-8792-4a3b-80eb-e63a5a16ace9\") " pod="openshift-dns/node-resolver-bjxff" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-sys\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1696709a-c17b-4d1f-a156-8bca1c668589-ovnkube-script-lib\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937107 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zphfr\" (UniqueName: \"kubernetes.io/projected/d04bd9da-ce17-432c-8d3f-fdd80d1130ca-kube-api-access-zphfr\") pod \"iptables-alerter-zjlx4\" (UID: \"d04bd9da-ce17-432c-8d3f-fdd80d1130ca\") " pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-run-multus-certs\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937191 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-systemd-units\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937223 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f29962f2-67c8-411b-87c2-a3950a8a189f-agent-certs\") pod \"konnectivity-agent-nkqd4\" (UID: \"f29962f2-67c8-411b-87c2-a3950a8a189f\") " pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937248 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-run-netns\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-var-lib-kubelet\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/365078df-0ea9-49f4-a965-d444e88d9046-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937312 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d04bd9da-ce17-432c-8d3f-fdd80d1130ca-iptables-alerter-script\") pod \"iptables-alerter-zjlx4\" (UID: \"d04bd9da-ce17-432c-8d3f-fdd80d1130ca\") " pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j2s8\" (UniqueName: \"kubernetes.io/projected/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-kube-api-access-2j2s8\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937354 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-etc-openvswitch\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-systemd-units\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937384 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-host-run-netns\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937414 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-os-release\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.939015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937436 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937359 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-host-cni-bin\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-sysctl-d\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937453 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1696709a-c17b-4d1f-a156-8bca1c668589-etc-openvswitch\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937490 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d04bd9da-ce17-432c-8d3f-fdd80d1130ca-host-slash\") pod \"iptables-alerter-zjlx4\" (UID: \"d04bd9da-ce17-432c-8d3f-fdd80d1130ca\") " pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be7e39fc-84d1-4096-970c-2215e2b4c3fe-os-release\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937516 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-device-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937540 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-sys-fs\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d04bd9da-ce17-432c-8d3f-fdd80d1130ca-host-slash\") pod \"iptables-alerter-zjlx4\" (UID: \"d04bd9da-ce17-432c-8d3f-fdd80d1130ca\") " pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937566 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klv2s\" (UniqueName: \"kubernetes.io/projected/831b0097-02d1-4335-94ac-31b7929e0df1-kube-api-access-klv2s\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937586 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-device-dir\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.939734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.937628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/831b0097-02d1-4335-94ac-31b7929e0df1-sys-fs\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.940030 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.939867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1696709a-c17b-4d1f-a156-8bca1c668589-ovn-node-metrics-cert\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.940030 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.939901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f29962f2-67c8-411b-87c2-a3950a8a189f-agent-certs\") pod \"konnectivity-agent-nkqd4\" (UID: \"f29962f2-67c8-411b-87c2-a3950a8a189f\") " pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:13.946241 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.946215 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zphfr\" (UniqueName: \"kubernetes.io/projected/d04bd9da-ce17-432c-8d3f-fdd80d1130ca-kube-api-access-zphfr\") pod \"iptables-alerter-zjlx4\" (UID: \"d04bd9da-ce17-432c-8d3f-fdd80d1130ca\") " pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:13.946368 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.946354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj49m\" (UniqueName: \"kubernetes.io/projected/1696709a-c17b-4d1f-a156-8bca1c668589-kube-api-access-bj49m\") pod \"ovnkube-node-p285b\" (UID: \"1696709a-c17b-4d1f-a156-8bca1c668589\") " pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:13.946958 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.946933 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7dh\" (UniqueName: \"kubernetes.io/projected/be7e39fc-84d1-4096-970c-2215e2b4c3fe-kube-api-access-sb7dh\") pod \"multus-c52gm\" (UID: \"be7e39fc-84d1-4096-970c-2215e2b4c3fe\") " pod="openshift-multus/multus-c52gm" May 21 01:47:13.947039 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.947002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klv2s\" (UniqueName: \"kubernetes.io/projected/831b0097-02d1-4335-94ac-31b7929e0df1-kube-api-access-klv2s\") pod \"aws-ebs-csi-driver-node-2cjw5\" (UID: \"831b0097-02d1-4335-94ac-31b7929e0df1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:13.947093 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:13.947034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2p57\" (UniqueName: \"kubernetes.io/projected/365078df-0ea9-49f4-a965-d444e88d9046-kube-api-access-h2p57\") pod \"multus-additional-cni-plugins-b7rnz\" (UID: \"365078df-0ea9-49f4-a965-d444e88d9046\") " pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:14.038241 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038143 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e42179a-8792-4a3b-80eb-e63a5a16ace9-hosts-file\") pod \"node-resolver-bjxff\" (UID: \"8e42179a-8792-4a3b-80eb-e63a5a16ace9\") " pod="openshift-dns/node-resolver-bjxff" May 21 01:47:14.038241 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038180 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-sys\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.038241 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038203 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-var-lib-kubelet\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.038241 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038227 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2j2s8\" (UniqueName: \"kubernetes.io/projected/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-kube-api-access-2j2s8\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038266 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-sysctl-d\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038281 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e42179a-8792-4a3b-80eb-e63a5a16ace9-hosts-file\") pod \"node-resolver-bjxff\" (UID: \"8e42179a-8792-4a3b-80eb-e63a5a16ace9\") " pod="openshift-dns/node-resolver-bjxff" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-sys\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038291 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e42179a-8792-4a3b-80eb-e63a5a16ace9-tmp-dir\") pod \"node-resolver-bjxff\" (UID: \"8e42179a-8792-4a3b-80eb-e63a5a16ace9\") " pod="openshift-dns/node-resolver-bjxff" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-var-lib-kubelet\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038336 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nn6qc\" (UniqueName: \"kubernetes.io/projected/81894662-3585-4174-aa1a-a1d0343177b4-kube-api-access-nn6qc\") pod \"node-ca-wgpnr\" (UID: \"81894662-3585-4174-aa1a-a1d0343177b4\") " pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038363 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-modprobe-d\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038387 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-run\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038413 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-lib-modules\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038444 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-sysctl-d\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038436 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038508 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vx4lj\" (UniqueName: \"kubernetes.io/projected/8e42179a-8792-4a3b-80eb-e63a5a16ace9-kube-api-access-vx4lj\") pod \"node-resolver-bjxff\" (UID: \"8e42179a-8792-4a3b-80eb-e63a5a16ace9\") " pod="openshift-dns/node-resolver-bjxff" May 21 01:47:14.038544 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038534 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81894662-3585-4174-aa1a-a1d0343177b4-serviceca\") pod \"node-ca-wgpnr\" (UID: \"81894662-3585-4174-aa1a-a1d0343177b4\") " pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-run\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038562 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-systemd\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038612 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-host\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-lib-modules\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038645 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-tuned\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038673 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnd9p\" (UniqueName: \"kubernetes.io/projected/1c6834d1-efc1-4e66-9d81-9fe9a703a274-kube-api-access-cnd9p\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038682 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-host\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-modprobe-d\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038699 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c6834d1-efc1-4e66-9d81-9fe9a703a274-tmp\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.038718 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038730 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-sysconfig\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038755 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-sysctl-conf\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038755 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-systemd\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.038794 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs podName:0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe nodeName:}" failed. No retries permitted until 2026-05-21 01:47:14.538757422 +0000 UTC m=+3.215533163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs") pod "network-metrics-daemon-zspbw" (UID: "0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-sysconfig\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038827 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:14.039006 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038864 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-kubernetes\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039756 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038894 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81894662-3585-4174-aa1a-a1d0343177b4-host\") pod \"node-ca-wgpnr\" (UID: \"81894662-3585-4174-aa1a-a1d0343177b4\") " pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:14.039756 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038933 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81894662-3585-4174-aa1a-a1d0343177b4-serviceca\") pod \"node-ca-wgpnr\" (UID: \"81894662-3585-4174-aa1a-a1d0343177b4\") " pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:14.039756 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.038963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81894662-3585-4174-aa1a-a1d0343177b4-host\") pod \"node-ca-wgpnr\" (UID: \"81894662-3585-4174-aa1a-a1d0343177b4\") " pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:14.039756 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.039003 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-kubernetes\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039756 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.039087 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-sysctl-conf\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.039756 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.039283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e42179a-8792-4a3b-80eb-e63a5a16ace9-tmp-dir\") pod \"node-resolver-bjxff\" (UID: \"8e42179a-8792-4a3b-80eb-e63a5a16ace9\") " pod="openshift-dns/node-resolver-bjxff" May 21 01:47:14.040860 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.040840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c6834d1-efc1-4e66-9d81-9fe9a703a274-tmp\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.040969 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.040886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c6834d1-efc1-4e66-9d81-9fe9a703a274-etc-tuned\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.045599 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.045579 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn6qc\" (UniqueName: \"kubernetes.io/projected/81894662-3585-4174-aa1a-a1d0343177b4-kube-api-access-nn6qc\") pod \"node-ca-wgpnr\" (UID: \"81894662-3585-4174-aa1a-a1d0343177b4\") " pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:14.048081 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.048061 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 01:47:14.048178 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.048090 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 01:47:14.048178 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.048105 2562 projected.go:194] Error preparing data for projected volume kube-api-access-r5nkt for pod openshift-network-diagnostics/network-check-target-6mcwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:14.048178 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.048162 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt podName:100852ea-cf8a-4319-8cd1-4fc3eb3c418a nodeName:}" failed. No retries permitted until 2026-05-21 01:47:14.548145494 +0000 UTC m=+3.224921233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r5nkt" (UniqueName: "kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt") pod "network-check-target-6mcwq" (UID: "100852ea-cf8a-4319-8cd1-4fc3eb3c418a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:14.049173 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.049153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx4lj\" (UniqueName: \"kubernetes.io/projected/8e42179a-8792-4a3b-80eb-e63a5a16ace9-kube-api-access-vx4lj\") pod \"node-resolver-bjxff\" (UID: \"8e42179a-8792-4a3b-80eb-e63a5a16ace9\") " pod="openshift-dns/node-resolver-bjxff" May 21 01:47:14.049443 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.049425 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnd9p\" (UniqueName: \"kubernetes.io/projected/1c6834d1-efc1-4e66-9d81-9fe9a703a274-kube-api-access-cnd9p\") pod \"tuned-m8n8p\" (UID: \"1c6834d1-efc1-4e66-9d81-9fe9a703a274\") " pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.050357 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.050331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j2s8\" (UniqueName: \"kubernetes.io/projected/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-kube-api-access-2j2s8\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:14.123414 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.123379 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" May 21 01:47:14.131471 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.131444 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c52gm" May 21 01:47:14.140540 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.140510 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zjlx4" May 21 01:47:14.145744 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.145726 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:14.153800 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.151308 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:14.157214 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.157192 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" May 21 01:47:14.163247 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.163225 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" May 21 01:47:14.169758 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.169738 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bjxff" May 21 01:47:14.175197 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.175179 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgpnr" May 21 01:47:14.457392 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:14.457369 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7e39fc_84d1_4096_970c_2215e2b4c3fe.slice/crio-fd3eed3a6ffa6ff4cb3b082e046e3fd1e764ca9b1714e488bcd5592e86a8ecf8 WatchSource:0}: Error finding container fd3eed3a6ffa6ff4cb3b082e046e3fd1e764ca9b1714e488bcd5592e86a8ecf8: Status 404 returned error can't find the container with id fd3eed3a6ffa6ff4cb3b082e046e3fd1e764ca9b1714e488bcd5592e86a8ecf8 May 21 01:47:14.458381 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:14.458353 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831b0097_02d1_4335_94ac_31b7929e0df1.slice/crio-aa1c8810a02ec508a0f37e863ad7e3ea065e39b11e0d99cf40fb2f042e8f4144 WatchSource:0}: Error finding container aa1c8810a02ec508a0f37e863ad7e3ea065e39b11e0d99cf40fb2f042e8f4144: Status 404 returned error can't find the container with id aa1c8810a02ec508a0f37e863ad7e3ea065e39b11e0d99cf40fb2f042e8f4144 May 21 01:47:14.459147 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:14.458975 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81894662_3585_4174_aa1a_a1d0343177b4.slice/crio-5d7066caaf04e5e0c6760eb1263b773a027105b4e9452930a4ecae1241c876d6 WatchSource:0}: Error finding container 5d7066caaf04e5e0c6760eb1263b773a027105b4e9452930a4ecae1241c876d6: Status 404 returned error can't find the container with id 5d7066caaf04e5e0c6760eb1263b773a027105b4e9452930a4ecae1241c876d6 May 21 01:47:14.462432 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:14.462414 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c6834d1_efc1_4e66_9d81_9fe9a703a274.slice/crio-0eeae8e2eb5d0facfe109657476a5bec1ce5ac24911f2cb5a02e0ddce7ebc9f0 WatchSource:0}: Error finding container 0eeae8e2eb5d0facfe109657476a5bec1ce5ac24911f2cb5a02e0ddce7ebc9f0: Status 404 returned error can't find the container with id 0eeae8e2eb5d0facfe109657476a5bec1ce5ac24911f2cb5a02e0ddce7ebc9f0 May 21 01:47:14.463913 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:14.463855 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1696709a_c17b_4d1f_a156_8bca1c668589.slice/crio-47f271569b90afb5a76e3bae86e020901edf2f5ea20fb3974ec8d7a9f5f44b41 WatchSource:0}: Error finding container 47f271569b90afb5a76e3bae86e020901edf2f5ea20fb3974ec8d7a9f5f44b41: Status 404 returned error can't find the container with id 47f271569b90afb5a76e3bae86e020901edf2f5ea20fb3974ec8d7a9f5f44b41 May 21 01:47:14.464854 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:14.464815 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29962f2_67c8_411b_87c2_a3950a8a189f.slice/crio-02ad5e187dd8e364ad13792dbcaa47855fa7a7ec6ed77d0d3dd86a7a78295dc4 WatchSource:0}: Error finding container 02ad5e187dd8e364ad13792dbcaa47855fa7a7ec6ed77d0d3dd86a7a78295dc4: Status 404 returned error can't find the container with id 02ad5e187dd8e364ad13792dbcaa47855fa7a7ec6ed77d0d3dd86a7a78295dc4 May 21 01:47:14.466992 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:14.466797 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e42179a_8792_4a3b_80eb_e63a5a16ace9.slice/crio-68e48e404711209b744da5a2d1f8663494469b936a4e83c4f1f5b038afa6f3c8 WatchSource:0}: Error finding container 68e48e404711209b744da5a2d1f8663494469b936a4e83c4f1f5b038afa6f3c8: Status 404 returned error can't find the container with id 68e48e404711209b744da5a2d1f8663494469b936a4e83c4f1f5b038afa6f3c8 May 21 01:47:14.467398 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:14.467348 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04bd9da_ce17_432c_8d3f_fdd80d1130ca.slice/crio-0af12aec2470e4d33692d956dc57f693eeb0f866236046d4c11e74ac5c6e25b0 WatchSource:0}: Error finding container 0af12aec2470e4d33692d956dc57f693eeb0f866236046d4c11e74ac5c6e25b0: Status 404 returned error can't find the container with id 0af12aec2470e4d33692d956dc57f693eeb0f866236046d4c11e74ac5c6e25b0 May 21 01:47:14.469416 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:14.469300 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365078df_0ea9_49f4_a965_d444e88d9046.slice/crio-a7c1535de3d4eece8f26db3b9b53023c1091819fdc85ae3b50ec1b6477acc850 WatchSource:0}: Error finding container a7c1535de3d4eece8f26db3b9b53023c1091819fdc85ae3b50ec1b6477acc850: Status 404 returned error can't find the container with id a7c1535de3d4eece8f26db3b9b53023c1091819fdc85ae3b50ec1b6477acc850 May 21 01:47:14.541852 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.541830 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:14.541986 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.541968 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:14.542051 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.542041 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs podName:0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe nodeName:}" failed. No retries permitted until 2026-05-21 01:47:15.542023499 +0000 UTC m=+4.218799225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs") pod "network-metrics-daemon-zspbw" (UID: "0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:14.643110 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.643081 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:14.643230 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.643218 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 01:47:14.643298 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.643233 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 01:47:14.643298 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.643248 2562 projected.go:194] Error preparing data for projected volume kube-api-access-r5nkt for pod openshift-network-diagnostics/network-check-target-6mcwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:14.643365 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:14.643305 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt podName:100852ea-cf8a-4319-8cd1-4fc3eb3c418a nodeName:}" failed. No retries permitted until 2026-05-21 01:47:15.643289521 +0000 UTC m=+4.320065244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5nkt" (UniqueName: "kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt") pod "network-check-target-6mcwq" (UID: "100852ea-cf8a-4319-8cd1-4fc3eb3c418a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:14.865989 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.865950 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 01:42:12 +0000 UTC" deadline="2027-11-27 07:12:47.594040769 +0000 UTC" May 21 01:47:14.865989 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.865985 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13325h25m32.728058209s" May 21 01:47:14.911018 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.910954 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c52gm" event={"ID":"be7e39fc-84d1-4096-970c-2215e2b4c3fe","Type":"ContainerStarted","Data":"fd3eed3a6ffa6ff4cb3b082e046e3fd1e764ca9b1714e488bcd5592e86a8ecf8"} May 21 01:47:14.916349 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.915693 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" event={"ID":"9ff51d37359e6e6b6ad59d1d313d5818","Type":"ContainerStarted","Data":"9a577d2938a7f4e805601444be77bb8f3f038c0b7dbe93fe534d2b9b46997d8b"} May 21 01:47:14.924801 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.924749 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nkqd4" event={"ID":"f29962f2-67c8-411b-87c2-a3950a8a189f","Type":"ContainerStarted","Data":"02ad5e187dd8e364ad13792dbcaa47855fa7a7ec6ed77d0d3dd86a7a78295dc4"} May 21 01:47:14.934265 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.934230 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerStarted","Data":"47f271569b90afb5a76e3bae86e020901edf2f5ea20fb3974ec8d7a9f5f44b41"} May 21 01:47:14.947041 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.947016 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgpnr" event={"ID":"81894662-3585-4174-aa1a-a1d0343177b4","Type":"ContainerStarted","Data":"5d7066caaf04e5e0c6760eb1263b773a027105b4e9452930a4ecae1241c876d6"} May 21 01:47:14.949207 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.949183 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" event={"ID":"831b0097-02d1-4335-94ac-31b7929e0df1","Type":"ContainerStarted","Data":"aa1c8810a02ec508a0f37e863ad7e3ea065e39b11e0d99cf40fb2f042e8f4144"} May 21 01:47:14.953398 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.952720 2562 generic.go:358] "Generic (PLEG): container finished" podID="f4d0d564f2a56568222b3d7dd9c6173d" containerID="80a20d41bd020bf857b15a394135cc39290f5830cbe06a1242988bd4b43479bf" exitCode=0 May 21 01:47:14.953398 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.952795 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" event={"ID":"f4d0d564f2a56568222b3d7dd9c6173d","Type":"ContainerDied","Data":"80a20d41bd020bf857b15a394135cc39290f5830cbe06a1242988bd4b43479bf"} May 21 01:47:14.958905 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.958831 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" event={"ID":"365078df-0ea9-49f4-a965-d444e88d9046","Type":"ContainerStarted","Data":"a7c1535de3d4eece8f26db3b9b53023c1091819fdc85ae3b50ec1b6477acc850"} May 21 01:47:14.964048 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.964001 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bjxff" event={"ID":"8e42179a-8792-4a3b-80eb-e63a5a16ace9","Type":"ContainerStarted","Data":"68e48e404711209b744da5a2d1f8663494469b936a4e83c4f1f5b038afa6f3c8"} May 21 01:47:14.969280 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.968335 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" podStartSLOduration=1.968321056 podStartE2EDuration="1.968321056s" podCreationTimestamp="2026-05-21 01:47:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:47:14.931471939 +0000 UTC m=+3.608247686" watchObservedRunningTime="2026-05-21 01:47:14.968321056 +0000 UTC m=+3.645096801" May 21 01:47:14.983268 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.980051 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zjlx4" event={"ID":"d04bd9da-ce17-432c-8d3f-fdd80d1130ca","Type":"ContainerStarted","Data":"0af12aec2470e4d33692d956dc57f693eeb0f866236046d4c11e74ac5c6e25b0"} May 21 01:47:14.989384 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:14.989136 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" event={"ID":"1c6834d1-efc1-4e66-9d81-9fe9a703a274","Type":"ContainerStarted","Data":"0eeae8e2eb5d0facfe109657476a5bec1ce5ac24911f2cb5a02e0ddce7ebc9f0"} May 21 01:47:15.551127 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:15.551091 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:15.551380 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:15.551221 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:15.551380 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:15.551301 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs podName:0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe nodeName:}" failed. No retries permitted until 2026-05-21 01:47:17.551282241 +0000 UTC m=+6.228058011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs") pod "network-metrics-daemon-zspbw" (UID: "0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:15.651654 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:15.651619 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:15.651888 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:15.651869 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 01:47:15.651953 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:15.651896 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 01:47:15.651953 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:15.651909 2562 projected.go:194] Error preparing data for projected volume kube-api-access-r5nkt for pod openshift-network-diagnostics/network-check-target-6mcwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:15.652060 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:15.651964 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt podName:100852ea-cf8a-4319-8cd1-4fc3eb3c418a nodeName:}" failed. No retries permitted until 2026-05-21 01:47:17.651946621 +0000 UTC m=+6.328722349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5nkt" (UniqueName: "kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt") pod "network-check-target-6mcwq" (UID: "100852ea-cf8a-4319-8cd1-4fc3eb3c418a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:15.895243 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:15.895155 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:15.895672 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:15.895317 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:15.895757 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:15.895738 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:15.895878 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:15.895835 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:16.013964 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:16.013928 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" event={"ID":"f4d0d564f2a56568222b3d7dd9c6173d","Type":"ContainerStarted","Data":"0e02f7f7d8e7526ef7ff01649f4bed85dbbc664d98e6bf1f0e88d0c15be027d0"} May 21 01:47:16.035375 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:16.034221 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" podStartSLOduration=3.034202794 podStartE2EDuration="3.034202794s" podCreationTimestamp="2026-05-21 01:47:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:47:16.033503041 +0000 UTC m=+4.710278784" watchObservedRunningTime="2026-05-21 01:47:16.034202794 +0000 UTC m=+4.710978541" May 21 01:47:17.567060 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:17.567023 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:17.567641 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:17.567197 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:17.567641 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:17.567273 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs podName:0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe nodeName:}" failed. No retries permitted until 2026-05-21 01:47:21.567239221 +0000 UTC m=+10.244014964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs") pod "network-metrics-daemon-zspbw" (UID: "0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:17.667702 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:17.667653 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:17.667875 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:17.667823 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 01:47:17.667875 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:17.667838 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 01:47:17.667875 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:17.667847 2562 projected.go:194] Error preparing data for projected volume kube-api-access-r5nkt for pod openshift-network-diagnostics/network-check-target-6mcwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:17.668030 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:17.667890 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt podName:100852ea-cf8a-4319-8cd1-4fc3eb3c418a nodeName:}" failed. No retries permitted until 2026-05-21 01:47:21.667877347 +0000 UTC m=+10.344653070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5nkt" (UniqueName: "kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt") pod "network-check-target-6mcwq" (UID: "100852ea-cf8a-4319-8cd1-4fc3eb3c418a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:17.895661 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:17.895576 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:17.895802 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:17.895712 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:17.896067 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:17.896046 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:17.896188 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:17.896146 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:19.895204 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:19.895174 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:19.895665 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:19.895216 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:19.895665 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:19.895330 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:19.895665 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:19.895618 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:21.601018 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:21.600964 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:21.601498 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:21.601079 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:21.601498 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:21.601150 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs podName:0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe nodeName:}" failed. No retries permitted until 2026-05-21 01:47:29.601129705 +0000 UTC m=+18.277905433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs") pod "network-metrics-daemon-zspbw" (UID: "0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:21.701770 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:21.701730 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:21.702355 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:21.701951 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 01:47:21.702355 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:21.701971 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 01:47:21.702355 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:21.701983 2562 projected.go:194] Error preparing data for projected volume kube-api-access-r5nkt for pod openshift-network-diagnostics/network-check-target-6mcwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:21.702355 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:21.702034 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt podName:100852ea-cf8a-4319-8cd1-4fc3eb3c418a nodeName:}" failed. No retries permitted until 2026-05-21 01:47:29.702015989 +0000 UTC m=+18.378791727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5nkt" (UniqueName: "kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt") pod "network-check-target-6mcwq" (UID: "100852ea-cf8a-4319-8cd1-4fc3eb3c418a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:21.896683 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:21.896608 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:21.897369 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:21.896603 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:21.897369 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:21.897088 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:21.897369 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:21.896746 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:23.895503 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:23.895466 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:23.895939 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:23.895590 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:23.895939 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:23.895655 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:23.895939 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:23.895757 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:25.894491 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:25.894461 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:25.894939 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:25.894461 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:25.894939 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:25.894594 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:25.894939 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:25.894651 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:27.895401 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:27.895358 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:27.895840 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:27.895438 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:27.895840 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:27.895549 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:27.895840 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:27.895697 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:29.664386 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:29.664349 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:29.664891 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:29.664489 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:29.664891 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:29.664545 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs podName:0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe nodeName:}" failed. No retries permitted until 2026-05-21 01:47:45.664531499 +0000 UTC m=+34.341307223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs") pod "network-metrics-daemon-zspbw" (UID: "0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:29.765349 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:29.765315 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:29.765487 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:29.765448 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 01:47:29.765487 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:29.765465 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 01:47:29.765487 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:29.765476 2562 projected.go:194] Error preparing data for projected volume kube-api-access-r5nkt for pod openshift-network-diagnostics/network-check-target-6mcwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:29.765642 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:29.765536 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt podName:100852ea-cf8a-4319-8cd1-4fc3eb3c418a nodeName:}" failed. No retries permitted until 2026-05-21 01:47:45.765518055 +0000 UTC m=+34.442293792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5nkt" (UniqueName: "kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt") pod "network-check-target-6mcwq" (UID: "100852ea-cf8a-4319-8cd1-4fc3eb3c418a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:29.895421 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:29.895392 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:29.895579 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:29.895391 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:29.895579 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:29.895524 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:29.895688 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:29.895667 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:31.895802 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:31.895569 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:31.896195 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:31.895626 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:31.896195 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:31.895895 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:31.896195 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:31.895972 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:33.046049 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.045908 2562 generic.go:358] "Generic (PLEG): container finished" podID="365078df-0ea9-49f4-a965-d444e88d9046" containerID="6aed399c110c50ed2e24b3a10a579a621c92677044371ddcd91fa50df4969c61" exitCode=0 May 21 01:47:33.046689 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.045993 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" event={"ID":"365078df-0ea9-49f4-a965-d444e88d9046","Type":"ContainerDied","Data":"6aed399c110c50ed2e24b3a10a579a621c92677044371ddcd91fa50df4969c61"} May 21 01:47:33.048070 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.048024 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bjxff" event={"ID":"8e42179a-8792-4a3b-80eb-e63a5a16ace9","Type":"ContainerStarted","Data":"a9950ff7b8caf68379937597ce8f6bb3ff0ebad5783885a6f1dfd990e98edb44"} May 21 01:47:33.049671 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.049644 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" event={"ID":"1c6834d1-efc1-4e66-9d81-9fe9a703a274","Type":"ContainerStarted","Data":"3b1e50e22bdf96ac4c2761490b93c6d008b298dad42d7e4df76b72f6f215b3e4"} May 21 01:47:33.052143 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.052109 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c52gm" event={"ID":"be7e39fc-84d1-4096-970c-2215e2b4c3fe","Type":"ContainerStarted","Data":"98999a9edede02043f33d695dbff5922b00f1cf82c3b1546efaa48112a45a041"} May 21 01:47:33.053476 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.053452 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nkqd4" event={"ID":"f29962f2-67c8-411b-87c2-a3950a8a189f","Type":"ContainerStarted","Data":"a3c4ed6fc091e1a109f706354e51c710339936b6a2e20932dadb9733d558376a"} May 21 01:47:33.056427 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.056407 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 01:47:33.056895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.056871 2562 generic.go:358] "Generic (PLEG): container finished" podID="1696709a-c17b-4d1f-a156-8bca1c668589" containerID="8a459e062d5589fd892e4c3cb55497926beda7e7008306a9fd8ee18f29802365" exitCode=1 May 21 01:47:33.056986 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.056914 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerStarted","Data":"f8a1374c2dbaededd0fa716d6e0c6fc0c7a43f4114fb61fcec5b8daec567c898"} May 21 01:47:33.056986 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.056942 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerStarted","Data":"46a486038f5a7b4b9d479f39540475bbaf2e678b83bb1f8a1c33f19946ee8ad7"} May 21 01:47:33.056986 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.056955 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerDied","Data":"8a459e062d5589fd892e4c3cb55497926beda7e7008306a9fd8ee18f29802365"} May 21 01:47:33.056986 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.056970 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerStarted","Data":"4d0527558704d5be0df4f575118bf72246eb3e1f1ae7fa34494443c2e22efabc"} May 21 01:47:33.058432 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.058370 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgpnr" event={"ID":"81894662-3585-4174-aa1a-a1d0343177b4","Type":"ContainerStarted","Data":"39191241a762f153f511bd672d4282adeab5943142250b84ccce6506dbe59af3"} May 21 01:47:33.059864 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.059845 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" event={"ID":"831b0097-02d1-4335-94ac-31b7929e0df1","Type":"ContainerStarted","Data":"e3c55522779878cc1bc3ece683728e1d5a056225769815d6cdb4b507a0a510d9"} May 21 01:47:33.082447 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.082401 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m8n8p" podStartSLOduration=3.141227847 podStartE2EDuration="21.082386567s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:47:14.464355725 +0000 UTC m=+3.141131462" lastFinishedPulling="2026-05-21 01:47:32.405514453 +0000 UTC m=+21.082290182" observedRunningTime="2026-05-21 01:47:33.082380171 +0000 UTC m=+21.759155922" watchObservedRunningTime="2026-05-21 01:47:33.082386567 +0000 UTC m=+21.759162314" May 21 01:47:33.096704 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.096662 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-bjxff" podStartSLOduration=3.159425528 podStartE2EDuration="21.096648591s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:47:14.468294047 +0000 UTC m=+3.145069781" lastFinishedPulling="2026-05-21 01:47:32.405517119 +0000 UTC m=+21.082292844" observedRunningTime="2026-05-21 01:47:33.096391082 +0000 UTC m=+21.773166830" watchObservedRunningTime="2026-05-21 01:47:33.096648591 +0000 UTC m=+21.773424339" May 21 01:47:33.112597 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.112559 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wgpnr" podStartSLOduration=3.66566505 podStartE2EDuration="21.11254656s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:47:14.461462559 +0000 UTC m=+3.138238282" lastFinishedPulling="2026-05-21 01:47:31.908344069 +0000 UTC m=+20.585119792" observedRunningTime="2026-05-21 01:47:33.112175736 +0000 UTC m=+21.788951485" watchObservedRunningTime="2026-05-21 01:47:33.11254656 +0000 UTC m=+21.789322307" May 21 01:47:33.139813 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.139773 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-c52gm" podStartSLOduration=3.181835645 podStartE2EDuration="21.139763184s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:47:14.459368549 +0000 UTC m=+3.136144291" lastFinishedPulling="2026-05-21 01:47:32.417296041 +0000 UTC m=+21.094071830" observedRunningTime="2026-05-21 01:47:33.13959794 +0000 UTC m=+21.816373689" watchObservedRunningTime="2026-05-21 01:47:33.139763184 +0000 UTC m=+21.816538930" May 21 01:47:33.794007 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.793794 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 01:47:33.894951 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.894855 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T01:47:33.793972551Z","UUID":"dab42dee-1377-4919-97fe-9a9378909f38","Handler":null,"Name":"","Endpoint":""} May 21 01:47:33.894951 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.894945 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:33.895190 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.894945 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:33.895190 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:33.895048 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:33.895190 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:33.895149 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:33.896749 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.896732 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 01:47:33.896855 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:33.896756 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 01:47:34.064658 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:34.064581 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 01:47:34.065209 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:34.064925 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerStarted","Data":"11a960a8b89f32d14c66a9716d7ef70cbcc2ee83c7f89d671e2912fefe49efd8"} May 21 01:47:34.065209 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:34.064956 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerStarted","Data":"65179dd9899929ede796a0b28762f71e37731ada9db0eb44d09d6b1050fc27db"} May 21 01:47:34.066608 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:34.066576 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" event={"ID":"831b0097-02d1-4335-94ac-31b7929e0df1","Type":"ContainerStarted","Data":"04ae61c7ced39cb29dc3a888ff475ce1c147c5ca92aa289c8bc5a00ed789a423"} May 21 01:47:34.068339 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:34.068302 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zjlx4" event={"ID":"d04bd9da-ce17-432c-8d3f-fdd80d1130ca","Type":"ContainerStarted","Data":"c4bdc4477a1e12867e2dbb2a74b38f70728188ec2567f68810ebe9d3bbd4f991"} May 21 01:47:34.082238 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:34.082197 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zjlx4" podStartSLOduration=4.189291897 podStartE2EDuration="22.082187248s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:47:14.468932281 +0000 UTC m=+3.145708020" lastFinishedPulling="2026-05-21 01:47:32.361827639 +0000 UTC m=+21.038603371" observedRunningTime="2026-05-21 01:47:34.082072556 +0000 UTC m=+22.758848304" watchObservedRunningTime="2026-05-21 01:47:34.082187248 +0000 UTC m=+22.758962998" May 21 01:47:34.082443 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:34.082410 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nkqd4" podStartSLOduration=4.168301573 podStartE2EDuration="22.082404574s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:47:14.467031276 +0000 UTC m=+3.143807000" lastFinishedPulling="2026-05-21 01:47:32.381134258 +0000 UTC m=+21.057910001" observedRunningTime="2026-05-21 01:47:33.153637435 +0000 UTC m=+21.830413193" watchObservedRunningTime="2026-05-21 01:47:34.082404574 +0000 UTC m=+22.759180319" May 21 01:47:35.839368 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:35.839335 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:35.839952 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:35.839933 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:35.894569 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:35.894548 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:35.894704 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:35.894555 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:35.894704 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:35.894653 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:35.894815 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:35.894762 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:36.075712 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:36.075686 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 01:47:36.076068 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:36.076039 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerStarted","Data":"8d3bd76f0f419b17829f0205016b05ca9ba66629de81179762af69d9e651baea"} May 21 01:47:36.078004 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:36.077980 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" event={"ID":"831b0097-02d1-4335-94ac-31b7929e0df1","Type":"ContainerStarted","Data":"0ae748fb13e6a8b1b2beeed7d41361c783b829fbf0f24d037d84a367ea85c19c"} May 21 01:47:36.078311 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:36.078292 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:36.079236 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:36.079219 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nkqd4" May 21 01:47:36.094046 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:36.093663 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjw5" podStartSLOduration=3.476290282 podStartE2EDuration="24.093652035s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:47:14.461445758 +0000 UTC m=+3.138221496" lastFinishedPulling="2026-05-21 01:47:35.078807512 +0000 UTC m=+23.755583249" observedRunningTime="2026-05-21 01:47:36.09351838 +0000 UTC m=+24.770294191" watchObservedRunningTime="2026-05-21 01:47:36.093652035 +0000 UTC m=+24.770427780" May 21 01:47:37.895008 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:37.894856 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:37.895563 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:37.894856 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:37.895563 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:37.895089 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:37.895563 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:37.895136 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:38.083206 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.083180 2562 generic.go:358] "Generic (PLEG): container finished" podID="365078df-0ea9-49f4-a965-d444e88d9046" containerID="595caae2a5c539948a2e617d3013d32eb36afb7f7c6c1f294ac0a697562f0d6a" exitCode=0 May 21 01:47:38.083371 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.083213 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" event={"ID":"365078df-0ea9-49f4-a965-d444e88d9046","Type":"ContainerDied","Data":"595caae2a5c539948a2e617d3013d32eb36afb7f7c6c1f294ac0a697562f0d6a"} May 21 01:47:38.086418 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.086404 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 01:47:38.086748 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.086729 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerStarted","Data":"0e973a90134b807bdc3793516f890fa291f64741ce417731c5414055154a9bad"} May 21 01:47:38.087133 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.087118 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:38.087189 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.087143 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:38.087361 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.087347 2562 scope.go:117] "RemoveContainer" containerID="8a459e062d5589fd892e4c3cb55497926beda7e7008306a9fd8ee18f29802365" May 21 01:47:38.103205 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.103184 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:38.393628 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.393598 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wkrnk"] May 21 01:47:38.396900 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.396884 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:38.396961 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:38.396942 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkrnk" podUID="68cc1293-b33b-467b-9337-ca6197a9e9bc" May 21 01:47:38.531904 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.531882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68cc1293-b33b-467b-9337-ca6197a9e9bc-kubelet-config\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:38.532036 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.531908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:38.532036 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.531943 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68cc1293-b33b-467b-9337-ca6197a9e9bc-dbus\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:38.632315 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.632283 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68cc1293-b33b-467b-9337-ca6197a9e9bc-kubelet-config\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:38.632486 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.632328 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:38.632486 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.632381 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68cc1293-b33b-467b-9337-ca6197a9e9bc-dbus\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:38.632486 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.632396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68cc1293-b33b-467b-9337-ca6197a9e9bc-kubelet-config\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:38.632654 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:38.632527 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 01:47:38.632654 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:38.632574 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret podName:68cc1293-b33b-467b-9337-ca6197a9e9bc nodeName:}" failed. No retries permitted until 2026-05-21 01:47:39.132559145 +0000 UTC m=+27.809334878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret") pod "global-pull-secret-syncer-wkrnk" (UID: "68cc1293-b33b-467b-9337-ca6197a9e9bc") : object "kube-system"/"original-pull-secret" not registered May 21 01:47:38.632654 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:38.632604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68cc1293-b33b-467b-9337-ca6197a9e9bc-dbus\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:39.090589 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.090524 2562 generic.go:358] "Generic (PLEG): container finished" podID="365078df-0ea9-49f4-a965-d444e88d9046" containerID="fb32c3048f716660e03979da66aed476ae9a553c247efae170e424ac52cfa990" exitCode=0 May 21 01:47:39.090957 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.090604 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" event={"ID":"365078df-0ea9-49f4-a965-d444e88d9046","Type":"ContainerDied","Data":"fb32c3048f716660e03979da66aed476ae9a553c247efae170e424ac52cfa990"} May 21 01:47:39.094271 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.094236 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 01:47:39.094671 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.094597 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" event={"ID":"1696709a-c17b-4d1f-a156-8bca1c668589","Type":"ContainerStarted","Data":"55e618cf9ee642d314bfac2e22d494aeb44ce8a85d7247a35be405ada17ac49a"} May 21 01:47:39.094992 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.094971 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:39.111371 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.111351 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:47:39.136185 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.136155 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:39.136297 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:39.136242 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 01:47:39.136357 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:39.136301 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret podName:68cc1293-b33b-467b-9337-ca6197a9e9bc nodeName:}" failed. No retries permitted until 2026-05-21 01:47:40.136289115 +0000 UTC m=+28.813064839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret") pod "global-pull-secret-syncer-wkrnk" (UID: "68cc1293-b33b-467b-9337-ca6197a9e9bc") : object "kube-system"/"original-pull-secret" not registered May 21 01:47:39.148562 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.148524 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" podStartSLOduration=9.15598152 podStartE2EDuration="27.148514162s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:47:14.465655386 +0000 UTC m=+3.142431110" lastFinishedPulling="2026-05-21 01:47:32.458188013 +0000 UTC m=+21.134963752" observedRunningTime="2026-05-21 01:47:39.146721302 +0000 UTC m=+27.823497048" watchObservedRunningTime="2026-05-21 01:47:39.148514162 +0000 UTC m=+27.825289942" May 21 01:47:39.357037 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.356970 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zspbw"] May 21 01:47:39.357151 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.357079 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:39.357219 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:39.357201 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:39.359942 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.359917 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wkrnk"] May 21 01:47:39.360039 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.360011 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:39.360115 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:39.360095 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkrnk" podUID="68cc1293-b33b-467b-9337-ca6197a9e9bc" May 21 01:47:39.360675 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.360654 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6mcwq"] May 21 01:47:39.360766 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:39.360736 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:39.360820 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:39.360796 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:40.098932 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:40.098675 2562 generic.go:358] "Generic (PLEG): container finished" podID="365078df-0ea9-49f4-a965-d444e88d9046" containerID="49631a5933d073e3b597f55312b57806f959aeaff280665644d3623f3723ccb5" exitCode=0 May 21 01:47:40.099290 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:40.098761 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" event={"ID":"365078df-0ea9-49f4-a965-d444e88d9046","Type":"ContainerDied","Data":"49631a5933d073e3b597f55312b57806f959aeaff280665644d3623f3723ccb5"} May 21 01:47:40.144412 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:40.144387 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:40.144507 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:40.144473 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 01:47:40.144547 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:40.144516 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret podName:68cc1293-b33b-467b-9337-ca6197a9e9bc nodeName:}" failed. No retries permitted until 2026-05-21 01:47:42.144504658 +0000 UTC m=+30.821280381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret") pod "global-pull-secret-syncer-wkrnk" (UID: "68cc1293-b33b-467b-9337-ca6197a9e9bc") : object "kube-system"/"original-pull-secret" not registered May 21 01:47:40.895427 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:40.895391 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:40.895574 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:40.895401 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:40.895574 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:40.895524 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:40.895666 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:40.895485 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:40.895666 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:40.895595 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:40.895779 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:40.895708 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkrnk" podUID="68cc1293-b33b-467b-9337-ca6197a9e9bc" May 21 01:47:42.163277 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:42.163188 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:42.163937 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:42.163339 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 01:47:42.163937 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:42.163404 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret podName:68cc1293-b33b-467b-9337-ca6197a9e9bc nodeName:}" failed. No retries permitted until 2026-05-21 01:47:46.163388983 +0000 UTC m=+34.840164707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret") pod "global-pull-secret-syncer-wkrnk" (UID: "68cc1293-b33b-467b-9337-ca6197a9e9bc") : object "kube-system"/"original-pull-secret" not registered May 21 01:47:42.894843 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:42.894810 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:42.894843 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:42.894847 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:42.895051 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:42.894817 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:42.895051 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:42.894931 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkrnk" podUID="68cc1293-b33b-467b-9337-ca6197a9e9bc" May 21 01:47:42.895051 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:42.895004 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:42.895173 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:42.895071 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:44.895002 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:44.894961 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:44.895595 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:44.894966 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:44.895595 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:44.895077 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mcwq" podUID="100852ea-cf8a-4319-8cd1-4fc3eb3c418a" May 21 01:47:44.895595 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:44.895151 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zspbw" podUID="0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe" May 21 01:47:44.895595 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:44.894962 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:44.895595 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:44.895239 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkrnk" podUID="68cc1293-b33b-467b-9337-ca6197a9e9bc" May 21 01:47:45.691720 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:45.691687 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:45.691885 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:45.691783 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:45.691885 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:45.691845 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs podName:0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe nodeName:}" failed. No retries permitted until 2026-05-21 01:48:17.691832371 +0000 UTC m=+66.368608095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs") pod "network-metrics-daemon-zspbw" (UID: "0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 01:47:45.792664 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:45.792638 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:45.792830 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:45.792812 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 01:47:45.792906 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:45.792838 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 01:47:45.792906 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:45.792851 2562 projected.go:194] Error preparing data for projected volume kube-api-access-r5nkt for pod openshift-network-diagnostics/network-check-target-6mcwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:45.793005 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:45.792909 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt podName:100852ea-cf8a-4319-8cd1-4fc3eb3c418a nodeName:}" failed. No retries permitted until 2026-05-21 01:48:17.792891948 +0000 UTC m=+66.469667686 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5nkt" (UniqueName: "kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt") pod "network-check-target-6mcwq" (UID: "100852ea-cf8a-4319-8cd1-4fc3eb3c418a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 01:47:46.111499 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.111469 2562 generic.go:358] "Generic (PLEG): container finished" podID="365078df-0ea9-49f4-a965-d444e88d9046" containerID="288ae65ac91b041a5370ac4743edf56a1e265995e21523cdace85f36fef3e91c" exitCode=0 May 21 01:47:46.111862 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.111546 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" event={"ID":"365078df-0ea9-49f4-a965-d444e88d9046","Type":"ContainerDied","Data":"288ae65ac91b041a5370ac4743edf56a1e265995e21523cdace85f36fef3e91c"} May 21 01:47:46.137846 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.137825 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeReady" May 21 01:47:46.137947 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.137936 2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 01:47:46.168826 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.168805 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64"] May 21 01:47:46.194926 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.194898 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:46.195041 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:46.195019 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 01:47:46.195100 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:46.195076 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret podName:68cc1293-b33b-467b-9337-ca6197a9e9bc nodeName:}" failed. No retries permitted until 2026-05-21 01:47:54.195060727 +0000 UTC m=+42.871836472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret") pod "global-pull-secret-syncer-wkrnk" (UID: "68cc1293-b33b-467b-9337-ca6197a9e9bc") : object "kube-system"/"original-pull-secret" not registered May 21 01:47:46.201043 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.201022 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp"] May 21 01:47:46.201187 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.201165 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.203737 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.203718 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 01:47:46.203854 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.203718 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 01:47:46.203854 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.203757 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 01:47:46.204026 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.204011 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 01:47:46.215090 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.215041 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-584fc86f59-jn5xf"] May 21 01:47:46.215204 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.215188 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" May 21 01:47:46.220225 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.220208 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 01:47:46.220351 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.220329 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kvgmg\"" May 21 01:47:46.227063 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.227048 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm"] May 21 01:47:46.227178 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.227165 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.230234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.229999 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 01:47:46.230490 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.230472 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 01:47:46.230578 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.230512 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 01:47:46.230578 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.230547 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xmfz9\"" May 21 01:47:46.236589 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.236569 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 01:47:46.239172 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.239154 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vksc7"] May 21 01:47:46.239336 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.239317 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.241794 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.241774 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 01:47:46.241883 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.241775 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 01:47:46.241883 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.241808 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 01:47:46.241883 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.241861 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 01:47:46.255373 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.255346 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64"] May 21 01:47:46.255373 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.255371 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7fxxf"] May 21 01:47:46.255577 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.255495 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.258184 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.258124 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjjsz\"" May 21 01:47:46.258184 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.258148 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 01:47:46.258513 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.258287 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 01:47:46.267623 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.267606 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp"] May 21 01:47:46.267623 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.267626 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm"] May 21 01:47:46.267743 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.267635 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-584fc86f59-jn5xf"] May 21 01:47:46.267743 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.267643 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vksc7"] May 21 01:47:46.267743 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.267651 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7fxxf"] May 21 01:47:46.267743 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.267723 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:46.270436 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.270418 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 01:47:46.270528 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.270453 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bvhf9\"" May 21 01:47:46.270528 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.270496 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 01:47:46.270639 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.270565 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 01:47:46.295999 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.295979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx584\" (UniqueName: \"kubernetes.io/projected/07949bdf-7180-4218-8438-9e08f142e608-kube-api-access-tx584\") pod \"klusterlet-addon-workmgr-597fc7b645-ghs64\" (UID: \"07949bdf-7180-4218-8438-9e08f142e608\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.296223 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.296203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07949bdf-7180-4218-8438-9e08f142e608-tmp\") pod \"klusterlet-addon-workmgr-597fc7b645-ghs64\" (UID: \"07949bdf-7180-4218-8438-9e08f142e608\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.296302 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.296263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07949bdf-7180-4218-8438-9e08f142e608-klusterlet-config\") pod \"klusterlet-addon-workmgr-597fc7b645-ghs64\" (UID: \"07949bdf-7180-4218-8438-9e08f142e608\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.397349 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397326 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07949bdf-7180-4218-8438-9e08f142e608-tmp\") pod \"klusterlet-addon-workmgr-597fc7b645-ghs64\" (UID: \"07949bdf-7180-4218-8438-9e08f142e608\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.397456 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-ca\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.397456 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397379 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07949bdf-7180-4218-8438-9e08f142e608-klusterlet-config\") pod \"klusterlet-addon-workmgr-597fc7b645-ghs64\" (UID: \"07949bdf-7180-4218-8438-9e08f142e608\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.397574 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chmkr\" (UniqueName: \"kubernetes.io/projected/8f608821-4201-4334-878c-2950041dbb86-kube-api-access-chmkr\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:46.397574 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.397681 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be353974-84e6-4277-9fb0-f51cdf2da42b-tmp-dir\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.397681 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqbvx\" (UniqueName: \"kubernetes.io/projected/be353974-84e6-4277-9fb0-f51cdf2da42b-kube-api-access-hqbvx\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.397681 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.397681 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s9pc\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-kube-api-access-4s9pc\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.397872 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397713 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx584\" (UniqueName: \"kubernetes.io/projected/07949bdf-7180-4218-8438-9e08f142e608-kube-api-access-tx584\") pod \"klusterlet-addon-workmgr-597fc7b645-ghs64\" (UID: \"07949bdf-7180-4218-8438-9e08f142e608\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.397872 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07949bdf-7180-4218-8438-9e08f142e608-tmp\") pod \"klusterlet-addon-workmgr-597fc7b645-ghs64\" (UID: \"07949bdf-7180-4218-8438-9e08f142e608\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.397872 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-certificates\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.397872 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-hub\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.397872 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ee9083c-f865-400c-ad60-d7e158a6a009-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c5df5b488-ddngp\" (UID: \"9ee9083c-f865-400c-ad60-d7e158a6a009\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-trusted-ca\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.397984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsb55\" (UniqueName: \"kubernetes.io/projected/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-kube-api-access-wsb55\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.398012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/889d0c8d-9f91-48e2-913d-3fe6532240f4-ca-trust-extracted\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.398031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-installation-pull-secrets\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.398065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-bound-sa-token\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.398082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.398106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-image-registry-private-configuration\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.398129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94r8c\" (UniqueName: \"kubernetes.io/projected/9ee9083c-f865-400c-ad60-d7e158a6a009-kube-api-access-94r8c\") pod \"managed-serviceaccount-addon-agent-7c5df5b488-ddngp\" (UID: \"9ee9083c-f865-400c-ad60-d7e158a6a009\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" May 21 01:47:46.398175 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.398143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be353974-84e6-4277-9fb0-f51cdf2da42b-config-volume\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.401386 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.401240 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07949bdf-7180-4218-8438-9e08f142e608-klusterlet-config\") pod \"klusterlet-addon-workmgr-597fc7b645-ghs64\" (UID: \"07949bdf-7180-4218-8438-9e08f142e608\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.405529 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.405507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx584\" (UniqueName: \"kubernetes.io/projected/07949bdf-7180-4218-8438-9e08f142e608-kube-api-access-tx584\") pod \"klusterlet-addon-workmgr-597fc7b645-ghs64\" (UID: \"07949bdf-7180-4218-8438-9e08f142e608\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.498797 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.498739 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-trusted-ca\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.498797 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.498766 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.498797 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.498782 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsb55\" (UniqueName: \"kubernetes.io/projected/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-kube-api-access-wsb55\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.498977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.498812 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/889d0c8d-9f91-48e2-913d-3fe6532240f4-ca-trust-extracted\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.498977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.498829 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-installation-pull-secrets\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.498977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.498845 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-bound-sa-token\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.498977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.498874 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.499200 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499008 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-image-registry-private-configuration\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.499200 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499046 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94r8c\" (UniqueName: \"kubernetes.io/projected/9ee9083c-f865-400c-ad60-d7e158a6a009-kube-api-access-94r8c\") pod \"managed-serviceaccount-addon-agent-7c5df5b488-ddngp\" (UID: \"9ee9083c-f865-400c-ad60-d7e158a6a009\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" May 21 01:47:46.499200 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499079 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be353974-84e6-4277-9fb0-f51cdf2da42b-config-volume\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.499200 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499130 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-ca\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.499200 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499159 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chmkr\" (UniqueName: \"kubernetes.io/projected/8f608821-4201-4334-878c-2950041dbb86-kube-api-access-chmkr\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:46.499200 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499192 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.499537 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499218 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be353974-84e6-4277-9fb0-f51cdf2da42b-tmp-dir\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.499537 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/889d0c8d-9f91-48e2-913d-3fe6532240f4-ca-trust-extracted\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.499537 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499292 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqbvx\" (UniqueName: \"kubernetes.io/projected/be353974-84e6-4277-9fb0-f51cdf2da42b-kube-api-access-hqbvx\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.499537 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499331 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.499537 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499360 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4s9pc\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-kube-api-access-4s9pc\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.499537 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499393 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-certificates\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.499537 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499420 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-hub\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.499537 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499444 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:46.499537 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499473 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ee9083c-f865-400c-ad60-d7e158a6a009-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c5df5b488-ddngp\" (UID: \"9ee9083c-f865-400c-ad60-d7e158a6a009\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" May 21 01:47:46.499990 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499713 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.499990 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:46.499727 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 01:47:46.499990 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499760 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.499990 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.499773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-trusted-ca\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.499990 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:46.499794 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls podName:be353974-84e6-4277-9fb0-f51cdf2da42b nodeName:}" failed. No retries permitted until 2026-05-21 01:47:46.999773552 +0000 UTC m=+35.676549280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls") pod "dns-default-vksc7" (UID: "be353974-84e6-4277-9fb0-f51cdf2da42b") : secret "dns-default-metrics-tls" not found May 21 01:47:46.500323 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.500194 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be353974-84e6-4277-9fb0-f51cdf2da42b-tmp-dir\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.500323 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:46.500296 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 01:47:46.500323 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:46.500312 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fc86f59-jn5xf: secret "image-registry-tls" not found May 21 01:47:46.500513 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:46.500360 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls podName:889d0c8d-9f91-48e2-913d-3fe6532240f4 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:47.000343257 +0000 UTC m=+35.677118984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls") pod "image-registry-584fc86f59-jn5xf" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4") : secret "image-registry-tls" not found May 21 01:47:46.500828 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.500806 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-certificates\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.500910 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:46.500899 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 01:47:46.500999 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:46.500942 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert podName:8f608821-4201-4334-878c-2950041dbb86 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:47.000926565 +0000 UTC m=+35.677702291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert") pod "ingress-canary-7fxxf" (UID: "8f608821-4201-4334-878c-2950041dbb86") : secret "canary-serving-cert" not found May 21 01:47:46.501694 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.501442 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be353974-84e6-4277-9fb0-f51cdf2da42b-config-volume\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.501806 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.501765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-image-registry-private-configuration\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.502148 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.502124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ee9083c-f865-400c-ad60-d7e158a6a009-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c5df5b488-ddngp\" (UID: \"9ee9083c-f865-400c-ad60-d7e158a6a009\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" May 21 01:47:46.502206 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.502134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.502463 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.502443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.502563 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.502545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-ca\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.502614 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.502601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-hub\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.503099 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.503085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-installation-pull-secrets\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.506456 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.506434 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-bound-sa-token\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.507103 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.507075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsb55\" (UniqueName: \"kubernetes.io/projected/e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e-kube-api-access-wsb55\") pod \"cluster-proxy-proxy-agent-5977f7595-756mm\" (UID: \"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.508170 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.508133 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqbvx\" (UniqueName: \"kubernetes.io/projected/be353974-84e6-4277-9fb0-f51cdf2da42b-kube-api-access-hqbvx\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:46.508275 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.508196 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chmkr\" (UniqueName: \"kubernetes.io/projected/8f608821-4201-4334-878c-2950041dbb86-kube-api-access-chmkr\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:46.508275 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.508220 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94r8c\" (UniqueName: \"kubernetes.io/projected/9ee9083c-f865-400c-ad60-d7e158a6a009-kube-api-access-94r8c\") pod \"managed-serviceaccount-addon-agent-7c5df5b488-ddngp\" (UID: \"9ee9083c-f865-400c-ad60-d7e158a6a009\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" May 21 01:47:46.508435 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.508420 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s9pc\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-kube-api-access-4s9pc\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:46.539727 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.539708 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:46.556383 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.556359 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" May 21 01:47:46.570181 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.570165 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:47:46.738225 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.738196 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp"] May 21 01:47:46.741917 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.741890 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64"] May 21 01:47:46.742456 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.742432 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm"] May 21 01:47:46.743732 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:46.743688 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ee9083c_f865_400c_ad60_d7e158a6a009.slice/crio-305fb70d5221865237ad7c33da7a75f847fd0837519735dae1122ee8bb7c53f9 WatchSource:0}: Error finding container 305fb70d5221865237ad7c33da7a75f847fd0837519735dae1122ee8bb7c53f9: Status 404 returned error can't find the container with id 305fb70d5221865237ad7c33da7a75f847fd0837519735dae1122ee8bb7c53f9 May 21 01:47:46.746896 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:46.746877 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7372b69_a0b4_4ce9_bc9f_a38ce8f4e24e.slice/crio-1329a4eec9349f16f4010e8e59c16e6bd885bbde2710f2b0c403b701108cee5a WatchSource:0}: Error finding container 1329a4eec9349f16f4010e8e59c16e6bd885bbde2710f2b0c403b701108cee5a: Status 404 returned error can't find the container with id 1329a4eec9349f16f4010e8e59c16e6bd885bbde2710f2b0c403b701108cee5a May 21 01:47:46.747401 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:46.747377 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07949bdf_7180_4218_8438_9e08f142e608.slice/crio-21774db240b4e22e8cf141dee32b5d078972ecffe6b5b3fd7026cc86ba4412b9 WatchSource:0}: Error finding container 21774db240b4e22e8cf141dee32b5d078972ecffe6b5b3fd7026cc86ba4412b9: Status 404 returned error can't find the container with id 21774db240b4e22e8cf141dee32b5d078972ecffe6b5b3fd7026cc86ba4412b9 May 21 01:47:46.895183 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.895163 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:47:46.895308 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.895196 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:47:46.895308 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.895281 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:46.899956 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.899906 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 01:47:46.899956 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.899928 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8dzcp\"" May 21 01:47:46.900102 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.900067 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ng7kc\"" May 21 01:47:46.900198 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.900171 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 01:47:46.900310 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.900212 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 01:47:46.900450 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:46.900434 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 01:47:47.003235 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:47.003188 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:47.003235 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:47.003216 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:47.003235 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:47.003234 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:47.003445 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:47.003350 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 01:47:47.003445 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:47.003355 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 01:47:47.003445 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:47.003373 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fc86f59-jn5xf: secret "image-registry-tls" not found May 21 01:47:47.003445 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:47.003387 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert podName:8f608821-4201-4334-878c-2950041dbb86 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:48.003374738 +0000 UTC m=+36.680150463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert") pod "ingress-canary-7fxxf" (UID: "8f608821-4201-4334-878c-2950041dbb86") : secret "canary-serving-cert" not found May 21 01:47:47.003445 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:47.003413 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls podName:889d0c8d-9f91-48e2-913d-3fe6532240f4 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:48.00339873 +0000 UTC m=+36.680174454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls") pod "image-registry-584fc86f59-jn5xf" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4") : secret "image-registry-tls" not found May 21 01:47:47.003445 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:47.003356 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 01:47:47.003445 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:47.003443 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls podName:be353974-84e6-4277-9fb0-f51cdf2da42b nodeName:}" failed. No retries permitted until 2026-05-21 01:47:48.003437426 +0000 UTC m=+36.680213149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls") pod "dns-default-vksc7" (UID: "be353974-84e6-4277-9fb0-f51cdf2da42b") : secret "dns-default-metrics-tls" not found May 21 01:47:47.114022 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:47.113998 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" event={"ID":"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e","Type":"ContainerStarted","Data":"1329a4eec9349f16f4010e8e59c16e6bd885bbde2710f2b0c403b701108cee5a"} May 21 01:47:47.114886 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:47.114860 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" event={"ID":"9ee9083c-f865-400c-ad60-d7e158a6a009","Type":"ContainerStarted","Data":"305fb70d5221865237ad7c33da7a75f847fd0837519735dae1122ee8bb7c53f9"} May 21 01:47:47.115732 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:47.115715 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" event={"ID":"07949bdf-7180-4218-8438-9e08f142e608","Type":"ContainerStarted","Data":"21774db240b4e22e8cf141dee32b5d078972ecffe6b5b3fd7026cc86ba4412b9"} May 21 01:47:47.118100 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:47.118080 2562 generic.go:358] "Generic (PLEG): container finished" podID="365078df-0ea9-49f4-a965-d444e88d9046" containerID="e67620886e6a207f94f50fa880a77e3986e118ec60113f52496ba16398d49e2e" exitCode=0 May 21 01:47:47.118177 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:47.118112 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" event={"ID":"365078df-0ea9-49f4-a965-d444e88d9046","Type":"ContainerDied","Data":"e67620886e6a207f94f50fa880a77e3986e118ec60113f52496ba16398d49e2e"} May 21 01:47:48.012073 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:48.011843 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:48.012351 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:48.012100 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:48.012351 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:48.012137 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:48.012351 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:48.012121 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 01:47:48.012351 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:48.012245 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls podName:be353974-84e6-4277-9fb0-f51cdf2da42b nodeName:}" failed. No retries permitted until 2026-05-21 01:47:50.012225651 +0000 UTC m=+38.689001396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls") pod "dns-default-vksc7" (UID: "be353974-84e6-4277-9fb0-f51cdf2da42b") : secret "dns-default-metrics-tls" not found May 21 01:47:48.012351 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:48.012311 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 01:47:48.012351 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:48.012347 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert podName:8f608821-4201-4334-878c-2950041dbb86 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:50.012335637 +0000 UTC m=+38.689111375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert") pod "ingress-canary-7fxxf" (UID: "8f608821-4201-4334-878c-2950041dbb86") : secret "canary-serving-cert" not found May 21 01:47:48.012713 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:48.012405 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 01:47:48.012713 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:48.012416 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fc86f59-jn5xf: secret "image-registry-tls" not found May 21 01:47:48.012713 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:48.012445 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls podName:889d0c8d-9f91-48e2-913d-3fe6532240f4 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:50.012434702 +0000 UTC m=+38.689210441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls") pod "image-registry-584fc86f59-jn5xf" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4") : secret "image-registry-tls" not found May 21 01:47:48.127979 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:48.127132 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" event={"ID":"365078df-0ea9-49f4-a965-d444e88d9046","Type":"ContainerStarted","Data":"fdf95ebbf68e4784f8bb87e0890af45624e729a08949844d96e354973ebae8f4"} May 21 01:47:48.150306 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:48.149623 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b7rnz" podStartSLOduration=4.775088658 podStartE2EDuration="36.149610382s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:47:14.471749285 +0000 UTC m=+3.148525022" lastFinishedPulling="2026-05-21 01:47:45.846271011 +0000 UTC m=+34.523046746" observedRunningTime="2026-05-21 01:47:48.147457518 +0000 UTC m=+36.824233264" watchObservedRunningTime="2026-05-21 01:47:48.149610382 +0000 UTC m=+36.826386129" May 21 01:47:50.031149 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:50.030826 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:50.031149 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:50.030886 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:50.031149 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:50.030994 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 01:47:50.031149 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:50.031009 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fc86f59-jn5xf: secret "image-registry-tls" not found May 21 01:47:50.031149 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:50.031026 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:50.031149 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:50.031066 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls podName:889d0c8d-9f91-48e2-913d-3fe6532240f4 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:54.031049491 +0000 UTC m=+42.707825218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls") pod "image-registry-584fc86f59-jn5xf" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4") : secret "image-registry-tls" not found May 21 01:47:50.031149 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:50.030995 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 01:47:50.031149 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:50.031097 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 01:47:50.031149 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:50.031144 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert podName:8f608821-4201-4334-878c-2950041dbb86 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:54.031127729 +0000 UTC m=+42.707903468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert") pod "ingress-canary-7fxxf" (UID: "8f608821-4201-4334-878c-2950041dbb86") : secret "canary-serving-cert" not found May 21 01:47:50.032044 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:50.031172 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls podName:be353974-84e6-4277-9fb0-f51cdf2da42b nodeName:}" failed. No retries permitted until 2026-05-21 01:47:54.03116263 +0000 UTC m=+42.707938368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls") pod "dns-default-vksc7" (UID: "be353974-84e6-4277-9fb0-f51cdf2da42b") : secret "dns-default-metrics-tls" not found May 21 01:47:54.069411 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:54.069374 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:47:54.069921 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:54.069420 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:47:54.069921 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:54.069444 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:47:54.069921 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:54.069492 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 01:47:54.069921 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:54.069551 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 01:47:54.069921 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:54.069561 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 01:47:54.069921 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:54.069569 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fc86f59-jn5xf: secret "image-registry-tls" not found May 21 01:47:54.069921 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:54.069555 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls podName:be353974-84e6-4277-9fb0-f51cdf2da42b nodeName:}" failed. No retries permitted until 2026-05-21 01:48:02.069539844 +0000 UTC m=+50.746315586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls") pod "dns-default-vksc7" (UID: "be353974-84e6-4277-9fb0-f51cdf2da42b") : secret "dns-default-metrics-tls" not found May 21 01:47:54.069921 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:54.069610 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert podName:8f608821-4201-4334-878c-2950041dbb86 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:02.069598918 +0000 UTC m=+50.746374641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert") pod "ingress-canary-7fxxf" (UID: "8f608821-4201-4334-878c-2950041dbb86") : secret "canary-serving-cert" not found May 21 01:47:54.069921 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:47:54.069621 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls podName:889d0c8d-9f91-48e2-913d-3fe6532240f4 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:02.069615177 +0000 UTC m=+50.746390901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls") pod "image-registry-584fc86f59-jn5xf" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4") : secret "image-registry-tls" not found May 21 01:47:54.270816 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:54.270783 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:54.274181 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:54.274150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68cc1293-b33b-467b-9337-ca6197a9e9bc-original-pull-secret\") pod \"global-pull-secret-syncer-wkrnk\" (UID: \"68cc1293-b33b-467b-9337-ca6197a9e9bc\") " pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:54.414940 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:54.414884 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkrnk" May 21 01:47:54.878382 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:54.878358 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wkrnk"] May 21 01:47:54.882546 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:47:54.882493 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68cc1293_b33b_467b_9337_ca6197a9e9bc.slice/crio-f3a3d36fbd1f968d08caa0997cebc8a8a45a1c4dc92bda1410514335f49c0f9b WatchSource:0}: Error finding container f3a3d36fbd1f968d08caa0997cebc8a8a45a1c4dc92bda1410514335f49c0f9b: Status 404 returned error can't find the container with id f3a3d36fbd1f968d08caa0997cebc8a8a45a1c4dc92bda1410514335f49c0f9b May 21 01:47:55.144573 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:55.144473 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" event={"ID":"9ee9083c-f865-400c-ad60-d7e158a6a009","Type":"ContainerStarted","Data":"9edb95033c11aaa59bb4cb7b00d0b2f99da0cce4cef52767e5cb414ff60f9df8"} May 21 01:47:55.145853 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:55.145836 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" event={"ID":"07949bdf-7180-4218-8438-9e08f142e608","Type":"ContainerStarted","Data":"e11ad5130142e009af17a1a143c930ba1ad7f002746077cac0c3a42c53e5433e"} May 21 01:47:55.146015 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:55.145993 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:55.147151 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:55.147127 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" event={"ID":"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e","Type":"ContainerStarted","Data":"ff3ff591926271aad300863ce04286f7a15d632fa36c582842d7abe0f650d513"} May 21 01:47:55.147539 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:55.147518 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" May 21 01:47:55.148171 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:55.148150 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wkrnk" event={"ID":"68cc1293-b33b-467b-9337-ca6197a9e9bc","Type":"ContainerStarted","Data":"f3a3d36fbd1f968d08caa0997cebc8a8a45a1c4dc92bda1410514335f49c0f9b"} May 21 01:47:55.159199 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:55.159164 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c5df5b488-ddngp" podStartSLOduration=32.152277573 podStartE2EDuration="40.159153259s" podCreationTimestamp="2026-05-21 01:47:15 +0000 UTC" firstStartedPulling="2026-05-21 01:47:46.747320991 +0000 UTC m=+35.424096729" lastFinishedPulling="2026-05-21 01:47:54.75419669 +0000 UTC m=+43.430972415" observedRunningTime="2026-05-21 01:47:55.15888659 +0000 UTC m=+43.835662338" watchObservedRunningTime="2026-05-21 01:47:55.159153259 +0000 UTC m=+43.835929045" May 21 01:47:55.173457 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:47:55.173421 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597fc7b645-ghs64" podStartSLOduration=32.150106483 podStartE2EDuration="40.17340947s" podCreationTimestamp="2026-05-21 01:47:15 +0000 UTC" firstStartedPulling="2026-05-21 01:47:46.749026165 +0000 UTC m=+35.425801904" lastFinishedPulling="2026-05-21 01:47:54.772329166 +0000 UTC m=+43.449104891" observedRunningTime="2026-05-21 01:47:55.172877672 +0000 UTC m=+43.849653419" watchObservedRunningTime="2026-05-21 01:47:55.17340947 +0000 UTC m=+43.850185194" May 21 01:48:00.165593 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:00.165535 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" event={"ID":"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e","Type":"ContainerStarted","Data":"06a1e41d59e107b8de3bcd5199da6fa0439efad864dff5f12024d6da8133e08c"} May 21 01:48:00.165593 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:00.165593 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" event={"ID":"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e","Type":"ContainerStarted","Data":"50c927351f737e77c08f307faea1128ec4de6a918a602a27e536387a4aebe02d"} May 21 01:48:00.167294 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:00.167244 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wkrnk" event={"ID":"68cc1293-b33b-467b-9337-ca6197a9e9bc","Type":"ContainerStarted","Data":"6f08b3b26ee0a0a34d1122ec953fcaaa16e9229380c5f2a330f993d6067e292a"} May 21 01:48:00.185040 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:00.184985 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" podStartSLOduration=32.790036877 podStartE2EDuration="45.184970517s" podCreationTimestamp="2026-05-21 01:47:15 +0000 UTC" firstStartedPulling="2026-05-21 01:47:46.748655621 +0000 UTC m=+35.425431356" lastFinishedPulling="2026-05-21 01:47:59.143589269 +0000 UTC m=+47.820364996" observedRunningTime="2026-05-21 01:48:00.182843236 +0000 UTC m=+48.859618982" watchObservedRunningTime="2026-05-21 01:48:00.184970517 +0000 UTC m=+48.861746307" May 21 01:48:00.196993 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:00.196951 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wkrnk" podStartSLOduration=17.636998376 podStartE2EDuration="22.196940869s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:54.883981317 +0000 UTC m=+43.560757055" lastFinishedPulling="2026-05-21 01:47:59.443923821 +0000 UTC m=+48.120699548" observedRunningTime="2026-05-21 01:48:00.196649319 +0000 UTC m=+48.873425068" watchObservedRunningTime="2026-05-21 01:48:00.196940869 +0000 UTC m=+48.873716611" May 21 01:48:02.131827 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:02.131789 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:48:02.132343 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:02.131833 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:48:02.132343 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:02.131863 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:48:02.132343 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:02.131924 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 01:48:02.132343 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:02.131935 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 01:48:02.132343 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:02.131954 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fc86f59-jn5xf: secret "image-registry-tls" not found May 21 01:48:02.132343 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:02.131971 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 01:48:02.132343 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:02.131993 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls podName:be353974-84e6-4277-9fb0-f51cdf2da42b nodeName:}" failed. No retries permitted until 2026-05-21 01:48:18.131978192 +0000 UTC m=+66.808753947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls") pod "dns-default-vksc7" (UID: "be353974-84e6-4277-9fb0-f51cdf2da42b") : secret "dns-default-metrics-tls" not found May 21 01:48:02.132343 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:02.132008 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls podName:889d0c8d-9f91-48e2-913d-3fe6532240f4 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:18.132001902 +0000 UTC m=+66.808777625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls") pod "image-registry-584fc86f59-jn5xf" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4") : secret "image-registry-tls" not found May 21 01:48:02.132343 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:02.132028 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert podName:8f608821-4201-4334-878c-2950041dbb86 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:18.132012575 +0000 UTC m=+66.808788313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert") pod "ingress-canary-7fxxf" (UID: "8f608821-4201-4334-878c-2950041dbb86") : secret "canary-serving-cert" not found May 21 01:48:11.112410 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:11.112376 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p285b" May 21 01:48:17.739279 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:17.739223 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:48:17.742428 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:17.742408 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 01:48:17.749896 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:17.749873 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 01:48:17.749991 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:17.749935 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs podName:0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe nodeName:}" failed. No retries permitted until 2026-05-21 01:49:21.749919202 +0000 UTC m=+130.426694927 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs") pod "network-metrics-daemon-zspbw" (UID: "0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe") : secret "metrics-daemon-secret" not found May 21 01:48:17.839555 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:17.839532 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:48:17.842662 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:17.842645 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 01:48:17.852918 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:17.852898 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 01:48:17.863297 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:17.863272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5nkt\" (UniqueName: \"kubernetes.io/projected/100852ea-cf8a-4319-8cd1-4fc3eb3c418a-kube-api-access-r5nkt\") pod \"network-check-target-6mcwq\" (UID: \"100852ea-cf8a-4319-8cd1-4fc3eb3c418a\") " pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:48:18.111492 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:18.111440 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8dzcp\"" May 21 01:48:18.119601 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:18.119582 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:48:18.141267 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:18.141236 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:48:18.141361 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:18.141287 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:48:18.141361 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:18.141313 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:48:18.141488 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:18.141376 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 01:48:18.141488 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:18.141398 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 01:48:18.141488 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:18.141433 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls podName:be353974-84e6-4277-9fb0-f51cdf2da42b nodeName:}" failed. No retries permitted until 2026-05-21 01:48:50.141418551 +0000 UTC m=+98.818194275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls") pod "dns-default-vksc7" (UID: "be353974-84e6-4277-9fb0-f51cdf2da42b") : secret "dns-default-metrics-tls" not found May 21 01:48:18.141488 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:18.141450 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert podName:8f608821-4201-4334-878c-2950041dbb86 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:50.141442178 +0000 UTC m=+98.818217903 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert") pod "ingress-canary-7fxxf" (UID: "8f608821-4201-4334-878c-2950041dbb86") : secret "canary-serving-cert" not found May 21 01:48:18.141488 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:18.141447 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 01:48:18.141488 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:18.141470 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fc86f59-jn5xf: secret "image-registry-tls" not found May 21 01:48:18.141703 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:18.141537 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls podName:889d0c8d-9f91-48e2-913d-3fe6532240f4 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:50.141519502 +0000 UTC m=+98.818295241 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls") pod "image-registry-584fc86f59-jn5xf" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4") : secret "image-registry-tls" not found May 21 01:48:18.230969 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:18.230942 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6mcwq"] May 21 01:48:18.234095 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:48:18.234069 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100852ea_cf8a_4319_8cd1_4fc3eb3c418a.slice/crio-20e40af86ca7359df95b4d45f6f958f7911b6e8d978764098f9a3e456facb582 WatchSource:0}: Error finding container 20e40af86ca7359df95b4d45f6f958f7911b6e8d978764098f9a3e456facb582: Status 404 returned error can't find the container with id 20e40af86ca7359df95b4d45f6f958f7911b6e8d978764098f9a3e456facb582 May 21 01:48:19.220630 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:19.220588 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6mcwq" event={"ID":"100852ea-cf8a-4319-8cd1-4fc3eb3c418a","Type":"ContainerStarted","Data":"20e40af86ca7359df95b4d45f6f958f7911b6e8d978764098f9a3e456facb582"} May 21 01:48:22.229218 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:22.229180 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6mcwq" event={"ID":"100852ea-cf8a-4319-8cd1-4fc3eb3c418a","Type":"ContainerStarted","Data":"d3437455eedfaaf189058f3196ff87c7162b0ea8b8e5634ccedcb81711fc4980"} May 21 01:48:22.229673 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:22.229293 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:48:22.243857 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:22.243812 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6mcwq" podStartSLOduration=67.123732569 podStartE2EDuration="1m10.243799668s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:48:18.235977334 +0000 UTC m=+66.912753058" lastFinishedPulling="2026-05-21 01:48:21.356044419 +0000 UTC m=+70.032820157" observedRunningTime="2026-05-21 01:48:22.243443482 +0000 UTC m=+70.920219228" watchObservedRunningTime="2026-05-21 01:48:22.243799668 +0000 UTC m=+70.920575413" May 21 01:48:45.494839 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:45.494724 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh"] May 21 01:48:45.497062 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:45.497045 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh" May 21 01:48:45.499669 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:45.499649 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jj978\"" May 21 01:48:45.504615 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:45.504593 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh"] May 21 01:48:45.636403 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:45.636377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4c2s\" (UniqueName: \"kubernetes.io/projected/26d99ec6-a0f6-4051-b0b3-d38fae44c0bb-kube-api-access-k4c2s\") pod \"network-check-source-7f44b6dd87-qwxlh\" (UID: \"26d99ec6-a0f6-4051-b0b3-d38fae44c0bb\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh" May 21 01:48:45.737346 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:45.737312 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4c2s\" (UniqueName: \"kubernetes.io/projected/26d99ec6-a0f6-4051-b0b3-d38fae44c0bb-kube-api-access-k4c2s\") pod \"network-check-source-7f44b6dd87-qwxlh\" (UID: \"26d99ec6-a0f6-4051-b0b3-d38fae44c0bb\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh" May 21 01:48:45.745223 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:45.745172 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4c2s\" (UniqueName: \"kubernetes.io/projected/26d99ec6-a0f6-4051-b0b3-d38fae44c0bb-kube-api-access-k4c2s\") pod \"network-check-source-7f44b6dd87-qwxlh\" (UID: \"26d99ec6-a0f6-4051-b0b3-d38fae44c0bb\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh" May 21 01:48:45.806351 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:45.806325 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh" May 21 01:48:45.925369 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:45.925341 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh"] May 21 01:48:45.928415 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:48:45.928391 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d99ec6_a0f6_4051_b0b3_d38fae44c0bb.slice/crio-e0f0d768a01d96c1404d13fd4f4816a9cc6bee0c5f2cd965188026838cabae20 WatchSource:0}: Error finding container e0f0d768a01d96c1404d13fd4f4816a9cc6bee0c5f2cd965188026838cabae20: Status 404 returned error can't find the container with id e0f0d768a01d96c1404d13fd4f4816a9cc6bee0c5f2cd965188026838cabae20 May 21 01:48:46.286751 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:46.286722 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh" event={"ID":"26d99ec6-a0f6-4051-b0b3-d38fae44c0bb","Type":"ContainerStarted","Data":"eba1989e6c5fe0e684f37e7bfab968016e119b7254580281375b4abadb9898e9"} May 21 01:48:46.286881 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:46.286754 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh" event={"ID":"26d99ec6-a0f6-4051-b0b3-d38fae44c0bb","Type":"ContainerStarted","Data":"e0f0d768a01d96c1404d13fd4f4816a9cc6bee0c5f2cd965188026838cabae20"} May 21 01:48:46.302214 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:46.302174 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qwxlh" podStartSLOduration=1.302162004 podStartE2EDuration="1.302162004s" podCreationTimestamp="2026-05-21 01:48:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:48:46.301140693 +0000 UTC m=+94.977916439" watchObservedRunningTime="2026-05-21 01:48:46.302162004 +0000 UTC m=+94.978937749" May 21 01:48:50.167038 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:50.167007 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:48:50.167414 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:50.167045 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") pod \"image-registry-584fc86f59-jn5xf\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:48:50.167414 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:50.167064 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:48:50.167414 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:50.167157 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 01:48:50.167414 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:50.167166 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 01:48:50.167414 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:50.167174 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 01:48:50.167414 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:50.167183 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fc86f59-jn5xf: secret "image-registry-tls" not found May 21 01:48:50.167414 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:50.167218 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls podName:be353974-84e6-4277-9fb0-f51cdf2da42b nodeName:}" failed. No retries permitted until 2026-05-21 01:49:54.167202929 +0000 UTC m=+162.843978652 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls") pod "dns-default-vksc7" (UID: "be353974-84e6-4277-9fb0-f51cdf2da42b") : secret "dns-default-metrics-tls" not found May 21 01:48:50.167414 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:50.167232 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert podName:8f608821-4201-4334-878c-2950041dbb86 nodeName:}" failed. No retries permitted until 2026-05-21 01:49:54.167225587 +0000 UTC m=+162.844001311 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert") pod "ingress-canary-7fxxf" (UID: "8f608821-4201-4334-878c-2950041dbb86") : secret "canary-serving-cert" not found May 21 01:48:50.167414 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:48:50.167242 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls podName:889d0c8d-9f91-48e2-913d-3fe6532240f4 nodeName:}" failed. No retries permitted until 2026-05-21 01:49:54.167236637 +0000 UTC m=+162.844012362 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls") pod "image-registry-584fc86f59-jn5xf" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4") : secret "image-registry-tls" not found May 21 01:48:50.730002 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:50.729975 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bjxff_8e42179a-8792-4a3b-80eb-e63a5a16ace9/dns-node-resolver/0.log" May 21 01:48:51.931433 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:51.931398 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgpnr_81894662-3585-4174-aa1a-a1d0343177b4/node-ca/0.log" May 21 01:48:53.234370 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:48:53.234338 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6mcwq" May 21 01:49:12.546191 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.546157 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4rtfw"] May 21 01:49:12.549336 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.549320 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.553293 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.553246 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 01:49:12.553425 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.553336 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pnbl7\"" May 21 01:49:12.553425 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.553338 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 01:49:12.553425 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.553340 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 01:49:12.553425 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.553342 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 01:49:12.559807 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.559779 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4rtfw"] May 21 01:49:12.632632 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.632605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqrtx\" (UniqueName: \"kubernetes.io/projected/44fe0866-491d-467d-83f9-2f09255edb1d-kube-api-access-mqrtx\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.632747 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.632647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44fe0866-491d-467d-83f9-2f09255edb1d-crio-socket\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.632747 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.632670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44fe0866-491d-467d-83f9-2f09255edb1d-data-volume\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.632747 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.632703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44fe0866-491d-467d-83f9-2f09255edb1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.632747 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.632740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44fe0866-491d-467d-83f9-2f09255edb1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.733788 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.733759 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqrtx\" (UniqueName: \"kubernetes.io/projected/44fe0866-491d-467d-83f9-2f09255edb1d-kube-api-access-mqrtx\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.733873 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.733806 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44fe0866-491d-467d-83f9-2f09255edb1d-crio-socket\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.733873 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.733828 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44fe0866-491d-467d-83f9-2f09255edb1d-data-volume\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.733873 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.733845 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44fe0866-491d-467d-83f9-2f09255edb1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.733985 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.733885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44fe0866-491d-467d-83f9-2f09255edb1d-crio-socket\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.733985 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.733918 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44fe0866-491d-467d-83f9-2f09255edb1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.734167 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.734149 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44fe0866-491d-467d-83f9-2f09255edb1d-data-volume\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.734356 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.734342 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44fe0866-491d-467d-83f9-2f09255edb1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.736096 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.736076 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44fe0866-491d-467d-83f9-2f09255edb1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.741422 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.741392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqrtx\" (UniqueName: \"kubernetes.io/projected/44fe0866-491d-467d-83f9-2f09255edb1d-kube-api-access-mqrtx\") pod \"insights-runtime-extractor-4rtfw\" (UID: \"44fe0866-491d-467d-83f9-2f09255edb1d\") " pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.858534 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.858485 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4rtfw" May 21 01:49:12.976890 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:12.976749 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4rtfw"] May 21 01:49:12.979491 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:49:12.979462 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44fe0866_491d_467d_83f9_2f09255edb1d.slice/crio-e6aade64fba4d0f95c457c78879ed7e9dc5bf4b9cfde83a52e0cc67cbc3f3e1c WatchSource:0}: Error finding container e6aade64fba4d0f95c457c78879ed7e9dc5bf4b9cfde83a52e0cc67cbc3f3e1c: Status 404 returned error can't find the container with id e6aade64fba4d0f95c457c78879ed7e9dc5bf4b9cfde83a52e0cc67cbc3f3e1c May 21 01:49:13.350695 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:13.350662 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4rtfw" event={"ID":"44fe0866-491d-467d-83f9-2f09255edb1d","Type":"ContainerStarted","Data":"4c8c5f3f7a96c65a14721b3918743e6465f62ecae56393a07cfffb01d523e8aa"} May 21 01:49:13.350839 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:13.350703 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4rtfw" event={"ID":"44fe0866-491d-467d-83f9-2f09255edb1d","Type":"ContainerStarted","Data":"e6aade64fba4d0f95c457c78879ed7e9dc5bf4b9cfde83a52e0cc67cbc3f3e1c"} May 21 01:49:14.355861 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:14.355822 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4rtfw" event={"ID":"44fe0866-491d-467d-83f9-2f09255edb1d","Type":"ContainerStarted","Data":"3c3194a5b0135c185b9aecf5a1978634f85bbf601f5a6384c81f1cddf594cf5b"} May 21 01:49:15.360674 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:15.360637 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4rtfw" event={"ID":"44fe0866-491d-467d-83f9-2f09255edb1d","Type":"ContainerStarted","Data":"4477c5a536a0cf5accea08cf6da8f07dea6e1426d498fbed256340a136bd8533"} May 21 01:49:15.381828 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:15.381417 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4rtfw" podStartSLOduration=1.460329467 podStartE2EDuration="3.381401721s" podCreationTimestamp="2026-05-21 01:49:12 +0000 UTC" firstStartedPulling="2026-05-21 01:49:13.034779877 +0000 UTC m=+121.711555613" lastFinishedPulling="2026-05-21 01:49:14.955852142 +0000 UTC m=+123.632627867" observedRunningTime="2026-05-21 01:49:15.381349158 +0000 UTC m=+124.058124908" watchObservedRunningTime="2026-05-21 01:49:15.381401721 +0000 UTC m=+124.058177461" May 21 01:49:21.801560 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:21.801527 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:49:21.803896 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:21.803877 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe-metrics-certs\") pod \"network-metrics-daemon-zspbw\" (UID: \"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe\") " pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:49:22.022462 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:22.022436 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ng7kc\"" May 21 01:49:22.030595 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:22.030577 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zspbw" May 21 01:49:22.148838 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:22.148807 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zspbw"] May 21 01:49:22.152473 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:49:22.152447 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a78bc0e_ca6f_4991_ab19_5d3e533b9dbe.slice/crio-77230a1eac9bbe9f4b502f32f9e3980a640c72d6fcc67f77adfd8e08a55d258d WatchSource:0}: Error finding container 77230a1eac9bbe9f4b502f32f9e3980a640c72d6fcc67f77adfd8e08a55d258d: Status 404 returned error can't find the container with id 77230a1eac9bbe9f4b502f32f9e3980a640c72d6fcc67f77adfd8e08a55d258d May 21 01:49:22.379088 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:22.379025 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zspbw" event={"ID":"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe","Type":"ContainerStarted","Data":"77230a1eac9bbe9f4b502f32f9e3980a640c72d6fcc67f77adfd8e08a55d258d"} May 21 01:49:23.383947 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:23.383870 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zspbw" event={"ID":"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe","Type":"ContainerStarted","Data":"9b534f8c8e2f917e61c106551ed2e7bf3cd8e45cf50451e6e65f3c980d2ed154"} May 21 01:49:23.383947 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:23.383911 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zspbw" event={"ID":"0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe","Type":"ContainerStarted","Data":"9c457f2ba545cf291440f46af2e16e876019822dea48d365eeb1d020fab4b65e"} May 21 01:49:23.400304 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:23.400227 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zspbw" podStartSLOduration=130.520984499 podStartE2EDuration="2m11.400213197s" podCreationTimestamp="2026-05-21 01:47:12 +0000 UTC" firstStartedPulling="2026-05-21 01:49:22.154818749 +0000 UTC m=+130.831594473" lastFinishedPulling="2026-05-21 01:49:23.034047446 +0000 UTC m=+131.710823171" observedRunningTime="2026-05-21 01:49:23.398514253 +0000 UTC m=+132.075290002" watchObservedRunningTime="2026-05-21 01:49:23.400213197 +0000 UTC m=+132.076988943" May 21 01:49:25.871982 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.871948 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zmmk4"] May 21 01:49:25.875127 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.875104 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:25.877564 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.877541 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 01:49:25.877670 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.877613 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 01:49:25.877670 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.877546 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 01:49:25.878854 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.878838 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 01:49:25.878949 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.878854 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bsgjt\"" May 21 01:49:25.878949 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.878889 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 01:49:25.878949 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.878841 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 01:49:25.930697 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.930676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-textfile\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:25.930818 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.930702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rjb4\" (UniqueName: \"kubernetes.io/projected/9889eb8b-43b1-40bd-85d6-5bdcff68031e-kube-api-access-9rjb4\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:25.930818 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.930750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-wtmp\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:25.930905 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.930860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9889eb8b-43b1-40bd-85d6-5bdcff68031e-metrics-client-ca\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:25.930905 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.930894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:25.930980 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.930915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9889eb8b-43b1-40bd-85d6-5bdcff68031e-sys\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:25.930980 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.930963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9889eb8b-43b1-40bd-85d6-5bdcff68031e-root\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:25.931062 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.931019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-tls\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:25.931062 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:25.931042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.031845 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.031819 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-tls\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.031940 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.031851 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.031940 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.031898 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-textfile\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.031940 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.031914 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rjb4\" (UniqueName: \"kubernetes.io/projected/9889eb8b-43b1-40bd-85d6-5bdcff68031e-kube-api-access-9rjb4\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032057 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.031951 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-wtmp\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032057 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.031972 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9889eb8b-43b1-40bd-85d6-5bdcff68031e-metrics-client-ca\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032057 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.032009 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032057 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.032039 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9889eb8b-43b1-40bd-85d6-5bdcff68031e-sys\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032239 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.032072 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9889eb8b-43b1-40bd-85d6-5bdcff68031e-root\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032239 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.032104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-wtmp\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032239 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.032140 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9889eb8b-43b1-40bd-85d6-5bdcff68031e-root\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032239 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.032181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9889eb8b-43b1-40bd-85d6-5bdcff68031e-sys\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032468 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.032291 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-textfile\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032583 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.032560 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.032685 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.032663 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9889eb8b-43b1-40bd-85d6-5bdcff68031e-metrics-client-ca\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.034193 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.034176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.034391 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.034372 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9889eb8b-43b1-40bd-85d6-5bdcff68031e-node-exporter-tls\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.039599 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.039578 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rjb4\" (UniqueName: \"kubernetes.io/projected/9889eb8b-43b1-40bd-85d6-5bdcff68031e-kube-api-access-9rjb4\") pod \"node-exporter-zmmk4\" (UID: \"9889eb8b-43b1-40bd-85d6-5bdcff68031e\") " pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.184054 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.183991 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zmmk4" May 21 01:49:26.191506 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:49:26.191482 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9889eb8b_43b1_40bd_85d6_5bdcff68031e.slice/crio-3f8bd8d2d444b005f3fec9fa1fcb7871763d28b43f6f40fd69ac7fa4a55b13a2 WatchSource:0}: Error finding container 3f8bd8d2d444b005f3fec9fa1fcb7871763d28b43f6f40fd69ac7fa4a55b13a2: Status 404 returned error can't find the container with id 3f8bd8d2d444b005f3fec9fa1fcb7871763d28b43f6f40fd69ac7fa4a55b13a2 May 21 01:49:26.394376 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:26.394348 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zmmk4" event={"ID":"9889eb8b-43b1-40bd-85d6-5bdcff68031e","Type":"ContainerStarted","Data":"3f8bd8d2d444b005f3fec9fa1fcb7871763d28b43f6f40fd69ac7fa4a55b13a2"} May 21 01:49:27.397977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:27.397913 2562 generic.go:358] "Generic (PLEG): container finished" podID="9889eb8b-43b1-40bd-85d6-5bdcff68031e" containerID="df1e3c413227e1bb4c2d69c904a12b8b1d563f2db901b2e7c841403aa89cdcdc" exitCode=0 May 21 01:49:27.397977 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:27.397967 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zmmk4" event={"ID":"9889eb8b-43b1-40bd-85d6-5bdcff68031e","Type":"ContainerDied","Data":"df1e3c413227e1bb4c2d69c904a12b8b1d563f2db901b2e7c841403aa89cdcdc"} May 21 01:49:28.403055 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:28.403015 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zmmk4" event={"ID":"9889eb8b-43b1-40bd-85d6-5bdcff68031e","Type":"ContainerStarted","Data":"90f8404378e34186e20c2f66a1c34c26d10d204d53c9544aaf754e6268355bbc"} May 21 01:49:28.403055 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:28.403055 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zmmk4" event={"ID":"9889eb8b-43b1-40bd-85d6-5bdcff68031e","Type":"ContainerStarted","Data":"baf2503ef09e54d64b09e4dde308a8ad0113d742c7cd286762b3585797b6a62b"} May 21 01:49:28.423237 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:28.423185 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zmmk4" podStartSLOduration=2.479431483 podStartE2EDuration="3.42316945s" podCreationTimestamp="2026-05-21 01:49:25 +0000 UTC" firstStartedPulling="2026-05-21 01:49:26.193281669 +0000 UTC m=+134.870057396" lastFinishedPulling="2026-05-21 01:49:27.137019626 +0000 UTC m=+135.813795363" observedRunningTime="2026-05-21 01:49:28.422373189 +0000 UTC m=+137.099148937" watchObservedRunningTime="2026-05-21 01:49:28.42316945 +0000 UTC m=+137.099945195" May 21 01:49:34.727405 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:34.727361 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584fc86f59-jn5xf"] May 21 01:49:34.727865 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:49:34.727510 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" podUID="889d0c8d-9f91-48e2-913d-3fe6532240f4" May 21 01:49:35.420575 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.420546 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:49:35.424648 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.424622 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:49:35.502216 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502195 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s9pc\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-kube-api-access-4s9pc\") pod \"889d0c8d-9f91-48e2-913d-3fe6532240f4\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " May 21 01:49:35.502362 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502226 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-certificates\") pod \"889d0c8d-9f91-48e2-913d-3fe6532240f4\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " May 21 01:49:35.502362 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502248 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/889d0c8d-9f91-48e2-913d-3fe6532240f4-ca-trust-extracted\") pod \"889d0c8d-9f91-48e2-913d-3fe6532240f4\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " May 21 01:49:35.502362 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502302 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-bound-sa-token\") pod \"889d0c8d-9f91-48e2-913d-3fe6532240f4\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " May 21 01:49:35.502362 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502339 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-installation-pull-secrets\") pod \"889d0c8d-9f91-48e2-913d-3fe6532240f4\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " May 21 01:49:35.502621 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502369 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-trusted-ca\") pod \"889d0c8d-9f91-48e2-913d-3fe6532240f4\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " May 21 01:49:35.502621 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502402 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-image-registry-private-configuration\") pod \"889d0c8d-9f91-48e2-913d-3fe6532240f4\" (UID: \"889d0c8d-9f91-48e2-913d-3fe6532240f4\") " May 21 01:49:35.502621 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502507 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/889d0c8d-9f91-48e2-913d-3fe6532240f4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "889d0c8d-9f91-48e2-913d-3fe6532240f4" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 01:49:35.502799 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502630 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "889d0c8d-9f91-48e2-913d-3fe6532240f4" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 01:49:35.502799 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502704 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-certificates\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:49:35.502799 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502722 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/889d0c8d-9f91-48e2-913d-3fe6532240f4-ca-trust-extracted\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:49:35.502940 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.502844 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "889d0c8d-9f91-48e2-913d-3fe6532240f4" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 01:49:35.504737 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.504704 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "889d0c8d-9f91-48e2-913d-3fe6532240f4" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 01:49:35.504875 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.504723 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "889d0c8d-9f91-48e2-913d-3fe6532240f4" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 01:49:35.504875 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.504779 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-kube-api-access-4s9pc" (OuterVolumeSpecName: "kube-api-access-4s9pc") pod "889d0c8d-9f91-48e2-913d-3fe6532240f4" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4"). InnerVolumeSpecName "kube-api-access-4s9pc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 01:49:35.504875 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.504790 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "889d0c8d-9f91-48e2-913d-3fe6532240f4" (UID: "889d0c8d-9f91-48e2-913d-3fe6532240f4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 01:49:35.603179 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.603148 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-bound-sa-token\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:49:35.603179 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.603178 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-installation-pull-secrets\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:49:35.603338 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.603192 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/889d0c8d-9f91-48e2-913d-3fe6532240f4-trusted-ca\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:49:35.603338 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.603201 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/889d0c8d-9f91-48e2-913d-3fe6532240f4-image-registry-private-configuration\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:49:35.603338 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:35.603211 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s9pc\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-kube-api-access-4s9pc\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:49:36.422950 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:36.422914 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584fc86f59-jn5xf" May 21 01:49:36.454105 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:36.454076 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584fc86f59-jn5xf"] May 21 01:49:36.459316 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:36.459288 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-584fc86f59-jn5xf"] May 21 01:49:36.509024 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:36.509004 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889d0c8d-9f91-48e2-913d-3fe6532240f4-registry-tls\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:49:36.571559 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:36.571517 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" podUID="e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 01:49:37.898767 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:37.898726 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="889d0c8d-9f91-48e2-913d-3fe6532240f4" path="/var/lib/kubelet/pods/889d0c8d-9f91-48e2-913d-3fe6532240f4/volumes" May 21 01:49:46.571493 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:46.571444 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" podUID="e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 01:49:49.285376 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:49:49.285321 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vksc7" podUID="be353974-84e6-4277-9fb0-f51cdf2da42b" May 21 01:49:49.290469 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:49:49.290443 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7fxxf" podUID="8f608821-4201-4334-878c-2950041dbb86" May 21 01:49:49.456395 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:49.456370 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vksc7" May 21 01:49:54.228761 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:54.228718 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:49:54.228761 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:54.228770 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:49:54.230992 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:54.230970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be353974-84e6-4277-9fb0-f51cdf2da42b-metrics-tls\") pod \"dns-default-vksc7\" (UID: \"be353974-84e6-4277-9fb0-f51cdf2da42b\") " pod="openshift-dns/dns-default-vksc7" May 21 01:49:54.231116 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:54.231098 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f608821-4201-4334-878c-2950041dbb86-cert\") pod \"ingress-canary-7fxxf\" (UID: \"8f608821-4201-4334-878c-2950041dbb86\") " pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:49:54.260082 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:54.260059 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjjsz\"" May 21 01:49:54.268169 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:54.268151 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vksc7" May 21 01:49:54.387808 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:54.387784 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vksc7"] May 21 01:49:54.390076 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:49:54.390047 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe353974_84e6_4277_9fb0_f51cdf2da42b.slice/crio-62268fac5fd01740f413ac6dd32304bc03efe4cae2160f231d54ea035a5c4e09 WatchSource:0}: Error finding container 62268fac5fd01740f413ac6dd32304bc03efe4cae2160f231d54ea035a5c4e09: Status 404 returned error can't find the container with id 62268fac5fd01740f413ac6dd32304bc03efe4cae2160f231d54ea035a5c4e09 May 21 01:49:54.471484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:54.471459 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vksc7" event={"ID":"be353974-84e6-4277-9fb0-f51cdf2da42b","Type":"ContainerStarted","Data":"62268fac5fd01740f413ac6dd32304bc03efe4cae2160f231d54ea035a5c4e09"} May 21 01:49:56.478539 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:56.478502 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vksc7" event={"ID":"be353974-84e6-4277-9fb0-f51cdf2da42b","Type":"ContainerStarted","Data":"a899ca1dd49a62e3d4cacc887656dd200dfbc082d7305476141c83a57fb852ce"} May 21 01:49:56.478903 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:56.478545 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vksc7" event={"ID":"be353974-84e6-4277-9fb0-f51cdf2da42b","Type":"ContainerStarted","Data":"89605ea7899d9d13fde2b00dd264580604399019eff8597e351df4ee8a056696"} May 21 01:49:56.478903 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:56.478738 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vksc7" May 21 01:49:56.494742 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:56.494699 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-vksc7" podStartSLOduration=129.286797812 podStartE2EDuration="2m10.494684846s" podCreationTimestamp="2026-05-21 01:47:46 +0000 UTC" firstStartedPulling="2026-05-21 01:49:54.391874417 +0000 UTC m=+163.068650140" lastFinishedPulling="2026-05-21 01:49:55.599761438 +0000 UTC m=+164.276537174" observedRunningTime="2026-05-21 01:49:56.493850683 +0000 UTC m=+165.170626410" watchObservedRunningTime="2026-05-21 01:49:56.494684846 +0000 UTC m=+165.171460592" May 21 01:49:56.571167 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:56.571142 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" podUID="e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 01:49:56.571293 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:56.571198 2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" May 21 01:49:56.571702 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:56.571674 2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"06a1e41d59e107b8de3bcd5199da6fa0439efad864dff5f12024d6da8133e08c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 01:49:56.571756 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:56.571740 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" podUID="e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e" containerName="service-proxy" containerID="cri-o://06a1e41d59e107b8de3bcd5199da6fa0439efad864dff5f12024d6da8133e08c" gracePeriod=30 May 21 01:49:57.484477 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:57.484439 2562 generic.go:358] "Generic (PLEG): container finished" podID="e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e" containerID="06a1e41d59e107b8de3bcd5199da6fa0439efad864dff5f12024d6da8133e08c" exitCode=2 May 21 01:49:57.484971 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:57.484505 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" event={"ID":"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e","Type":"ContainerDied","Data":"06a1e41d59e107b8de3bcd5199da6fa0439efad864dff5f12024d6da8133e08c"} May 21 01:49:57.484971 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:49:57.484548 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5977f7595-756mm" event={"ID":"e7372b69-a0b4-4ce9-bc9f-a38ce8f4e24e","Type":"ContainerStarted","Data":"0d65018e58dea3fdbe3cbac945c8063e6fd24e3982da524ce3770136742ae892"} May 21 01:50:00.894805 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:50:00.894772 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:50:00.897753 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:50:00.897735 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bvhf9\"" May 21 01:50:00.905471 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:50:00.905453 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7fxxf" May 21 01:50:01.018605 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:50:01.018575 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7fxxf"] May 21 01:50:01.021266 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:50:01.021227 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f608821_4201_4334_878c_2950041dbb86.slice/crio-300b70c3c8e0f029f617503609b0133e0b5e8fe45ada4b2abf5d4248b3b6c336 WatchSource:0}: Error finding container 300b70c3c8e0f029f617503609b0133e0b5e8fe45ada4b2abf5d4248b3b6c336: Status 404 returned error can't find the container with id 300b70c3c8e0f029f617503609b0133e0b5e8fe45ada4b2abf5d4248b3b6c336 May 21 01:50:01.496578 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:50:01.496541 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7fxxf" event={"ID":"8f608821-4201-4334-878c-2950041dbb86","Type":"ContainerStarted","Data":"300b70c3c8e0f029f617503609b0133e0b5e8fe45ada4b2abf5d4248b3b6c336"} May 21 01:50:03.504071 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:50:03.504031 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7fxxf" event={"ID":"8f608821-4201-4334-878c-2950041dbb86","Type":"ContainerStarted","Data":"462f9a3497f53dc7397b0d8847583a8214588e1ea490cd2a8ba23cc4e98dcaa2"} May 21 01:50:03.521693 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:50:03.521642 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7fxxf" podStartSLOduration=135.858939323 podStartE2EDuration="2m17.521627907s" podCreationTimestamp="2026-05-21 01:47:46 +0000 UTC" firstStartedPulling="2026-05-21 01:50:01.023187464 +0000 UTC m=+169.699963202" lastFinishedPulling="2026-05-21 01:50:02.685876063 +0000 UTC m=+171.362651786" observedRunningTime="2026-05-21 01:50:03.52112878 +0000 UTC m=+172.197904522" watchObservedRunningTime="2026-05-21 01:50:03.521627907 +0000 UTC m=+172.198403653" May 21 01:50:06.487233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:50:06.487206 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vksc7" May 21 01:52:11.840244 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:52:11.840217 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 01:52:11.840803 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:52:11.840318 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 01:52:11.844691 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:52:11.844674 2562 kubelet.go:1628] "Image garbage collection succeeded" May 21 01:53:47.286782 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.286745 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz"] May 21 01:53:47.289730 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.289711 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" May 21 01:53:47.292365 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.292336 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 01:53:47.293414 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.293395 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 01:53:47.293513 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.293427 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bcq4b\"" May 21 01:53:47.296229 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.296201 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz"] May 21 01:53:47.343135 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.343110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e10afdc0-301e-487d-9f81-6207b55e1ede-tmp\") pod \"openshift-lws-operator-bfc7f696d-zs5mz\" (UID: \"e10afdc0-301e-487d-9f81-6207b55e1ede\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" May 21 01:53:47.343227 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.343146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d59xr\" (UniqueName: \"kubernetes.io/projected/e10afdc0-301e-487d-9f81-6207b55e1ede-kube-api-access-d59xr\") pod \"openshift-lws-operator-bfc7f696d-zs5mz\" (UID: \"e10afdc0-301e-487d-9f81-6207b55e1ede\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" May 21 01:53:47.444416 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.444382 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d59xr\" (UniqueName: \"kubernetes.io/projected/e10afdc0-301e-487d-9f81-6207b55e1ede-kube-api-access-d59xr\") pod \"openshift-lws-operator-bfc7f696d-zs5mz\" (UID: \"e10afdc0-301e-487d-9f81-6207b55e1ede\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" May 21 01:53:47.444503 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.444455 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e10afdc0-301e-487d-9f81-6207b55e1ede-tmp\") pod \"openshift-lws-operator-bfc7f696d-zs5mz\" (UID: \"e10afdc0-301e-487d-9f81-6207b55e1ede\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" May 21 01:53:47.444795 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.444779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e10afdc0-301e-487d-9f81-6207b55e1ede-tmp\") pod \"openshift-lws-operator-bfc7f696d-zs5mz\" (UID: \"e10afdc0-301e-487d-9f81-6207b55e1ede\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" May 21 01:53:47.451822 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.451803 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d59xr\" (UniqueName: \"kubernetes.io/projected/e10afdc0-301e-487d-9f81-6207b55e1ede-kube-api-access-d59xr\") pod \"openshift-lws-operator-bfc7f696d-zs5mz\" (UID: \"e10afdc0-301e-487d-9f81-6207b55e1ede\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" May 21 01:53:47.600280 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.600216 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" May 21 01:53:47.714573 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.714540 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz"] May 21 01:53:47.718008 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:53:47.717982 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode10afdc0_301e_487d_9f81_6207b55e1ede.slice/crio-46b2ea1085374b797aff55fe1a44e031def97b760768f7de56713711b3384a96 WatchSource:0}: Error finding container 46b2ea1085374b797aff55fe1a44e031def97b760768f7de56713711b3384a96: Status 404 returned error can't find the container with id 46b2ea1085374b797aff55fe1a44e031def97b760768f7de56713711b3384a96 May 21 01:53:47.719809 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:47.719793 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 01:53:48.090572 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:48.090539 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" event={"ID":"e10afdc0-301e-487d-9f81-6207b55e1ede","Type":"ContainerStarted","Data":"46b2ea1085374b797aff55fe1a44e031def97b760768f7de56713711b3384a96"} May 21 01:53:51.099941 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:51.099901 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" event={"ID":"e10afdc0-301e-487d-9f81-6207b55e1ede","Type":"ContainerStarted","Data":"cb155187b42ba07fe7f1c31ee971a21e50ea988f73bda622dec770e32a28c5ca"} May 21 01:53:51.114968 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:53:51.114919 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-zs5mz" podStartSLOduration=1.76169916 podStartE2EDuration="4.11490877s" podCreationTimestamp="2026-05-21 01:53:47 +0000 UTC" firstStartedPulling="2026-05-21 01:53:47.719912834 +0000 UTC m=+396.396688558" lastFinishedPulling="2026-05-21 01:53:50.073122426 +0000 UTC m=+398.749898168" observedRunningTime="2026-05-21 01:53:51.113977809 +0000 UTC m=+399.790753555" watchObservedRunningTime="2026-05-21 01:53:51.11490877 +0000 UTC m=+399.791684515" May 21 01:54:11.938478 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:11.938452 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89"] May 21 01:54:11.945925 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:11.945899 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:11.948385 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:11.948360 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 01:54:11.948464 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:11.948399 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 01:54:11.948641 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:11.948628 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fxg7r\"" May 21 01:54:11.948816 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:11.948787 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 01:54:11.948864 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:11.948849 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 01:54:11.955241 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:11.955223 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89"] May 21 01:54:12.004096 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.004070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/714874fa-5ff1-4ac4-9e44-cfcd95c0314f-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-97g89\" (UID: \"714874fa-5ff1-4ac4-9e44-cfcd95c0314f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.004188 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.004140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs5x9\" (UniqueName: \"kubernetes.io/projected/714874fa-5ff1-4ac4-9e44-cfcd95c0314f-kube-api-access-fs5x9\") pod \"opendatahub-operator-controller-manager-64cdd6779c-97g89\" (UID: \"714874fa-5ff1-4ac4-9e44-cfcd95c0314f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.004188 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.004169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/714874fa-5ff1-4ac4-9e44-cfcd95c0314f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-97g89\" (UID: \"714874fa-5ff1-4ac4-9e44-cfcd95c0314f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.104876 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.104851 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/714874fa-5ff1-4ac4-9e44-cfcd95c0314f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-97g89\" (UID: \"714874fa-5ff1-4ac4-9e44-cfcd95c0314f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.104973 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.104883 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/714874fa-5ff1-4ac4-9e44-cfcd95c0314f-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-97g89\" (UID: \"714874fa-5ff1-4ac4-9e44-cfcd95c0314f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.104973 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.104933 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs5x9\" (UniqueName: \"kubernetes.io/projected/714874fa-5ff1-4ac4-9e44-cfcd95c0314f-kube-api-access-fs5x9\") pod \"opendatahub-operator-controller-manager-64cdd6779c-97g89\" (UID: \"714874fa-5ff1-4ac4-9e44-cfcd95c0314f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.107148 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.107130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/714874fa-5ff1-4ac4-9e44-cfcd95c0314f-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-97g89\" (UID: \"714874fa-5ff1-4ac4-9e44-cfcd95c0314f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.107222 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.107154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/714874fa-5ff1-4ac4-9e44-cfcd95c0314f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-97g89\" (UID: \"714874fa-5ff1-4ac4-9e44-cfcd95c0314f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.114181 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.114159 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs5x9\" (UniqueName: \"kubernetes.io/projected/714874fa-5ff1-4ac4-9e44-cfcd95c0314f-kube-api-access-fs5x9\") pod \"opendatahub-operator-controller-manager-64cdd6779c-97g89\" (UID: \"714874fa-5ff1-4ac4-9e44-cfcd95c0314f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.255687 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.255665 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:12.378924 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:12.378895 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89"] May 21 01:54:12.382064 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:54:12.382033 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714874fa_5ff1_4ac4_9e44_cfcd95c0314f.slice/crio-6c29518a8d1c2c0504a2a293a59919f746a78675486290307376768cc92b5b1f WatchSource:0}: Error finding container 6c29518a8d1c2c0504a2a293a59919f746a78675486290307376768cc92b5b1f: Status 404 returned error can't find the container with id 6c29518a8d1c2c0504a2a293a59919f746a78675486290307376768cc92b5b1f May 21 01:54:13.159766 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:13.159729 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" event={"ID":"714874fa-5ff1-4ac4-9e44-cfcd95c0314f","Type":"ContainerStarted","Data":"6c29518a8d1c2c0504a2a293a59919f746a78675486290307376768cc92b5b1f"} May 21 01:54:14.633865 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.633817 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v"] May 21 01:54:14.639146 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.639125 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.643497 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.643378 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 01:54:14.643497 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.643392 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 01:54:14.643643 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.643632 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 01:54:14.643788 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.643775 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fllhs\"" May 21 01:54:14.644766 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.644745 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v"] May 21 01:54:14.725587 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.725553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c805e092-fb11-41c9-95fa-5443bceb5d63-metrics-cert\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.725587 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.725589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w69c8\" (UniqueName: \"kubernetes.io/projected/c805e092-fb11-41c9-95fa-5443bceb5d63-kube-api-access-w69c8\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.725833 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.725668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c805e092-fb11-41c9-95fa-5443bceb5d63-manager-config\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.725833 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.725726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c805e092-fb11-41c9-95fa-5443bceb5d63-cert\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.827057 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.827028 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c805e092-fb11-41c9-95fa-5443bceb5d63-manager-config\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.827057 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.827060 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c805e092-fb11-41c9-95fa-5443bceb5d63-cert\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.827267 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.827088 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c805e092-fb11-41c9-95fa-5443bceb5d63-metrics-cert\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.827267 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.827121 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w69c8\" (UniqueName: \"kubernetes.io/projected/c805e092-fb11-41c9-95fa-5443bceb5d63-kube-api-access-w69c8\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.827671 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.827649 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c805e092-fb11-41c9-95fa-5443bceb5d63-manager-config\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.829570 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.829548 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c805e092-fb11-41c9-95fa-5443bceb5d63-cert\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.829704 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.829684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c805e092-fb11-41c9-95fa-5443bceb5d63-metrics-cert\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.840025 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.840001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w69c8\" (UniqueName: \"kubernetes.io/projected/c805e092-fb11-41c9-95fa-5443bceb5d63-kube-api-access-w69c8\") pod \"lws-controller-manager-5c8fd9c4f9-66d8v\" (UID: \"c805e092-fb11-41c9-95fa-5443bceb5d63\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:14.952120 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:14.952080 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:15.072851 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:15.072775 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v"] May 21 01:54:15.075435 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:54:15.075407 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc805e092_fb11_41c9_95fa_5443bceb5d63.slice/crio-a272dd30ae4ccd079c53a9ce6cf525bbfcee7bf0812899e86b67e2fc86678983 WatchSource:0}: Error finding container a272dd30ae4ccd079c53a9ce6cf525bbfcee7bf0812899e86b67e2fc86678983: Status 404 returned error can't find the container with id a272dd30ae4ccd079c53a9ce6cf525bbfcee7bf0812899e86b67e2fc86678983 May 21 01:54:15.167418 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:15.167358 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" event={"ID":"714874fa-5ff1-4ac4-9e44-cfcd95c0314f","Type":"ContainerStarted","Data":"813e9bd3b6f8e70b66bda0a4a8e818af1a17ddfe6ffcff3780ddff8aa43fb00f"} May 21 01:54:15.167518 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:15.167452 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:15.168412 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:15.168392 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" event={"ID":"c805e092-fb11-41c9-95fa-5443bceb5d63","Type":"ContainerStarted","Data":"a272dd30ae4ccd079c53a9ce6cf525bbfcee7bf0812899e86b67e2fc86678983"} May 21 01:54:15.189510 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:15.189463 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" podStartSLOduration=1.71004582 podStartE2EDuration="4.189448247s" podCreationTimestamp="2026-05-21 01:54:11 +0000 UTC" firstStartedPulling="2026-05-21 01:54:12.383795679 +0000 UTC m=+421.060571402" lastFinishedPulling="2026-05-21 01:54:14.863198105 +0000 UTC m=+423.539973829" observedRunningTime="2026-05-21 01:54:15.189129033 +0000 UTC m=+423.865904779" watchObservedRunningTime="2026-05-21 01:54:15.189448247 +0000 UTC m=+423.866223993" May 21 01:54:18.176697 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:18.176663 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" event={"ID":"c805e092-fb11-41c9-95fa-5443bceb5d63","Type":"ContainerStarted","Data":"d3e9b08f6de896c11b51f0d4a4c27c8284fe109373680a71eab4a8e840b07cb7"} May 21 01:54:18.177201 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:18.176790 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:54:18.193604 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:18.193562 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" podStartSLOduration=1.8998910599999999 podStartE2EDuration="4.193550732s" podCreationTimestamp="2026-05-21 01:54:14 +0000 UTC" firstStartedPulling="2026-05-21 01:54:15.077136197 +0000 UTC m=+423.753911921" lastFinishedPulling="2026-05-21 01:54:17.37079587 +0000 UTC m=+426.047571593" observedRunningTime="2026-05-21 01:54:18.192216196 +0000 UTC m=+426.868991943" watchObservedRunningTime="2026-05-21 01:54:18.193550732 +0000 UTC m=+426.870326537" May 21 01:54:26.173246 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:26.173201 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-97g89" May 21 01:54:29.181283 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:54:29.181172 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-66d8v" May 21 01:55:16.603008 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.602968 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx"] May 21 01:55:16.606450 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.606422 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.609460 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.609431 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-29tzj\"" May 21 01:55:16.609760 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.609734 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 01:55:16.609885 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.609792 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 01:55:16.610097 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.610078 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 01:55:16.619249 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.619222 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx"] May 21 01:55:16.736734 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.736702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.736853 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.736748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.736853 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.736773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.736935 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.736862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.736935 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.736893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.736935 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.736917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh88q\" (UniqueName: \"kubernetes.io/projected/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-kube-api-access-qh88q\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.737043 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.736974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.737043 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.737024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.737104 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.737048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838033 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838010 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838150 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838042 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh88q\" (UniqueName: \"kubernetes.io/projected/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-kube-api-access-qh88q\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838150 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838064 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838150 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838097 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838340 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838148 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838340 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838192 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838340 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838230 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838340 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838281 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838540 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838345 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838679 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838660 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838790 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.838909 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.838839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.839045 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.839025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.839104 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.839028 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.840554 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.840527 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.840633 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.840609 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.848817 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.848799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.848904 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.848854 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh88q\" (UniqueName: \"kubernetes.io/projected/6fcc27c0-bd0f-4a9c-87c1-324cd98473dc-kube-api-access-qh88q\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx\" (UID: \"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:16.919056 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:16.919000 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:17.059226 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:17.059195 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx"] May 21 01:55:17.062352 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:55:17.062321 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fcc27c0_bd0f_4a9c_87c1_324cd98473dc.slice/crio-b76ffbb4df2e09a8f4711b67d6199835fbc761737c0570e8ecc9c8540491739d WatchSource:0}: Error finding container b76ffbb4df2e09a8f4711b67d6199835fbc761737c0570e8ecc9c8540491739d: Status 404 returned error can't find the container with id b76ffbb4df2e09a8f4711b67d6199835fbc761737c0570e8ecc9c8540491739d May 21 01:55:17.335501 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:17.335468 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" event={"ID":"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc","Type":"ContainerStarted","Data":"b76ffbb4df2e09a8f4711b67d6199835fbc761737c0570e8ecc9c8540491739d"} May 21 01:55:19.469946 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:19.469908 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 01:55:19.470226 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:19.469979 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 01:55:19.470226 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:19.470005 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 01:55:20.344202 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:20.344167 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" event={"ID":"6fcc27c0-bd0f-4a9c-87c1-324cd98473dc","Type":"ContainerStarted","Data":"1d653a75222ae49c6feb120550d89265cfab25b230908448a3d617ae04496fb9"} May 21 01:55:20.365916 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:20.365862 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" podStartSLOduration=1.960311433 podStartE2EDuration="4.365846851s" podCreationTimestamp="2026-05-21 01:55:16 +0000 UTC" firstStartedPulling="2026-05-21 01:55:17.064155584 +0000 UTC m=+485.740931307" lastFinishedPulling="2026-05-21 01:55:19.469690985 +0000 UTC m=+488.146466725" observedRunningTime="2026-05-21 01:55:20.364742124 +0000 UTC m=+489.041517870" watchObservedRunningTime="2026-05-21 01:55:20.365846851 +0000 UTC m=+489.042622606" May 21 01:55:20.919483 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:20.919451 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:20.923702 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:20.923677 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:21.347026 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:21.346997 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:21.347933 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:21.347912 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx" May 21 01:55:30.047233 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.047185 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hgtrd"] May 21 01:55:30.050119 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.050101 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" May 21 01:55:30.052607 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.052588 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 01:55:30.052929 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.052907 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 01:55:30.053964 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.053950 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rdxzh\"" May 21 01:55:30.057390 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.057359 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hgtrd"] May 21 01:55:30.233437 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.233410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvsj2\" (UniqueName: \"kubernetes.io/projected/b5f07cad-8a28-4f08-a628-cbab6ade37d3-kube-api-access-kvsj2\") pod \"kuadrant-operator-catalog-hgtrd\" (UID: \"b5f07cad-8a28-4f08-a628-cbab6ade37d3\") " pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" May 21 01:55:30.334382 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.334319 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvsj2\" (UniqueName: \"kubernetes.io/projected/b5f07cad-8a28-4f08-a628-cbab6ade37d3-kube-api-access-kvsj2\") pod \"kuadrant-operator-catalog-hgtrd\" (UID: \"b5f07cad-8a28-4f08-a628-cbab6ade37d3\") " pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" May 21 01:55:30.344589 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.344566 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvsj2\" (UniqueName: \"kubernetes.io/projected/b5f07cad-8a28-4f08-a628-cbab6ade37d3-kube-api-access-kvsj2\") pod \"kuadrant-operator-catalog-hgtrd\" (UID: \"b5f07cad-8a28-4f08-a628-cbab6ade37d3\") " pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" May 21 01:55:30.360425 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.360402 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" May 21 01:55:30.411520 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.411490 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hgtrd"] May 21 01:55:30.478603 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.478575 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hgtrd"] May 21 01:55:30.481529 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:55:30.481506 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f07cad_8a28_4f08_a628_cbab6ade37d3.slice/crio-2f6f45780fd990d98dc3489ebaef141f0c4d689cfeb2cd7d45e13295826c9c7d WatchSource:0}: Error finding container 2f6f45780fd990d98dc3489ebaef141f0c4d689cfeb2cd7d45e13295826c9c7d: Status 404 returned error can't find the container with id 2f6f45780fd990d98dc3489ebaef141f0c4d689cfeb2cd7d45e13295826c9c7d May 21 01:55:30.622534 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.622479 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hh5qd"] May 21 01:55:30.626654 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.626639 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" May 21 01:55:30.631769 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.631748 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hh5qd"] May 21 01:55:30.738251 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.738229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcqmb\" (UniqueName: \"kubernetes.io/projected/17329c81-f051-4271-b9d0-c679d40661d2-kube-api-access-kcqmb\") pod \"kuadrant-operator-catalog-hh5qd\" (UID: \"17329c81-f051-4271-b9d0-c679d40661d2\") " pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" May 21 01:55:30.838796 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.838768 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcqmb\" (UniqueName: \"kubernetes.io/projected/17329c81-f051-4271-b9d0-c679d40661d2-kube-api-access-kcqmb\") pod \"kuadrant-operator-catalog-hh5qd\" (UID: \"17329c81-f051-4271-b9d0-c679d40661d2\") " pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" May 21 01:55:30.846473 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.846451 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcqmb\" (UniqueName: \"kubernetes.io/projected/17329c81-f051-4271-b9d0-c679d40661d2-kube-api-access-kcqmb\") pod \"kuadrant-operator-catalog-hh5qd\" (UID: \"17329c81-f051-4271-b9d0-c679d40661d2\") " pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" May 21 01:55:30.936806 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:30.936753 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" May 21 01:55:31.057961 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:31.057926 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hh5qd"] May 21 01:55:31.061113 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:55:31.061075 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17329c81_f051_4271_b9d0_c679d40661d2.slice/crio-b98329390407b6996ccf6dfcbf27d9a766670a131276b0067350f3e7f7bc750c WatchSource:0}: Error finding container b98329390407b6996ccf6dfcbf27d9a766670a131276b0067350f3e7f7bc750c: Status 404 returned error can't find the container with id b98329390407b6996ccf6dfcbf27d9a766670a131276b0067350f3e7f7bc750c May 21 01:55:31.376029 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:31.375969 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" event={"ID":"b5f07cad-8a28-4f08-a628-cbab6ade37d3","Type":"ContainerStarted","Data":"2f6f45780fd990d98dc3489ebaef141f0c4d689cfeb2cd7d45e13295826c9c7d"} May 21 01:55:31.377311 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:31.377274 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" event={"ID":"17329c81-f051-4271-b9d0-c679d40661d2","Type":"ContainerStarted","Data":"b98329390407b6996ccf6dfcbf27d9a766670a131276b0067350f3e7f7bc750c"} May 21 01:55:33.385381 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:33.385341 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" event={"ID":"b5f07cad-8a28-4f08-a628-cbab6ade37d3","Type":"ContainerStarted","Data":"7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d"} May 21 01:55:33.385860 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:33.385435 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" podUID="b5f07cad-8a28-4f08-a628-cbab6ade37d3" containerName="registry-server" containerID="cri-o://7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d" gracePeriod=2 May 21 01:55:33.387032 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:33.387000 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" event={"ID":"17329c81-f051-4271-b9d0-c679d40661d2","Type":"ContainerStarted","Data":"5d2b5f5c945d005ffae7f54d9f3fdb7ba3dbe3c6c45c1554fd9e9e87d4f6d992"} May 21 01:55:33.400887 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:33.400833 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" podStartSLOduration=1.271839957 podStartE2EDuration="3.400819299s" podCreationTimestamp="2026-05-21 01:55:30 +0000 UTC" firstStartedPulling="2026-05-21 01:55:30.482769612 +0000 UTC m=+499.159545336" lastFinishedPulling="2026-05-21 01:55:32.611748951 +0000 UTC m=+501.288524678" observedRunningTime="2026-05-21 01:55:33.399034701 +0000 UTC m=+502.075810451" watchObservedRunningTime="2026-05-21 01:55:33.400819299 +0000 UTC m=+502.077595044" May 21 01:55:33.412673 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:33.412630 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" podStartSLOduration=1.862890736 podStartE2EDuration="3.412617677s" podCreationTimestamp="2026-05-21 01:55:30 +0000 UTC" firstStartedPulling="2026-05-21 01:55:31.062467719 +0000 UTC m=+499.739243443" lastFinishedPulling="2026-05-21 01:55:32.61219466 +0000 UTC m=+501.288970384" observedRunningTime="2026-05-21 01:55:33.412002714 +0000 UTC m=+502.088778460" watchObservedRunningTime="2026-05-21 01:55:33.412617677 +0000 UTC m=+502.089393452" May 21 01:55:33.623830 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:33.623806 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" May 21 01:55:33.661428 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:33.661378 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvsj2\" (UniqueName: \"kubernetes.io/projected/b5f07cad-8a28-4f08-a628-cbab6ade37d3-kube-api-access-kvsj2\") pod \"b5f07cad-8a28-4f08-a628-cbab6ade37d3\" (UID: \"b5f07cad-8a28-4f08-a628-cbab6ade37d3\") " May 21 01:55:33.663519 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:33.663493 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5f07cad-8a28-4f08-a628-cbab6ade37d3-kube-api-access-kvsj2" (OuterVolumeSpecName: "kube-api-access-kvsj2") pod "b5f07cad-8a28-4f08-a628-cbab6ade37d3" (UID: "b5f07cad-8a28-4f08-a628-cbab6ade37d3"). InnerVolumeSpecName "kube-api-access-kvsj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 01:55:33.762242 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:33.762218 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvsj2\" (UniqueName: \"kubernetes.io/projected/b5f07cad-8a28-4f08-a628-cbab6ade37d3-kube-api-access-kvsj2\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:55:34.391140 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:34.391102 2562 generic.go:358] "Generic (PLEG): container finished" podID="b5f07cad-8a28-4f08-a628-cbab6ade37d3" containerID="7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d" exitCode=0 May 21 01:55:34.391570 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:34.391155 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" event={"ID":"b5f07cad-8a28-4f08-a628-cbab6ade37d3","Type":"ContainerDied","Data":"7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d"} May 21 01:55:34.391570 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:34.391194 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" May 21 01:55:34.391570 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:34.391208 2562 scope.go:117] "RemoveContainer" containerID="7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d" May 21 01:55:34.391570 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:34.391197 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hgtrd" event={"ID":"b5f07cad-8a28-4f08-a628-cbab6ade37d3","Type":"ContainerDied","Data":"2f6f45780fd990d98dc3489ebaef141f0c4d689cfeb2cd7d45e13295826c9c7d"} May 21 01:55:34.399246 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:34.399227 2562 scope.go:117] "RemoveContainer" containerID="7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d" May 21 01:55:34.399563 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:55:34.399542 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d\": container with ID starting with 7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d not found: ID does not exist" containerID="7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d" May 21 01:55:34.399616 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:34.399572 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d"} err="failed to get container status \"7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d\": rpc error: code = NotFound desc = could not find container \"7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d\": container with ID starting with 7dfac628454dfba9abfd5751a433cf0074d32516ff0813c217c7d2f7e102069d not found: ID does not exist" May 21 01:55:34.406520 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:34.406500 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hgtrd"] May 21 01:55:34.409919 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:34.409900 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hgtrd"] May 21 01:55:35.898776 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:35.898740 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5f07cad-8a28-4f08-a628-cbab6ade37d3" path="/var/lib/kubelet/pods/b5f07cad-8a28-4f08-a628-cbab6ade37d3/volumes" May 21 01:55:40.937564 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:40.937524 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" May 21 01:55:40.937564 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:40.937574 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" May 21 01:55:40.959582 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:40.959560 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" May 21 01:55:41.436894 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:55:41.436871 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hh5qd" May 21 01:56:01.647142 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.647071 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh"] May 21 01:56:01.647620 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.647377 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5f07cad-8a28-4f08-a628-cbab6ade37d3" containerName="registry-server" May 21 01:56:01.647620 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.647391 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5f07cad-8a28-4f08-a628-cbab6ade37d3" containerName="registry-server" May 21 01:56:01.647620 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.647442 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5f07cad-8a28-4f08-a628-cbab6ade37d3" containerName="registry-server" May 21 01:56:01.649904 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.649888 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" May 21 01:56:01.652535 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.652515 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-s8rcl\"" May 21 01:56:01.656950 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.656929 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh"] May 21 01:56:01.756633 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.756606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw9cv\" (UniqueName: \"kubernetes.io/projected/a5b806b5-0657-47ee-a8d1-2500a0ac32a8-kube-api-access-kw9cv\") pod \"limitador-operator-controller-manager-85c4996f8c-gt5fh\" (UID: \"a5b806b5-0657-47ee-a8d1-2500a0ac32a8\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" May 21 01:56:01.857138 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.857111 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kw9cv\" (UniqueName: \"kubernetes.io/projected/a5b806b5-0657-47ee-a8d1-2500a0ac32a8-kube-api-access-kw9cv\") pod \"limitador-operator-controller-manager-85c4996f8c-gt5fh\" (UID: \"a5b806b5-0657-47ee-a8d1-2500a0ac32a8\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" May 21 01:56:01.874057 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.874030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw9cv\" (UniqueName: \"kubernetes.io/projected/a5b806b5-0657-47ee-a8d1-2500a0ac32a8-kube-api-access-kw9cv\") pod \"limitador-operator-controller-manager-85c4996f8c-gt5fh\" (UID: \"a5b806b5-0657-47ee-a8d1-2500a0ac32a8\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" May 21 01:56:01.960304 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:01.960236 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" May 21 01:56:02.086414 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:02.086386 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh"] May 21 01:56:02.089325 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:56:02.089299 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b806b5_0657_47ee_a8d1_2500a0ac32a8.slice/crio-cd887908d2632f95096359c3e870e8384e97f7368761c6d59bbe840867c98c25 WatchSource:0}: Error finding container cd887908d2632f95096359c3e870e8384e97f7368761c6d59bbe840867c98c25: Status 404 returned error can't find the container with id cd887908d2632f95096359c3e870e8384e97f7368761c6d59bbe840867c98c25 May 21 01:56:02.479306 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:02.479271 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" event={"ID":"a5b806b5-0657-47ee-a8d1-2500a0ac32a8","Type":"ContainerStarted","Data":"cd887908d2632f95096359c3e870e8384e97f7368761c6d59bbe840867c98c25"} May 21 01:56:04.487220 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:04.487176 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" event={"ID":"a5b806b5-0657-47ee-a8d1-2500a0ac32a8","Type":"ContainerStarted","Data":"8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c"} May 21 01:56:04.487659 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:04.487312 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" May 21 01:56:04.505978 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:04.505936 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" podStartSLOduration=1.836389327 podStartE2EDuration="3.505922477s" podCreationTimestamp="2026-05-21 01:56:01 +0000 UTC" firstStartedPulling="2026-05-21 01:56:02.091185851 +0000 UTC m=+530.767961579" lastFinishedPulling="2026-05-21 01:56:03.760718991 +0000 UTC m=+532.437494729" observedRunningTime="2026-05-21 01:56:04.50453248 +0000 UTC m=+533.181308227" watchObservedRunningTime="2026-05-21 01:56:04.505922477 +0000 UTC m=+533.182698222" May 21 01:56:09.900484 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:09.900451 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd"] May 21 01:56:09.903933 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:09.903909 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" May 21 01:56:09.906522 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:09.906502 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 01:56:09.906522 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:09.906509 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-md2d4\"" May 21 01:56:09.913142 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:09.913117 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd"] May 21 01:56:10.013889 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:10.013857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv7xb\" (UniqueName: \"kubernetes.io/projected/aed1abfb-1600-4c37-a444-9e0e38b26b46-kube-api-access-xv7xb\") pod \"dns-operator-controller-manager-648d5c98bc-j7lnd\" (UID: \"aed1abfb-1600-4c37-a444-9e0e38b26b46\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" May 21 01:56:10.114776 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:10.114747 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xv7xb\" (UniqueName: \"kubernetes.io/projected/aed1abfb-1600-4c37-a444-9e0e38b26b46-kube-api-access-xv7xb\") pod \"dns-operator-controller-manager-648d5c98bc-j7lnd\" (UID: \"aed1abfb-1600-4c37-a444-9e0e38b26b46\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" May 21 01:56:10.125100 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:10.125078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv7xb\" (UniqueName: \"kubernetes.io/projected/aed1abfb-1600-4c37-a444-9e0e38b26b46-kube-api-access-xv7xb\") pod \"dns-operator-controller-manager-648d5c98bc-j7lnd\" (UID: \"aed1abfb-1600-4c37-a444-9e0e38b26b46\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" May 21 01:56:10.215361 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:10.215337 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" May 21 01:56:10.336322 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:10.336288 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd"] May 21 01:56:10.339026 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:56:10.338997 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed1abfb_1600_4c37_a444_9e0e38b26b46.slice/crio-349ee5e56d4736041bc444ec851ed2e13b6d9d39de14376a81204bf16ba8dfa1 WatchSource:0}: Error finding container 349ee5e56d4736041bc444ec851ed2e13b6d9d39de14376a81204bf16ba8dfa1: Status 404 returned error can't find the container with id 349ee5e56d4736041bc444ec851ed2e13b6d9d39de14376a81204bf16ba8dfa1 May 21 01:56:10.507442 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:10.507384 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" event={"ID":"aed1abfb-1600-4c37-a444-9e0e38b26b46","Type":"ContainerStarted","Data":"349ee5e56d4736041bc444ec851ed2e13b6d9d39de14376a81204bf16ba8dfa1"} May 21 01:56:12.399413 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:12.399393 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 01:56:12.515562 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:12.515534 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" event={"ID":"aed1abfb-1600-4c37-a444-9e0e38b26b46","Type":"ContainerStarted","Data":"65337284f2242b73a322281b4525ab2b3a1ed8959cdf2544ca71e3cb314d592b"} May 21 01:56:12.515666 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:12.515657 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" May 21 01:56:12.530989 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:12.530950 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" podStartSLOduration=1.4749773290000001 podStartE2EDuration="3.530936531s" podCreationTimestamp="2026-05-21 01:56:09 +0000 UTC" firstStartedPulling="2026-05-21 01:56:10.340847532 +0000 UTC m=+539.017623256" lastFinishedPulling="2026-05-21 01:56:12.396806731 +0000 UTC m=+541.073582458" observedRunningTime="2026-05-21 01:56:12.530302953 +0000 UTC m=+541.207078701" watchObservedRunningTime="2026-05-21 01:56:12.530936531 +0000 UTC m=+541.207712276" May 21 01:56:15.050856 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.050828 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk"] May 21 01:56:15.053890 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.053874 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.056364 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.056341 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 01:56:15.056364 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.056360 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 01:56:15.056542 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.056371 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5cvtl\"" May 21 01:56:15.060230 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.060208 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk"] May 21 01:56:15.149948 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.149920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a8aa430-3595-47a1-b2e1-934dec655c84-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-7wqzk\" (UID: \"3a8aa430-3595-47a1-b2e1-934dec655c84\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.150061 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.149976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpn66\" (UniqueName: \"kubernetes.io/projected/3a8aa430-3595-47a1-b2e1-934dec655c84-kube-api-access-rpn66\") pod \"kuadrant-console-plugin-6cb54b5c86-7wqzk\" (UID: \"3a8aa430-3595-47a1-b2e1-934dec655c84\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.150061 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.150050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a8aa430-3595-47a1-b2e1-934dec655c84-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-7wqzk\" (UID: \"3a8aa430-3595-47a1-b2e1-934dec655c84\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.250912 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.250886 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a8aa430-3595-47a1-b2e1-934dec655c84-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-7wqzk\" (UID: \"3a8aa430-3595-47a1-b2e1-934dec655c84\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.251002 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.250917 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a8aa430-3595-47a1-b2e1-934dec655c84-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-7wqzk\" (UID: \"3a8aa430-3595-47a1-b2e1-934dec655c84\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.251002 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.250968 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpn66\" (UniqueName: \"kubernetes.io/projected/3a8aa430-3595-47a1-b2e1-934dec655c84-kube-api-access-rpn66\") pod \"kuadrant-console-plugin-6cb54b5c86-7wqzk\" (UID: \"3a8aa430-3595-47a1-b2e1-934dec655c84\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.251618 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.251598 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a8aa430-3595-47a1-b2e1-934dec655c84-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-7wqzk\" (UID: \"3a8aa430-3595-47a1-b2e1-934dec655c84\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.253206 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.253184 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a8aa430-3595-47a1-b2e1-934dec655c84-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-7wqzk\" (UID: \"3a8aa430-3595-47a1-b2e1-934dec655c84\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.259025 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.259001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpn66\" (UniqueName: \"kubernetes.io/projected/3a8aa430-3595-47a1-b2e1-934dec655c84-kube-api-access-rpn66\") pod \"kuadrant-console-plugin-6cb54b5c86-7wqzk\" (UID: \"3a8aa430-3595-47a1-b2e1-934dec655c84\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.363552 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.363501 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" May 21 01:56:15.482976 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.482950 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk"] May 21 01:56:15.485519 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:56:15.485486 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a8aa430_3595_47a1_b2e1_934dec655c84.slice/crio-162aa08911c33f1d7e78b8d5ae388a24d8b049cec8cdc5d124fb6d186e4534b9 WatchSource:0}: Error finding container 162aa08911c33f1d7e78b8d5ae388a24d8b049cec8cdc5d124fb6d186e4534b9: Status 404 returned error can't find the container with id 162aa08911c33f1d7e78b8d5ae388a24d8b049cec8cdc5d124fb6d186e4534b9 May 21 01:56:15.491729 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.491712 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" May 21 01:56:15.525431 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:15.525409 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" event={"ID":"3a8aa430-3595-47a1-b2e1-934dec655c84","Type":"ContainerStarted","Data":"162aa08911c33f1d7e78b8d5ae388a24d8b049cec8cdc5d124fb6d186e4534b9"} May 21 01:56:23.521240 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:23.521208 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-j7lnd" May 21 01:56:26.054234 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.054203 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh"] May 21 01:56:26.054856 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.054531 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" podUID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" containerName="manager" containerID="cri-o://8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c" gracePeriod=2 May 21 01:56:26.060525 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.060426 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh"] May 21 01:56:26.078500 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.078466 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw"] May 21 01:56:26.078789 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.078763 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" containerName="manager" May 21 01:56:26.078789 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.078784 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" containerName="manager" May 21 01:56:26.078925 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.078861 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" containerName="manager" May 21 01:56:26.092392 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.092372 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw"] May 21 01:56:26.092517 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.092503 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" May 21 01:56:26.095170 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.095053 2562 status_manager.go:895] "Failed to get status for pod" podUID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" err="pods \"limitador-operator-controller-manager-85c4996f8c-gt5fh\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" May 21 01:56:26.245145 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.245117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gph56\" (UniqueName: \"kubernetes.io/projected/43884786-888b-4cd5-9b6b-8ac2240d4442-kube-api-access-gph56\") pod \"limitador-operator-controller-manager-85c4996f8c-jmmlw\" (UID: \"43884786-888b-4cd5-9b6b-8ac2240d4442\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" May 21 01:56:26.346622 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.346536 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gph56\" (UniqueName: \"kubernetes.io/projected/43884786-888b-4cd5-9b6b-8ac2240d4442-kube-api-access-gph56\") pod \"limitador-operator-controller-manager-85c4996f8c-jmmlw\" (UID: \"43884786-888b-4cd5-9b6b-8ac2240d4442\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" May 21 01:56:26.354704 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.354678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gph56\" (UniqueName: \"kubernetes.io/projected/43884786-888b-4cd5-9b6b-8ac2240d4442-kube-api-access-gph56\") pod \"limitador-operator-controller-manager-85c4996f8c-jmmlw\" (UID: \"43884786-888b-4cd5-9b6b-8ac2240d4442\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" May 21 01:56:26.452804 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:26.452730 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" May 21 01:56:36.732966 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:36.732939 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" May 21 01:56:36.735495 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:36.735467 2562 status_manager.go:895] "Failed to get status for pod" podUID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" err="pods \"limitador-operator-controller-manager-85c4996f8c-gt5fh\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" May 21 01:56:36.748611 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:36.748590 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw"] May 21 01:56:36.751708 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:56:36.751684 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43884786_888b_4cd5_9b6b_8ac2240d4442.slice/crio-062abac98cd7bcfc6330c9a164a3b3a370e4568e8fa073d923b2f3ab31f92874 WatchSource:0}: Error finding container 062abac98cd7bcfc6330c9a164a3b3a370e4568e8fa073d923b2f3ab31f92874: Status 404 returned error can't find the container with id 062abac98cd7bcfc6330c9a164a3b3a370e4568e8fa073d923b2f3ab31f92874 May 21 01:56:36.835034 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:36.835013 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw9cv\" (UniqueName: \"kubernetes.io/projected/a5b806b5-0657-47ee-a8d1-2500a0ac32a8-kube-api-access-kw9cv\") pod \"a5b806b5-0657-47ee-a8d1-2500a0ac32a8\" (UID: \"a5b806b5-0657-47ee-a8d1-2500a0ac32a8\") " May 21 01:56:36.836732 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:36.836709 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5b806b5-0657-47ee-a8d1-2500a0ac32a8-kube-api-access-kw9cv" (OuterVolumeSpecName: "kube-api-access-kw9cv") pod "a5b806b5-0657-47ee-a8d1-2500a0ac32a8" (UID: "a5b806b5-0657-47ee-a8d1-2500a0ac32a8"). InnerVolumeSpecName "kube-api-access-kw9cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 01:56:36.936458 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:36.936409 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw9cv\" (UniqueName: \"kubernetes.io/projected/a5b806b5-0657-47ee-a8d1-2500a0ac32a8-kube-api-access-kw9cv\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:56:37.600335 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.600292 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" event={"ID":"3a8aa430-3595-47a1-b2e1-934dec655c84","Type":"ContainerStarted","Data":"d9cb97fd7a385d2e41ffb35dc87eb46a700b3b18e563cc212349f65a73a43df4"} May 21 01:56:37.601723 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.601692 2562 generic.go:358] "Generic (PLEG): container finished" podID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" containerID="8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c" exitCode=0 May 21 01:56:37.601874 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.601739 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" May 21 01:56:37.601874 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.601800 2562 scope.go:117] "RemoveContainer" containerID="8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c" May 21 01:56:37.603990 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.603964 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" event={"ID":"43884786-888b-4cd5-9b6b-8ac2240d4442","Type":"ContainerStarted","Data":"adb959b9e43d989fc047e67fac495ca8565be9b9e34e48829ae9f8813e4af374"} May 21 01:56:37.603990 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.603998 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" event={"ID":"43884786-888b-4cd5-9b6b-8ac2240d4442","Type":"ContainerStarted","Data":"062abac98cd7bcfc6330c9a164a3b3a370e4568e8fa073d923b2f3ab31f92874"} May 21 01:56:37.604206 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.604101 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" May 21 01:56:37.611032 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.611009 2562 scope.go:117] "RemoveContainer" containerID="8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c" May 21 01:56:37.611304 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:56:37.611287 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c\": container with ID starting with 8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c not found: ID does not exist" containerID="8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c" May 21 01:56:37.611359 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.611312 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c"} err="failed to get container status \"8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c\": rpc error: code = NotFound desc = could not find container \"8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c\": container with ID starting with 8db0b3bc1201bf510e15f2c553d4126861e19f4afd062210fb7ee096d80e6a6c not found: ID does not exist" May 21 01:56:37.616871 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.616832 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-7wqzk" podStartSLOduration=1.394371389 podStartE2EDuration="22.616820766s" podCreationTimestamp="2026-05-21 01:56:15 +0000 UTC" firstStartedPulling="2026-05-21 01:56:15.486785341 +0000 UTC m=+544.163561077" lastFinishedPulling="2026-05-21 01:56:36.709234728 +0000 UTC m=+565.386010454" observedRunningTime="2026-05-21 01:56:37.615597999 +0000 UTC m=+566.292373745" watchObservedRunningTime="2026-05-21 01:56:37.616820766 +0000 UTC m=+566.293596512" May 21 01:56:37.617769 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.617745 2562 status_manager.go:895] "Failed to get status for pod" podUID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" err="pods \"limitador-operator-controller-manager-85c4996f8c-gt5fh\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" May 21 01:56:37.619678 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.619657 2562 status_manager.go:895] "Failed to get status for pod" podUID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gt5fh" err="pods \"limitador-operator-controller-manager-85c4996f8c-gt5fh\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" May 21 01:56:37.899371 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:37.899300 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5b806b5-0657-47ee-a8d1-2500a0ac32a8" path="/var/lib/kubelet/pods/a5b806b5-0657-47ee-a8d1-2500a0ac32a8/volumes" May 21 01:56:48.610947 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:48.610909 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" May 21 01:56:48.627888 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:48.627834 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jmmlw" podStartSLOduration=22.627819482 podStartE2EDuration="22.627819482s" podCreationTimestamp="2026-05-21 01:56:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:56:37.637965084 +0000 UTC m=+566.314740830" watchObservedRunningTime="2026-05-21 01:56:48.627819482 +0000 UTC m=+577.304595227" May 21 01:56:54.645738 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.645703 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw"] May 21 01:56:54.666870 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.666827 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw"] May 21 01:56:54.667041 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.666975 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.670024 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.670001 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hdh74\"" May 21 01:56:54.750784 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.750758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.750909 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.750800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.750909 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.750860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.750983 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.750926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsq2d\" (UniqueName: \"kubernetes.io/projected/0cae97e2-1206-4d6f-9e32-0e729c180c8c-kube-api-access-xsq2d\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.750983 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.750961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.751062 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.750988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.751062 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.751016 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.751124 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.751073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.751124 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.751119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852161 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852136 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852313 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852169 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852313 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852187 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852313 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852221 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852313 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852277 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852313 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852304 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852555 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852338 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852555 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852384 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsq2d\" (UniqueName: \"kubernetes.io/projected/0cae97e2-1206-4d6f-9e32-0e729c180c8c-kube-api-access-xsq2d\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852555 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852413 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852705 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852759 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852819 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852801 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.852859 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.852846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.853071 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.853049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.854568 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.854549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.854568 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.854561 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.860653 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.860629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cae97e2-1206-4d6f-9e32-0e729c180c8c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.860949 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.860917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsq2d\" (UniqueName: \"kubernetes.io/projected/0cae97e2-1206-4d6f-9e32-0e729c180c8c-kube-api-access-xsq2d\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-b4rmw\" (UID: \"0cae97e2-1206-4d6f-9e32-0e729c180c8c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:54.978451 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:54.978433 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:55.101470 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:55.101445 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw"] May 21 01:56:55.103702 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:56:55.103672 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cae97e2_1206_4d6f_9e32_0e729c180c8c.slice/crio-f8981d97976b22c14f0d3cf2267239e2c72a02a20b91f1b3d00567c27732f633 WatchSource:0}: Error finding container f8981d97976b22c14f0d3cf2267239e2c72a02a20b91f1b3d00567c27732f633: Status 404 returned error can't find the container with id f8981d97976b22c14f0d3cf2267239e2c72a02a20b91f1b3d00567c27732f633 May 21 01:56:55.105894 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:55.105847 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 01:56:55.105969 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:55.105941 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 01:56:55.106011 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:55.105978 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 01:56:55.670959 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:55.670923 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" event={"ID":"0cae97e2-1206-4d6f-9e32-0e729c180c8c","Type":"ContainerStarted","Data":"96c120df9463680658b4137c4ebb3a8cd2e0ce59e70ca7cd53e3d2b769fa5d20"} May 21 01:56:55.670959 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:55.670958 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" event={"ID":"0cae97e2-1206-4d6f-9e32-0e729c180c8c","Type":"ContainerStarted","Data":"f8981d97976b22c14f0d3cf2267239e2c72a02a20b91f1b3d00567c27732f633"} May 21 01:56:55.696481 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:55.696439 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" podStartSLOduration=1.696425707 podStartE2EDuration="1.696425707s" podCreationTimestamp="2026-05-21 01:56:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:56:55.694663605 +0000 UTC m=+584.371439350" watchObservedRunningTime="2026-05-21 01:56:55.696425707 +0000 UTC m=+584.373201453" May 21 01:56:55.979475 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:55.979449 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:56.983073 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:56.983044 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:57.677055 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:57.677024 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:56:57.677962 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:56:57.677946 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-b4rmw" May 21 01:57:09.618932 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.618900 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:57:09.674078 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.674044 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:57:09.674078 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.674074 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:09.674250 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.674090 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:57:09.676860 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.676837 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 01:57:09.759763 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.759739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3-config-file\") pod \"limitador-limitador-78c99df468-w7qc8\" (UID: \"4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:09.759857 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.759804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmcrn\" (UniqueName: \"kubernetes.io/projected/4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3-kube-api-access-kmcrn\") pod \"limitador-limitador-78c99df468-w7qc8\" (UID: \"4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:09.860699 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.860676 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmcrn\" (UniqueName: \"kubernetes.io/projected/4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3-kube-api-access-kmcrn\") pod \"limitador-limitador-78c99df468-w7qc8\" (UID: \"4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:09.860803 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.860733 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3-config-file\") pod \"limitador-limitador-78c99df468-w7qc8\" (UID: \"4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:09.861310 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.861289 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3-config-file\") pod \"limitador-limitador-78c99df468-w7qc8\" (UID: \"4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:09.883957 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.883899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmcrn\" (UniqueName: \"kubernetes.io/projected/4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3-kube-api-access-kmcrn\") pod \"limitador-limitador-78c99df468-w7qc8\" (UID: \"4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:09.983715 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:09.983687 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:10.105646 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.105609 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:57:10.107728 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:57:10.107699 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9ab5a0_4d80_4b28_b50a_3b352c6e49c3.slice/crio-62b170881257cd2bb1a2a51623f640afffb99b13a7e49ddd0babacad1ec6fb30 WatchSource:0}: Error finding container 62b170881257cd2bb1a2a51623f640afffb99b13a7e49ddd0babacad1ec6fb30: Status 404 returned error can't find the container with id 62b170881257cd2bb1a2a51623f640afffb99b13a7e49ddd0babacad1ec6fb30 May 21 01:57:10.303763 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.303730 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-blcst"] May 21 01:57:10.308486 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.308465 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-blcst" May 21 01:57:10.311087 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.311068 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7ntpb\"" May 21 01:57:10.315965 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.315945 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-blcst"] May 21 01:57:10.365414 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.365388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2klqg\" (UniqueName: \"kubernetes.io/projected/4d6c4ac8-444b-49a2-882b-7786fe765c6d-kube-api-access-2klqg\") pod \"authorino-7498df8756-blcst\" (UID: \"4d6c4ac8-444b-49a2-882b-7786fe765c6d\") " pod="kuadrant-system/authorino-7498df8756-blcst" May 21 01:57:10.466407 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.466369 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2klqg\" (UniqueName: \"kubernetes.io/projected/4d6c4ac8-444b-49a2-882b-7786fe765c6d-kube-api-access-2klqg\") pod \"authorino-7498df8756-blcst\" (UID: \"4d6c4ac8-444b-49a2-882b-7786fe765c6d\") " pod="kuadrant-system/authorino-7498df8756-blcst" May 21 01:57:10.476176 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.476149 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2klqg\" (UniqueName: \"kubernetes.io/projected/4d6c4ac8-444b-49a2-882b-7786fe765c6d-kube-api-access-2klqg\") pod \"authorino-7498df8756-blcst\" (UID: \"4d6c4ac8-444b-49a2-882b-7786fe765c6d\") " pod="kuadrant-system/authorino-7498df8756-blcst" May 21 01:57:10.618931 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.618867 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-blcst" May 21 01:57:10.728526 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.728108 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" event={"ID":"4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3","Type":"ContainerStarted","Data":"62b170881257cd2bb1a2a51623f640afffb99b13a7e49ddd0babacad1ec6fb30"} May 21 01:57:10.788681 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:10.788551 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-blcst"] May 21 01:57:10.791201 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:57:10.791165 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d6c4ac8_444b_49a2_882b_7786fe765c6d.slice/crio-7c626d26d53de3698b9f55dcbf517780fe74fda960524e92e4667ed4af46896e WatchSource:0}: Error finding container 7c626d26d53de3698b9f55dcbf517780fe74fda960524e92e4667ed4af46896e: Status 404 returned error can't find the container with id 7c626d26d53de3698b9f55dcbf517780fe74fda960524e92e4667ed4af46896e May 21 01:57:11.735927 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:11.735889 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-blcst" event={"ID":"4d6c4ac8-444b-49a2-882b-7786fe765c6d","Type":"ContainerStarted","Data":"7c626d26d53de3698b9f55dcbf517780fe74fda960524e92e4667ed4af46896e"} May 21 01:57:14.515274 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:14.515231 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 01:57:14.515654 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:14.515231 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 01:57:14.747943 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:14.747906 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-blcst" event={"ID":"4d6c4ac8-444b-49a2-882b-7786fe765c6d","Type":"ContainerStarted","Data":"8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3"} May 21 01:57:14.749207 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:14.749183 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" event={"ID":"4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3","Type":"ContainerStarted","Data":"3cd7062894205bbee66494f8380a3ccf5ff4fb4dc381aba92746b11e55658b18"} May 21 01:57:14.749335 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:14.749327 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:14.761922 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:14.761884 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-blcst" podStartSLOduration=0.991341992 podStartE2EDuration="4.761873196s" podCreationTimestamp="2026-05-21 01:57:10 +0000 UTC" firstStartedPulling="2026-05-21 01:57:10.793398143 +0000 UTC m=+599.470173884" lastFinishedPulling="2026-05-21 01:57:14.563929351 +0000 UTC m=+603.240705088" observedRunningTime="2026-05-21 01:57:14.760952756 +0000 UTC m=+603.437728505" watchObservedRunningTime="2026-05-21 01:57:14.761873196 +0000 UTC m=+603.438648942" May 21 01:57:14.777043 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:14.776967 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" podStartSLOduration=1.324919157 podStartE2EDuration="5.776955337s" podCreationTimestamp="2026-05-21 01:57:09 +0000 UTC" firstStartedPulling="2026-05-21 01:57:10.109475298 +0000 UTC m=+598.786251034" lastFinishedPulling="2026-05-21 01:57:14.56151149 +0000 UTC m=+603.238287214" observedRunningTime="2026-05-21 01:57:14.775576209 +0000 UTC m=+603.452351955" watchObservedRunningTime="2026-05-21 01:57:14.776955337 +0000 UTC m=+603.453731060" May 21 01:57:25.752904 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:25.752873 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-w7qc8" May 21 01:57:44.242993 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.242952 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-blcst"] May 21 01:57:44.243548 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.243183 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-blcst" podUID="4d6c4ac8-444b-49a2-882b-7786fe765c6d" containerName="authorino" containerID="cri-o://8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3" gracePeriod=30 May 21 01:57:44.480317 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.480294 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-blcst" May 21 01:57:44.616276 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.616191 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2klqg\" (UniqueName: \"kubernetes.io/projected/4d6c4ac8-444b-49a2-882b-7786fe765c6d-kube-api-access-2klqg\") pod \"4d6c4ac8-444b-49a2-882b-7786fe765c6d\" (UID: \"4d6c4ac8-444b-49a2-882b-7786fe765c6d\") " May 21 01:57:44.618126 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.618102 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d6c4ac8-444b-49a2-882b-7786fe765c6d-kube-api-access-2klqg" (OuterVolumeSpecName: "kube-api-access-2klqg") pod "4d6c4ac8-444b-49a2-882b-7786fe765c6d" (UID: "4d6c4ac8-444b-49a2-882b-7786fe765c6d"). InnerVolumeSpecName "kube-api-access-2klqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 01:57:44.717587 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.717565 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2klqg\" (UniqueName: \"kubernetes.io/projected/4d6c4ac8-444b-49a2-882b-7786fe765c6d-kube-api-access-2klqg\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 01:57:44.860431 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.860407 2562 generic.go:358] "Generic (PLEG): container finished" podID="4d6c4ac8-444b-49a2-882b-7786fe765c6d" containerID="8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3" exitCode=0 May 21 01:57:44.860547 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.860470 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-blcst" event={"ID":"4d6c4ac8-444b-49a2-882b-7786fe765c6d","Type":"ContainerDied","Data":"8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3"} May 21 01:57:44.860547 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.860478 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-blcst" May 21 01:57:44.860547 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.860504 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-blcst" event={"ID":"4d6c4ac8-444b-49a2-882b-7786fe765c6d","Type":"ContainerDied","Data":"7c626d26d53de3698b9f55dcbf517780fe74fda960524e92e4667ed4af46896e"} May 21 01:57:44.860547 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.860524 2562 scope.go:117] "RemoveContainer" containerID="8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3" May 21 01:57:44.868176 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.868058 2562 scope.go:117] "RemoveContainer" containerID="8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3" May 21 01:57:44.868421 ip-10-0-136-250 kubenswrapper[2562]: E0521 01:57:44.868399 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3\": container with ID starting with 8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3 not found: ID does not exist" containerID="8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3" May 21 01:57:44.868496 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.868427 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3"} err="failed to get container status \"8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3\": rpc error: code = NotFound desc = could not find container \"8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3\": container with ID starting with 8cb99f50403b76746abc9ce05b96f98d655fa6c1c4bc978716ff3eaf0ff50bb3 not found: ID does not exist" May 21 01:57:44.880179 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.880155 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-blcst"] May 21 01:57:44.881842 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:44.881823 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-blcst"] May 21 01:57:45.899013 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:45.898979 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d6c4ac8-444b-49a2-882b-7786fe765c6d" path="/var/lib/kubelet/pods/4d6c4ac8-444b-49a2-882b-7786fe765c6d/volumes" May 21 01:57:53.280524 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:57:53.280489 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:58:25.900135 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:58:25.900104 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:58:30.111498 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:58:30.111455 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:58:34.199939 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:58:34.199902 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:58:38.893973 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:58:38.893931 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:58:44.497769 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:58:44.497734 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:59:05.395758 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:05.395671 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:59:16.028656 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.028624 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55669b8fd4-9cmpv"] May 21 01:59:16.029024 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.028898 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d6c4ac8-444b-49a2-882b-7786fe765c6d" containerName="authorino" May 21 01:59:16.029024 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.028909 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d6c4ac8-444b-49a2-882b-7786fe765c6d" containerName="authorino" May 21 01:59:16.029024 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.028967 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d6c4ac8-444b-49a2-882b-7786fe765c6d" containerName="authorino" May 21 01:59:16.031895 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.031878 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55669b8fd4-9cmpv" May 21 01:59:16.035661 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.035636 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7ntpb\"" May 21 01:59:16.035811 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.035694 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 01:59:16.037674 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.037647 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55669b8fd4-9cmpv"] May 21 01:59:16.191073 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.191040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9b2a6ca-cac5-46cc-87d4-8997546c9479-tls-cert\") pod \"authorino-55669b8fd4-9cmpv\" (UID: \"c9b2a6ca-cac5-46cc-87d4-8997546c9479\") " pod="kuadrant-system/authorino-55669b8fd4-9cmpv" May 21 01:59:16.191193 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.191106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldrxl\" (UniqueName: \"kubernetes.io/projected/c9b2a6ca-cac5-46cc-87d4-8997546c9479-kube-api-access-ldrxl\") pod \"authorino-55669b8fd4-9cmpv\" (UID: \"c9b2a6ca-cac5-46cc-87d4-8997546c9479\") " pod="kuadrant-system/authorino-55669b8fd4-9cmpv" May 21 01:59:16.292036 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.291978 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9b2a6ca-cac5-46cc-87d4-8997546c9479-tls-cert\") pod \"authorino-55669b8fd4-9cmpv\" (UID: \"c9b2a6ca-cac5-46cc-87d4-8997546c9479\") " pod="kuadrant-system/authorino-55669b8fd4-9cmpv" May 21 01:59:16.292036 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.292030 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldrxl\" (UniqueName: \"kubernetes.io/projected/c9b2a6ca-cac5-46cc-87d4-8997546c9479-kube-api-access-ldrxl\") pod \"authorino-55669b8fd4-9cmpv\" (UID: \"c9b2a6ca-cac5-46cc-87d4-8997546c9479\") " pod="kuadrant-system/authorino-55669b8fd4-9cmpv" May 21 01:59:16.294517 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.294495 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9b2a6ca-cac5-46cc-87d4-8997546c9479-tls-cert\") pod \"authorino-55669b8fd4-9cmpv\" (UID: \"c9b2a6ca-cac5-46cc-87d4-8997546c9479\") " pod="kuadrant-system/authorino-55669b8fd4-9cmpv" May 21 01:59:16.299553 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.299529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldrxl\" (UniqueName: \"kubernetes.io/projected/c9b2a6ca-cac5-46cc-87d4-8997546c9479-kube-api-access-ldrxl\") pod \"authorino-55669b8fd4-9cmpv\" (UID: \"c9b2a6ca-cac5-46cc-87d4-8997546c9479\") " pod="kuadrant-system/authorino-55669b8fd4-9cmpv" May 21 01:59:16.341605 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.341586 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55669b8fd4-9cmpv" May 21 01:59:16.466973 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.466947 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55669b8fd4-9cmpv"] May 21 01:59:16.469428 ip-10-0-136-250 kubenswrapper[2562]: W0521 01:59:16.469394 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9b2a6ca_cac5_46cc_87d4_8997546c9479.slice/crio-785cdd64de53e2502c74f19455410f5e96a4d2954c4af17838c4bdf75773132e WatchSource:0}: Error finding container 785cdd64de53e2502c74f19455410f5e96a4d2954c4af17838c4bdf75773132e: Status 404 returned error can't find the container with id 785cdd64de53e2502c74f19455410f5e96a4d2954c4af17838c4bdf75773132e May 21 01:59:16.470651 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:16.470633 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 01:59:17.154179 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:17.154144 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55669b8fd4-9cmpv" event={"ID":"c9b2a6ca-cac5-46cc-87d4-8997546c9479","Type":"ContainerStarted","Data":"13fe77289413f99c6e71b4235c29616482dc973a53ec4622b9a2c175db26b4ee"} May 21 01:59:17.154179 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:17.154186 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55669b8fd4-9cmpv" event={"ID":"c9b2a6ca-cac5-46cc-87d4-8997546c9479","Type":"ContainerStarted","Data":"785cdd64de53e2502c74f19455410f5e96a4d2954c4af17838c4bdf75773132e"} May 21 01:59:17.174186 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:17.174096 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-55669b8fd4-9cmpv" podStartSLOduration=0.723963354 podStartE2EDuration="1.174083019s" podCreationTimestamp="2026-05-21 01:59:16 +0000 UTC" firstStartedPulling="2026-05-21 01:59:16.470757809 +0000 UTC m=+725.147533534" lastFinishedPulling="2026-05-21 01:59:16.920877472 +0000 UTC m=+725.597653199" observedRunningTime="2026-05-21 01:59:17.172221253 +0000 UTC m=+725.848997000" watchObservedRunningTime="2026-05-21 01:59:17.174083019 +0000 UTC m=+725.850858765" May 21 01:59:34.595436 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:34.595401 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:59:39.200249 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:39.200218 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:59:45.523791 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:45.523760 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 01:59:56.395937 ip-10-0-136-250 kubenswrapper[2562]: I0521 01:59:56.395902 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:00:00.138145 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:00.138111 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29655480-q4hjc"] May 21 02:00:00.141488 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:00.141470 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" May 21 02:00:00.144009 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:00.143987 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sxwq9\"" May 21 02:00:00.146299 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:00.146272 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655480-q4hjc"] May 21 02:00:00.190867 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:00.190842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvzg\" (UniqueName: \"kubernetes.io/projected/8951b9f5-33ea-4a96-bd39-6a2554066542-kube-api-access-ckvzg\") pod \"maas-api-key-cleanup-29655480-q4hjc\" (UID: \"8951b9f5-33ea-4a96-bd39-6a2554066542\") " pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" May 21 02:00:00.291687 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:00.291660 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvzg\" (UniqueName: \"kubernetes.io/projected/8951b9f5-33ea-4a96-bd39-6a2554066542-kube-api-access-ckvzg\") pod \"maas-api-key-cleanup-29655480-q4hjc\" (UID: \"8951b9f5-33ea-4a96-bd39-6a2554066542\") " pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" May 21 02:00:00.301035 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:00.301013 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvzg\" (UniqueName: \"kubernetes.io/projected/8951b9f5-33ea-4a96-bd39-6a2554066542-kube-api-access-ckvzg\") pod \"maas-api-key-cleanup-29655480-q4hjc\" (UID: \"8951b9f5-33ea-4a96-bd39-6a2554066542\") " pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" May 21 02:00:00.452922 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:00.452867 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" May 21 02:00:00.577785 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:00.577760 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655480-q4hjc"] May 21 02:00:00.580308 ip-10-0-136-250 kubenswrapper[2562]: W0521 02:00:00.580279 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8951b9f5_33ea_4a96_bd39_6a2554066542.slice/crio-b555f0ac7d1678c63a52608bb60ca7a9d23641384d5359a29d56b0d50770237f WatchSource:0}: Error finding container b555f0ac7d1678c63a52608bb60ca7a9d23641384d5359a29d56b0d50770237f: Status 404 returned error can't find the container with id b555f0ac7d1678c63a52608bb60ca7a9d23641384d5359a29d56b0d50770237f May 21 02:00:01.294140 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:01.294104 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" event={"ID":"8951b9f5-33ea-4a96-bd39-6a2554066542","Type":"ContainerStarted","Data":"b555f0ac7d1678c63a52608bb60ca7a9d23641384d5359a29d56b0d50770237f"} May 21 02:00:05.796466 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:05.796434 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:00:15.903458 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:15.903412 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:00:18.350865 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:18.350828 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" event={"ID":"8951b9f5-33ea-4a96-bd39-6a2554066542","Type":"ContainerStarted","Data":"ffaf2bbbd0459586976702d8b8c52524073f9fbdd06d4dde89d36573cd348ccb"} May 21 02:00:18.365321 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:18.365274 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" podStartSLOduration=1.467019698 podStartE2EDuration="18.365236313s" podCreationTimestamp="2026-05-21 02:00:00 +0000 UTC" firstStartedPulling="2026-05-21 02:00:00.581885472 +0000 UTC m=+769.258661196" lastFinishedPulling="2026-05-21 02:00:17.480102086 +0000 UTC m=+786.156877811" observedRunningTime="2026-05-21 02:00:18.364518615 +0000 UTC m=+787.041294361" watchObservedRunningTime="2026-05-21 02:00:18.365236313 +0000 UTC m=+787.042012060" May 21 02:00:19.356028 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:19.355993 2562 generic.go:358] "Generic (PLEG): container finished" podID="8951b9f5-33ea-4a96-bd39-6a2554066542" containerID="ffaf2bbbd0459586976702d8b8c52524073f9fbdd06d4dde89d36573cd348ccb" exitCode=0 May 21 02:00:19.356452 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:19.356058 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" event={"ID":"8951b9f5-33ea-4a96-bd39-6a2554066542","Type":"ContainerDied","Data":"ffaf2bbbd0459586976702d8b8c52524073f9fbdd06d4dde89d36573cd348ccb"} May 21 02:00:20.484489 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:20.484459 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" May 21 02:00:20.544813 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:20.544791 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckvzg\" (UniqueName: \"kubernetes.io/projected/8951b9f5-33ea-4a96-bd39-6a2554066542-kube-api-access-ckvzg\") pod \"8951b9f5-33ea-4a96-bd39-6a2554066542\" (UID: \"8951b9f5-33ea-4a96-bd39-6a2554066542\") " May 21 02:00:20.546822 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:20.546794 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8951b9f5-33ea-4a96-bd39-6a2554066542-kube-api-access-ckvzg" (OuterVolumeSpecName: "kube-api-access-ckvzg") pod "8951b9f5-33ea-4a96-bd39-6a2554066542" (UID: "8951b9f5-33ea-4a96-bd39-6a2554066542"). InnerVolumeSpecName "kube-api-access-ckvzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:00:20.645296 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:20.645218 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckvzg\" (UniqueName: \"kubernetes.io/projected/8951b9f5-33ea-4a96-bd39-6a2554066542-kube-api-access-ckvzg\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 02:00:21.364332 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:21.364295 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" event={"ID":"8951b9f5-33ea-4a96-bd39-6a2554066542","Type":"ContainerDied","Data":"b555f0ac7d1678c63a52608bb60ca7a9d23641384d5359a29d56b0d50770237f"} May 21 02:00:21.364332 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:21.364328 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655480-q4hjc" May 21 02:00:21.364556 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:21.364332 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b555f0ac7d1678c63a52608bb60ca7a9d23641384d5359a29d56b0d50770237f" May 21 02:00:24.697155 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:24.697121 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:00:34.501437 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:34.501361 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:00:43.208235 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.208172 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56f7fd9c8-2gnz2"] May 21 02:00:43.208737 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.208637 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8951b9f5-33ea-4a96-bd39-6a2554066542" containerName="cleanup" May 21 02:00:43.208737 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.208659 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8951b9f5-33ea-4a96-bd39-6a2554066542" containerName="cleanup" May 21 02:00:43.208737 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.208735 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="8951b9f5-33ea-4a96-bd39-6a2554066542" containerName="cleanup" May 21 02:00:43.216455 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.216426 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" May 21 02:00:43.220429 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.220401 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9dj6m\"" May 21 02:00:43.220565 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.220401 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 02:00:43.221232 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.221210 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f7fd9c8-2gnz2"] May 21 02:00:43.328081 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.328052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdqrn\" (UniqueName: \"kubernetes.io/projected/d748bc47-c706-493e-8565-b7d7fc98bc40-kube-api-access-wdqrn\") pod \"maas-controller-56f7fd9c8-2gnz2\" (UID: \"d748bc47-c706-493e-8565-b7d7fc98bc40\") " pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" May 21 02:00:43.428673 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.428637 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdqrn\" (UniqueName: \"kubernetes.io/projected/d748bc47-c706-493e-8565-b7d7fc98bc40-kube-api-access-wdqrn\") pod \"maas-controller-56f7fd9c8-2gnz2\" (UID: \"d748bc47-c706-493e-8565-b7d7fc98bc40\") " pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" May 21 02:00:43.439357 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.439337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdqrn\" (UniqueName: \"kubernetes.io/projected/d748bc47-c706-493e-8565-b7d7fc98bc40-kube-api-access-wdqrn\") pod \"maas-controller-56f7fd9c8-2gnz2\" (UID: \"d748bc47-c706-493e-8565-b7d7fc98bc40\") " pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" May 21 02:00:43.528152 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.528130 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" May 21 02:00:43.652619 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:43.652595 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f7fd9c8-2gnz2"] May 21 02:00:43.655192 ip-10-0-136-250 kubenswrapper[2562]: W0521 02:00:43.655166 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd748bc47_c706_493e_8565_b7d7fc98bc40.slice/crio-6f9daf8e68855f8a38582baedc4e4c9c52d10bad47f24e320d4dcb7b6a0079d1 WatchSource:0}: Error finding container 6f9daf8e68855f8a38582baedc4e4c9c52d10bad47f24e320d4dcb7b6a0079d1: Status 404 returned error can't find the container with id 6f9daf8e68855f8a38582baedc4e4c9c52d10bad47f24e320d4dcb7b6a0079d1 May 21 02:00:44.447321 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:44.447281 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" event={"ID":"d748bc47-c706-493e-8565-b7d7fc98bc40","Type":"ContainerStarted","Data":"6f9daf8e68855f8a38582baedc4e4c9c52d10bad47f24e320d4dcb7b6a0079d1"} May 21 02:00:46.455340 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:46.455297 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" event={"ID":"d748bc47-c706-493e-8565-b7d7fc98bc40","Type":"ContainerStarted","Data":"718cf166dc0b654fcbfb2bda307bf23ef41a068186e6e2c55ca7196dc0c5d37b"} May 21 02:00:46.455718 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:46.455422 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" May 21 02:00:46.472465 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:46.472426 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" podStartSLOduration=0.832046887 podStartE2EDuration="3.472415697s" podCreationTimestamp="2026-05-21 02:00:43 +0000 UTC" firstStartedPulling="2026-05-21 02:00:43.656446963 +0000 UTC m=+812.333222687" lastFinishedPulling="2026-05-21 02:00:46.296815769 +0000 UTC m=+814.973591497" observedRunningTime="2026-05-21 02:00:46.470909634 +0000 UTC m=+815.147685380" watchObservedRunningTime="2026-05-21 02:00:46.472415697 +0000 UTC m=+815.149191443" May 21 02:00:57.462925 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:00:57.462897 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56f7fd9c8-2gnz2" May 21 02:01:09.096115 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:01:09.096084 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:01:13.097548 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:01:13.097513 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:01:48.497023 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:01:48.496986 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:02:03.990639 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:02:03.990554 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:02:14.541685 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:02:14.541659 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:02:14.542778 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:02:14.542757 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:02:42.391594 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:02:42.391563 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:02:58.495512 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:02:58.495479 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:03:14.297416 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:03:14.297381 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:03:30.096923 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:03:30.096837 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:03:57.191436 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:03:57.191404 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:04:01.396403 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:04:01.396370 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:04:23.990414 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:04:23.990381 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:04:32.901431 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:04:32.901397 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:04:49.702081 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:04:49.702046 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:04:57.696121 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:04:57.696083 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:05:14.602587 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:05:14.602549 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:05:23.599755 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:05:23.599724 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:05:55.600140 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:05:55.600105 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:06:04.594416 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:06:04.594379 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:06:13.096836 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:06:13.096795 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:06:20.892083 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:06:20.892045 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:06:29.789153 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:06:29.789076 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:06:46.500996 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:06:46.500958 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:06:59.599141 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:06:59.599100 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:07:14.562115 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:07:14.562072 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:07:14.564169 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:07:14.564147 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:07:45.396968 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:07:45.396934 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:07:49.998695 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:07:49.998657 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:07:57.291621 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:07:57.291585 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:08:05.700760 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:08:05.700722 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:08:14.500324 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:08:14.500288 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:08:22.696542 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:08:22.696504 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:08:32.098791 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:08:32.098754 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:08:41.545022 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:08:41.544986 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:08:49.104946 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:08:49.104916 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:08:58.497800 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:08:58.497749 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:09:07.304962 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:09:07.304928 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:09:15.299073 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:09:15.299040 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:09:24.592864 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:09:24.592821 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:09:32.502576 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:09:32.502491 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:09:41.696026 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:09:41.695987 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:09:50.499001 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:09:50.498962 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:09:59.904649 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:09:59.904619 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:10:08.298350 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:10:08.298308 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:12:14.583688 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:12:14.583658 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:12:14.587026 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:12:14.587005 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:12:25.198897 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:12:25.198868 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:12:30.497612 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:12:30.497533 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:12:55.903353 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:12:55.903320 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:13:02.703438 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:13:02.703401 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:13:11.704279 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:13:11.703705 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:13:22.094427 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:13:22.094395 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:13:31.500953 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:13:31.500922 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:13:42.196891 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:13:42.196854 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:13:50.701847 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:13:50.701811 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:14:01.295095 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:14:01.294997 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:14:09.292678 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:14:09.292644 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:14:20.593518 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:14:20.593484 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:14:29.600118 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:14:29.600076 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:15:00.133333 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.133297 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29655495-sbj2m"] May 21 02:15:00.136464 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.136448 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" May 21 02:15:00.138830 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.138811 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sxwq9\"" May 21 02:15:00.152473 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.152452 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655495-sbj2m"] May 21 02:15:00.153510 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.153487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbwsc\" (UniqueName: \"kubernetes.io/projected/f752085c-60e0-465b-9673-6a7e0f5a83f3-kube-api-access-jbwsc\") pod \"maas-api-key-cleanup-29655495-sbj2m\" (UID: \"f752085c-60e0-465b-9673-6a7e0f5a83f3\") " pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" May 21 02:15:00.254500 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.254475 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbwsc\" (UniqueName: \"kubernetes.io/projected/f752085c-60e0-465b-9673-6a7e0f5a83f3-kube-api-access-jbwsc\") pod \"maas-api-key-cleanup-29655495-sbj2m\" (UID: \"f752085c-60e0-465b-9673-6a7e0f5a83f3\") " pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" May 21 02:15:00.262219 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.262199 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbwsc\" (UniqueName: \"kubernetes.io/projected/f752085c-60e0-465b-9673-6a7e0f5a83f3-kube-api-access-jbwsc\") pod \"maas-api-key-cleanup-29655495-sbj2m\" (UID: \"f752085c-60e0-465b-9673-6a7e0f5a83f3\") " pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" May 21 02:15:00.446123 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.446072 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" May 21 02:15:00.567330 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.567290 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655495-sbj2m"] May 21 02:15:00.569427 ip-10-0-136-250 kubenswrapper[2562]: W0521 02:15:00.569395 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf752085c_60e0_465b_9673_6a7e0f5a83f3.slice/crio-710e6b03a6b86c047e68d64ea182c178e58b9c85ed80be2b5f1056394649773b WatchSource:0}: Error finding container 710e6b03a6b86c047e68d64ea182c178e58b9c85ed80be2b5f1056394649773b: Status 404 returned error can't find the container with id 710e6b03a6b86c047e68d64ea182c178e58b9c85ed80be2b5f1056394649773b May 21 02:15:00.571135 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:00.571120 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:15:01.290853 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:01.290822 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" event={"ID":"f752085c-60e0-465b-9673-6a7e0f5a83f3","Type":"ContainerStarted","Data":"dd1a6fbd5f8405f8a6c5f3bf344cc7a8871a760b63039ab5a85ed0a0db4ac3df"} May 21 02:15:01.291318 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:01.290858 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" event={"ID":"f752085c-60e0-465b-9673-6a7e0f5a83f3","Type":"ContainerStarted","Data":"710e6b03a6b86c047e68d64ea182c178e58b9c85ed80be2b5f1056394649773b"} May 21 02:15:01.304112 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:01.304052 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" podStartSLOduration=1.304036683 podStartE2EDuration="1.304036683s" podCreationTimestamp="2026-05-21 02:15:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:15:01.303889536 +0000 UTC m=+1669.980665294" watchObservedRunningTime="2026-05-21 02:15:01.304036683 +0000 UTC m=+1669.980812430" May 21 02:15:02.294781 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:02.294748 2562 generic.go:358] "Generic (PLEG): container finished" podID="f752085c-60e0-465b-9673-6a7e0f5a83f3" containerID="dd1a6fbd5f8405f8a6c5f3bf344cc7a8871a760b63039ab5a85ed0a0db4ac3df" exitCode=0 May 21 02:15:02.295142 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:02.294822 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" event={"ID":"f752085c-60e0-465b-9673-6a7e0f5a83f3","Type":"ContainerDied","Data":"dd1a6fbd5f8405f8a6c5f3bf344cc7a8871a760b63039ab5a85ed0a0db4ac3df"} May 21 02:15:02.803897 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:02.803862 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:15:03.423672 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:03.423646 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" May 21 02:15:03.483319 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:03.483297 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbwsc\" (UniqueName: \"kubernetes.io/projected/f752085c-60e0-465b-9673-6a7e0f5a83f3-kube-api-access-jbwsc\") pod \"f752085c-60e0-465b-9673-6a7e0f5a83f3\" (UID: \"f752085c-60e0-465b-9673-6a7e0f5a83f3\") " May 21 02:15:03.485279 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:03.485222 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f752085c-60e0-465b-9673-6a7e0f5a83f3-kube-api-access-jbwsc" (OuterVolumeSpecName: "kube-api-access-jbwsc") pod "f752085c-60e0-465b-9673-6a7e0f5a83f3" (UID: "f752085c-60e0-465b-9673-6a7e0f5a83f3"). InnerVolumeSpecName "kube-api-access-jbwsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:15:03.584394 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:03.584338 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbwsc\" (UniqueName: \"kubernetes.io/projected/f752085c-60e0-465b-9673-6a7e0f5a83f3-kube-api-access-jbwsc\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" May 21 02:15:04.302789 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:04.302757 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" event={"ID":"f752085c-60e0-465b-9673-6a7e0f5a83f3","Type":"ContainerDied","Data":"710e6b03a6b86c047e68d64ea182c178e58b9c85ed80be2b5f1056394649773b"} May 21 02:15:04.302789 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:04.302788 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="710e6b03a6b86c047e68d64ea182c178e58b9c85ed80be2b5f1056394649773b" May 21 02:15:04.302973 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:04.302801 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655495-sbj2m" May 21 02:15:45.494424 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:45.494342 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:15:53.695960 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:15:53.695915 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:16:02.203909 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:16:02.203873 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:16:10.892886 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:16:10.892854 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:16:18.696896 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:16:18.696860 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:16:29.804406 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:16:29.804361 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:16:38.600145 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:16:38.600110 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:16:46.497962 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:16:46.497928 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:16:55.299031 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:16:55.298996 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:17:03.388323 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:17:03.388216 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:17:12.542312 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:17:12.542275 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:17:14.606512 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:17:14.606485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:17:14.610304 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:17:14.610282 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:17:25.194280 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:17:25.194218 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:17:42.397755 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:17:42.397722 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:17:50.098672 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:17:50.098632 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:17:59.396162 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:17:59.396131 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:18:07.188974 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:18:07.188938 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:18:25.192153 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:18:25.192117 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:18:32.692653 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:18:32.692579 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:18:41.399051 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:18:41.399011 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:18:50.595533 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:18:50.595493 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:18:59.603678 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:18:59.603641 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:19:07.899289 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:19:07.899248 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:19:16.895064 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:19:16.895033 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:19:29.598505 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:19:29.598470 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:19:38.394650 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:19:38.394622 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:19:49.601745 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:19:49.601705 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:19:58.401946 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:19:58.401870 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:20:05.598440 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:20:05.598397 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:20:15.098284 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:20:15.098237 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:20:23.494645 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:20:23.494608 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:20:39.001916 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:20:39.001882 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:20:48.901371 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:20:48.901333 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:20:56.998060 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:20:56.998023 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:21:05.400362 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:05.400324 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:21:28.797623 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:28.797534 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:21:41.460768 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:41.460737 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w7qc8"] May 21 02:21:42.988212 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:42.988182 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55669b8fd4-9cmpv_c9b2a6ca-cac5-46cc-87d4-8997546c9479/authorino/0.log" May 21 02:21:47.486526 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:47.486488 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655480-q4hjc_8951b9f5-33ea-4a96-bd39-6a2554066542/cleanup/0.log" May 21 02:21:47.599405 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:47.599381 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655495-sbj2m_f752085c-60e0-465b-9673-6a7e0f5a83f3/cleanup/0.log" May 21 02:21:47.717110 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:47.717083 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56f7fd9c8-2gnz2_d748bc47-c706-493e-8565-b7d7fc98bc40/manager/0.log" May 21 02:21:48.053215 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:48.053184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cdd6779c-97g89_714874fa-5ff1-4ac4-9e44-cfcd95c0314f/manager/0.log" May 21 02:21:49.488270 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:49.488223 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55669b8fd4-9cmpv_c9b2a6ca-cac5-46cc-87d4-8997546c9479/authorino/0.log" May 21 02:21:49.710771 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:49.710744 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-j7lnd_aed1abfb-1600-4c37-a444-9e0e38b26b46/manager/0.log" May 21 02:21:49.815607 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:49.815537 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-7wqzk_3a8aa430-3595-47a1-b2e1-934dec655c84/kuadrant-console-plugin/0.log" May 21 02:21:49.924652 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:49.924623 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hh5qd_17329c81-f051-4271-b9d0-c679d40661d2/registry-server/0.log" May 21 02:21:50.146459 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:50.146391 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-w7qc8_4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3/limitador/0.log" May 21 02:21:50.256107 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:50.256085 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-jmmlw_43884786-888b-4cd5-9b6b-8ac2240d4442/manager/0.log" May 21 02:21:50.582287 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:50.582238 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx_6fcc27c0-bd0f-4a9c-87c1-324cd98473dc/istio-proxy/0.log" May 21 02:21:51.011599 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:51.011567 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-b4rmw_0cae97e2-1206-4d6f-9e32-0e729c180c8c/istio-proxy/0.log" May 21 02:21:55.760324 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.760294 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwfm7/must-gather-jjns6"] May 21 02:21:55.760680 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.760578 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f752085c-60e0-465b-9673-6a7e0f5a83f3" containerName="cleanup" May 21 02:21:55.760680 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.760588 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f752085c-60e0-465b-9673-6a7e0f5a83f3" containerName="cleanup" May 21 02:21:55.760680 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.760646 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f752085c-60e0-465b-9673-6a7e0f5a83f3" containerName="cleanup" May 21 02:21:55.763622 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.763600 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwfm7/must-gather-jjns6" May 21 02:21:55.766350 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.766324 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwfm7\"/\"openshift-service-ca.crt\"" May 21 02:21:55.767546 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.767531 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwfm7\"/\"kube-root-ca.crt\"" May 21 02:21:55.767605 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.767544 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mwfm7\"/\"default-dockercfg-zddpb\"" May 21 02:21:55.778235 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.778214 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwfm7/must-gather-jjns6"] May 21 02:21:55.864369 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.864349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bpph\" (UniqueName: \"kubernetes.io/projected/468e71be-9fe2-46d5-ac80-dd63f10136a9-kube-api-access-8bpph\") pod \"must-gather-jjns6\" (UID: \"468e71be-9fe2-46d5-ac80-dd63f10136a9\") " pod="openshift-must-gather-mwfm7/must-gather-jjns6" May 21 02:21:55.864453 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.864384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/468e71be-9fe2-46d5-ac80-dd63f10136a9-must-gather-output\") pod \"must-gather-jjns6\" (UID: \"468e71be-9fe2-46d5-ac80-dd63f10136a9\") " pod="openshift-must-gather-mwfm7/must-gather-jjns6" May 21 02:21:55.965617 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.965592 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bpph\" (UniqueName: \"kubernetes.io/projected/468e71be-9fe2-46d5-ac80-dd63f10136a9-kube-api-access-8bpph\") pod \"must-gather-jjns6\" (UID: \"468e71be-9fe2-46d5-ac80-dd63f10136a9\") " pod="openshift-must-gather-mwfm7/must-gather-jjns6" May 21 02:21:55.965710 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.965629 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/468e71be-9fe2-46d5-ac80-dd63f10136a9-must-gather-output\") pod \"must-gather-jjns6\" (UID: \"468e71be-9fe2-46d5-ac80-dd63f10136a9\") " pod="openshift-must-gather-mwfm7/must-gather-jjns6" May 21 02:21:55.965930 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.965915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/468e71be-9fe2-46d5-ac80-dd63f10136a9-must-gather-output\") pod \"must-gather-jjns6\" (UID: \"468e71be-9fe2-46d5-ac80-dd63f10136a9\") " pod="openshift-must-gather-mwfm7/must-gather-jjns6" May 21 02:21:55.972981 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:55.972954 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bpph\" (UniqueName: \"kubernetes.io/projected/468e71be-9fe2-46d5-ac80-dd63f10136a9-kube-api-access-8bpph\") pod \"must-gather-jjns6\" (UID: \"468e71be-9fe2-46d5-ac80-dd63f10136a9\") " pod="openshift-must-gather-mwfm7/must-gather-jjns6" May 21 02:21:56.072531 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:56.072474 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwfm7/must-gather-jjns6" May 21 02:21:56.193334 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:56.193302 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwfm7/must-gather-jjns6"] May 21 02:21:56.195202 ip-10-0-136-250 kubenswrapper[2562]: W0521 02:21:56.195169 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod468e71be_9fe2_46d5_ac80_dd63f10136a9.slice/crio-e0ba4a3ae5ccdcdf73ea7cc41d4c607ad3341b9fa7969e14259259bee89418d8 WatchSource:0}: Error finding container e0ba4a3ae5ccdcdf73ea7cc41d4c607ad3341b9fa7969e14259259bee89418d8: Status 404 returned error can't find the container with id e0ba4a3ae5ccdcdf73ea7cc41d4c607ad3341b9fa7969e14259259bee89418d8 May 21 02:21:56.197004 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:56.196984 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:21:56.698833 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:56.698802 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwfm7/must-gather-jjns6" event={"ID":"468e71be-9fe2-46d5-ac80-dd63f10136a9","Type":"ContainerStarted","Data":"e0ba4a3ae5ccdcdf73ea7cc41d4c607ad3341b9fa7969e14259259bee89418d8"} May 21 02:21:57.706180 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:57.706140 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwfm7/must-gather-jjns6" event={"ID":"468e71be-9fe2-46d5-ac80-dd63f10136a9","Type":"ContainerStarted","Data":"b04034ada0f3590675a0aa70983603e45844dba669dd4271ea13a6beab2a0b5b"} May 21 02:21:57.706659 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:57.706185 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwfm7/must-gather-jjns6" event={"ID":"468e71be-9fe2-46d5-ac80-dd63f10136a9","Type":"ContainerStarted","Data":"4d4f480f01542a210ed9d10523a425af85156876815b47fd850569ddfa80e8eb"} May 21 02:21:57.721658 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:57.721610 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mwfm7/must-gather-jjns6" podStartSLOduration=1.968716475 podStartE2EDuration="2.721596213s" podCreationTimestamp="2026-05-21 02:21:55 +0000 UTC" firstStartedPulling="2026-05-21 02:21:56.197106046 +0000 UTC m=+2084.873881770" lastFinishedPulling="2026-05-21 02:21:56.949985785 +0000 UTC m=+2085.626761508" observedRunningTime="2026-05-21 02:21:57.72059776 +0000 UTC m=+2086.397373507" watchObservedRunningTime="2026-05-21 02:21:57.721596213 +0000 UTC m=+2086.398371998" May 21 02:21:58.467308 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:58.467284 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wkrnk_68cc1293-b33b-467b-9337-ca6197a9e9bc/global-pull-secret-syncer/0.log" May 21 02:21:58.571288 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:58.571236 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nkqd4_f29962f2-67c8-411b-87c2-a3950a8a189f/konnectivity-agent/0.log" May 21 02:21:58.607921 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:21:58.607892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-250.ec2.internal_9ff51d37359e6e6b6ad59d1d313d5818/haproxy/0.log" May 21 02:22:02.730284 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:02.729941 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55669b8fd4-9cmpv_c9b2a6ca-cac5-46cc-87d4-8997546c9479/authorino/0.log" May 21 02:22:02.775310 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:02.775283 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-j7lnd_aed1abfb-1600-4c37-a444-9e0e38b26b46/manager/0.log" May 21 02:22:02.800155 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:02.800121 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-7wqzk_3a8aa430-3595-47a1-b2e1-934dec655c84/kuadrant-console-plugin/0.log" May 21 02:22:02.833077 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:02.833050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hh5qd_17329c81-f051-4271-b9d0-c679d40661d2/registry-server/0.log" May 21 02:22:02.916940 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:02.916909 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-w7qc8_4e9ab5a0-4d80-4b28-b50a-3b352c6e49c3/limitador/0.log" May 21 02:22:02.993324 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:02.992301 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-jmmlw_43884786-888b-4cd5-9b6b-8ac2240d4442/manager/0.log" May 21 02:22:04.539188 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:04.539155 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zmmk4_9889eb8b-43b1-40bd-85d6-5bdcff68031e/node-exporter/0.log" May 21 02:22:04.558851 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:04.558805 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zmmk4_9889eb8b-43b1-40bd-85d6-5bdcff68031e/kube-rbac-proxy/0.log" May 21 02:22:04.580954 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:04.580921 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zmmk4_9889eb8b-43b1-40bd-85d6-5bdcff68031e/init-textfile/0.log" May 21 02:22:07.115542 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.115510 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl"] May 21 02:22:07.120744 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.120724 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.126242 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.126215 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl"] May 21 02:22:07.289933 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.289895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-lib-modules\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.290189 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.290157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-proc\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.290312 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.290196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qclfj\" (UniqueName: \"kubernetes.io/projected/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-kube-api-access-qclfj\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.290370 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.290333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-sys\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.290370 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.290367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-podres\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.391041 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.390957 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-lib-modules\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.391041 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.391006 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-proc\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.391041 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.391031 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qclfj\" (UniqueName: \"kubernetes.io/projected/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-kube-api-access-qclfj\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.391312 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.391080 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-sys\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.391312 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.391113 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-podres\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.391312 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.391112 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-proc\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.391312 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.391185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-sys\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.391312 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.391193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-lib-modules\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.391468 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.391358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-podres\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.399609 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.399584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qclfj\" (UniqueName: \"kubernetes.io/projected/d71bbb6d-81a3-4328-a11b-3c7f1b7642d8-kube-api-access-qclfj\") pod \"perf-node-gather-daemonset-9gthl\" (UID: \"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.435396 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.435358 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.600171 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.599404 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl"] May 21 02:22:07.761611 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.761571 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" event={"ID":"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8","Type":"ContainerStarted","Data":"82b7538dca3be8e065dfe27d0ab35fbef30bef496d4324a942dd194e35b492a1"} May 21 02:22:07.761793 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.761618 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" event={"ID":"d71bbb6d-81a3-4328-a11b-3c7f1b7642d8","Type":"ContainerStarted","Data":"3db3fc4fd132e324e2d76034c9c7446315d6f1d875361df944107841c18f5bcd"} May 21 02:22:07.762383 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.762358 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:07.777051 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:07.776982 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" podStartSLOduration=0.776965611 podStartE2EDuration="776.965611ms" podCreationTimestamp="2026-05-21 02:22:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:22:07.776677999 +0000 UTC m=+2096.453453746" watchObservedRunningTime="2026-05-21 02:22:07.776965611 +0000 UTC m=+2096.453741355" May 21 02:22:08.507037 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:08.507009 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vksc7_be353974-84e6-4277-9fb0-f51cdf2da42b/dns/0.log" May 21 02:22:08.523348 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:08.523324 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vksc7_be353974-84e6-4277-9fb0-f51cdf2da42b/kube-rbac-proxy/0.log" May 21 02:22:08.572985 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:08.572946 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bjxff_8e42179a-8792-4a3b-80eb-e63a5a16ace9/dns-node-resolver/0.log" May 21 02:22:09.058405 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:09.058382 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgpnr_81894662-3585-4174-aa1a-a1d0343177b4/node-ca/0.log" May 21 02:22:09.812687 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:09.812662 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bsr7kx_6fcc27c0-bd0f-4a9c-87c1-324cd98473dc/istio-proxy/0.log" May 21 02:22:09.998361 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:09.998333 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-b4rmw_0cae97e2-1206-4d6f-9e32-0e729c180c8c/istio-proxy/0.log" May 21 02:22:10.541289 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:10.541242 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7fxxf_8f608821-4201-4334-878c-2950041dbb86/serve-healthcheck-canary/0.log" May 21 02:22:11.016962 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:11.016935 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4rtfw_44fe0866-491d-467d-83f9-2f09255edb1d/kube-rbac-proxy/0.log" May 21 02:22:11.033034 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:11.033005 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4rtfw_44fe0866-491d-467d-83f9-2f09255edb1d/exporter/0.log" May 21 02:22:11.048848 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:11.048833 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4rtfw_44fe0866-491d-467d-83f9-2f09255edb1d/extractor/0.log" May 21 02:22:12.923969 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:12.923942 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655480-q4hjc_8951b9f5-33ea-4a96-bd39-6a2554066542/cleanup/0.log" May 21 02:22:12.941979 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:12.941950 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655495-sbj2m_f752085c-60e0-465b-9673-6a7e0f5a83f3/cleanup/0.log" May 21 02:22:12.998177 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:12.998150 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56f7fd9c8-2gnz2_d748bc47-c706-493e-8565-b7d7fc98bc40/manager/0.log" May 21 02:22:13.087078 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:13.087055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cdd6779c-97g89_714874fa-5ff1-4ac4-9e44-cfcd95c0314f/manager/0.log" May 21 02:22:14.138196 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:14.138168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c8fd9c4f9-66d8v_c805e092-fb11-41c9-95fa-5443bceb5d63/manager/0.log" May 21 02:22:14.184008 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:14.183978 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-zs5mz_e10afdc0-301e-487d-9f81-6207b55e1ede/openshift-lws-operator/0.log" May 21 02:22:14.633098 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:14.633072 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:22:14.635159 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:14.635142 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:22:14.779619 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:14.779593 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-9gthl" May 21 02:22:19.792853 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:19.792827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7rnz_365078df-0ea9-49f4-a965-d444e88d9046/kube-multus-additional-cni-plugins/0.log" May 21 02:22:19.809515 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:19.809492 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7rnz_365078df-0ea9-49f4-a965-d444e88d9046/egress-router-binary-copy/0.log" May 21 02:22:19.825440 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:19.825427 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7rnz_365078df-0ea9-49f4-a965-d444e88d9046/cni-plugins/0.log" May 21 02:22:19.841062 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:19.841046 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7rnz_365078df-0ea9-49f4-a965-d444e88d9046/bond-cni-plugin/0.log" May 21 02:22:19.857461 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:19.857446 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7rnz_365078df-0ea9-49f4-a965-d444e88d9046/routeoverride-cni/0.log" May 21 02:22:19.874995 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:19.874980 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7rnz_365078df-0ea9-49f4-a965-d444e88d9046/whereabouts-cni-bincopy/0.log" May 21 02:22:19.893004 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:19.892923 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7rnz_365078df-0ea9-49f4-a965-d444e88d9046/whereabouts-cni/0.log" May 21 02:22:20.043612 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:20.043533 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c52gm_be7e39fc-84d1-4096-970c-2215e2b4c3fe/kube-multus/0.log" May 21 02:22:20.176235 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:20.176178 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zspbw_0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe/network-metrics-daemon/0.log" May 21 02:22:20.193663 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:20.193637 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zspbw_0a78bc0e-ca6f-4991-ab19-5d3e533b9dbe/kube-rbac-proxy/0.log" May 21 02:22:21.142286 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:21.142263 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-controller/0.log" May 21 02:22:21.158195 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:21.158142 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/0.log" May 21 02:22:21.168040 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:21.168020 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovn-acl-logging/1.log" May 21 02:22:21.183173 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:21.183153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/kube-rbac-proxy-node/0.log" May 21 02:22:21.200919 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:21.200888 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/kube-rbac-proxy-ovn-metrics/0.log" May 21 02:22:21.215472 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:21.215454 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/northd/0.log" May 21 02:22:21.289893 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:21.289869 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/nbdb/0.log" May 21 02:22:21.307317 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:21.307301 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/sbdb/0.log" May 21 02:22:21.409931 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:21.409869 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p285b_1696709a-c17b-4d1f-a156-8bca1c668589/ovnkube-controller/0.log" May 21 02:22:22.633065 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:22.633040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-qwxlh_26d99ec6-a0f6-4051-b0b3-d38fae44c0bb/check-endpoints/0.log" May 21 02:22:22.675227 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:22.675197 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6mcwq_100852ea-cf8a-4319-8cd1-4fc3eb3c418a/network-check-target-container/0.log" May 21 02:22:23.657821 ip-10-0-136-250 kubenswrapper[2562]: I0521 02:22:23.657744 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-zjlx4_d04bd9da-ce17-432c-8d3f-fdd80d1130ca/iptables-alerter/0.log"