May 26 11:45:36.905718 ip-10-0-140-83 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 26 11:45:36.905727 ip-10-0-140-83 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 26 11:45:36.905734 ip-10-0-140-83 systemd[1]: kubelet.service: Failed with result 'resources'. May 26 11:45:36.905960 ip-10-0-140-83 systemd[1]: Failed to start Kubernetes Kubelet. May 26 11:45:46.979785 ip-10-0-140-83 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 26 11:45:46.979800 ip-10-0-140-83 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3328cecbebb349c492cfedeafd2f9010 -- May 26 11:48:13.993807 ip-10-0-140-83 systemd[1]: Starting Kubernetes Kubelet... May 26 11:48:14.478172 ip-10-0-140-83 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 11:48:14.478172 ip-10-0-140-83 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 11:48:14.478172 ip-10-0-140-83 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 11:48:14.478172 ip-10-0-140-83 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 11:48:14.478172 ip-10-0-140-83 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 11:48:14.479252 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.479181 2572 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 11:48:14.482005 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.481984 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:48:14.482005 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482001 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:48:14.482005 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482006 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 11:48:14.482005 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482010 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482015 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482020 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482025 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482028 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482040 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482045 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482049 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482052 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482056 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482059 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482063 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482067 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482071 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482075 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482079 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482083 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482086 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482090 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482094 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:48:14.482242 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482098 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482102 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482106 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482110 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482115 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482120 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482124 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482129 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482133 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482137 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482142 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482146 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482150 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482155 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482160 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482164 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482171 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482179 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482184 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482188 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:48:14.483070 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482193 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482197 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482201 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482216 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482221 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482225 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482230 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482234 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482238 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482242 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482246 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482250 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482254 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482259 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482263 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482267 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482272 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482276 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482280 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:48:14.483748 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482285 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482290 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482294 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482298 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482304 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482308 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482312 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482317 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482322 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482326 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482330 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482335 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482339 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482343 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482349 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482354 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482359 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482364 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482369 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:48:14.484209 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482373 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482378 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482382 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482386 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.482390 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483017 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483026 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483032 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483037 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483041 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483046 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483050 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483054 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483060 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483064 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483068 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483072 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483076 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483080 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483085 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:48:14.484687 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483090 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483094 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483098 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483103 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483107 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483111 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483116 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483120 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483124 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483129 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483133 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483137 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483142 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483147 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483151 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483155 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483159 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483163 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483167 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483172 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:48:14.485159 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483175 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483180 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483184 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483188 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483192 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483196 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483202 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483206 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483211 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483215 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483219 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483222 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483227 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483232 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483236 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483242 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483246 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483250 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483255 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:48:14.485714 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483259 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483263 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483267 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483271 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483276 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483280 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483284 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483288 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483292 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483297 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483301 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483305 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483309 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483313 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483320 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483326 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483330 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483335 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483339 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:48:14.486179 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483345 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483359 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483365 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483370 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483374 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483379 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483383 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483387 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483400 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483405 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483409 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483413 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.483417 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484650 2572 flags.go:64] FLAG: --address="0.0.0.0" May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484665 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484672 2572 flags.go:64] FLAG: --anonymous-auth="true" May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484677 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484681 2572 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484685 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484690 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484694 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 11:48:14.486658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484698 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484701 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484705 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484711 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484714 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484717 2572 flags.go:64] FLAG: --cgroup-root="" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484720 2572 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484724 2572 flags.go:64] FLAG: --client-ca-file="" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484727 2572 flags.go:64] FLAG: --cloud-config="" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484729 2572 flags.go:64] FLAG: --cloud-provider="external" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484733 2572 flags.go:64] FLAG: --cluster-dns="[]" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484737 2572 flags.go:64] FLAG: --cluster-domain="" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484740 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484743 2572 flags.go:64] FLAG: --config-dir="" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484746 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484749 2572 flags.go:64] FLAG: --container-log-max-files="5" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484753 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484756 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484759 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484763 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484766 2572 flags.go:64] FLAG: --contention-profiling="false" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484768 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484771 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484774 2572 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484777 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 11:48:14.487167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484783 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484787 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484790 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484793 2572 flags.go:64] FLAG: --enable-load-reader="false" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484796 2572 flags.go:64] FLAG: --enable-server="true" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484799 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484804 2572 flags.go:64] FLAG: --event-burst="100" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484807 2572 flags.go:64] FLAG: --event-qps="50" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484810 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484813 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484816 2572 flags.go:64] FLAG: --eviction-hard="" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484820 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484823 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484826 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484829 2572 flags.go:64] FLAG: --eviction-soft="" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484832 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484835 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484838 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484841 2572 flags.go:64] FLAG: --experimental-mounter-path="" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484844 2572 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484846 2572 flags.go:64] FLAG: --fail-swap-on="true" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484849 2572 flags.go:64] FLAG: --feature-gates="" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484856 2572 flags.go:64] FLAG: --file-check-frequency="20s" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484859 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484862 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 11:48:14.487789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484865 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484868 2572 flags.go:64] FLAG: --healthz-port="10248" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484871 2572 flags.go:64] FLAG: --help="false" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484874 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-140-83.ec2.internal" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484877 2572 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484880 2572 flags.go:64] FLAG: --http-check-frequency="20s" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484883 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484888 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484893 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484896 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484899 2572 flags.go:64] FLAG: --image-service-endpoint="" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484902 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484905 2572 flags.go:64] FLAG: --kube-api-burst="100" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484908 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484911 2572 flags.go:64] FLAG: --kube-api-qps="50" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484914 2572 flags.go:64] FLAG: --kube-reserved="" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484917 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484919 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484922 2572 flags.go:64] FLAG: --kubelet-cgroups="" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484925 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484928 2572 flags.go:64] FLAG: --lock-file="" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484931 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484934 2572 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484936 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 11:48:14.488384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484942 2572 flags.go:64] FLAG: --log-json-split-stream="false" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484945 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484948 2572 flags.go:64] FLAG: --log-text-split-stream="false" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484951 2572 flags.go:64] FLAG: --logging-format="text" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484953 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484957 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484960 2572 flags.go:64] FLAG: --manifest-url="" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484963 2572 flags.go:64] FLAG: --manifest-url-header="" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484967 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484970 2572 flags.go:64] FLAG: --max-open-files="1000000" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484975 2572 flags.go:64] FLAG: --max-pods="110" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484978 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484981 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484983 2572 flags.go:64] FLAG: --memory-manager-policy="None" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484987 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484990 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484993 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.484996 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485004 2572 flags.go:64] FLAG: --node-status-max-images="50" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485007 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485010 2572 flags.go:64] FLAG: --oom-score-adj="-999" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485013 2572 flags.go:64] FLAG: --pod-cidr="" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485016 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 11:48:14.488964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485021 2572 flags.go:64] FLAG: --pod-manifest-path="" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485024 2572 flags.go:64] FLAG: --pod-max-pids="-1" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485027 2572 flags.go:64] FLAG: --pods-per-core="0" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485029 2572 flags.go:64] FLAG: --port="10250" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485032 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485035 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-075f616e3aee7e720" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485038 2572 flags.go:64] FLAG: --qos-reserved="" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485041 2572 flags.go:64] FLAG: --read-only-port="10255" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485045 2572 flags.go:64] FLAG: --register-node="true" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485048 2572 flags.go:64] FLAG: --register-schedulable="true" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485051 2572 flags.go:64] FLAG: --register-with-taints="" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485054 2572 flags.go:64] FLAG: --registry-burst="10" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485057 2572 flags.go:64] FLAG: --registry-qps="5" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485060 2572 flags.go:64] FLAG: --reserved-cpus="" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485063 2572 flags.go:64] FLAG: --reserved-memory="" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485067 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485070 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485073 2572 flags.go:64] FLAG: --rotate-certificates="false" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485076 2572 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485079 2572 flags.go:64] FLAG: --runonce="false" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485082 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485085 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485088 2572 flags.go:64] FLAG: --seccomp-default="false" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485091 2572 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485094 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485098 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 11:48:14.489644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485101 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485104 2572 flags.go:64] FLAG: --storage-driver-password="root" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485107 2572 flags.go:64] FLAG: --storage-driver-secure="false" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485110 2572 flags.go:64] FLAG: --storage-driver-table="stats" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485113 2572 flags.go:64] FLAG: --storage-driver-user="root" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485116 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485119 2572 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485122 2572 flags.go:64] FLAG: --system-cgroups="" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485125 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485131 2572 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485134 2572 flags.go:64] FLAG: --tls-cert-file="" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485137 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485140 2572 flags.go:64] FLAG: --tls-min-version="" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485143 2572 flags.go:64] FLAG: --tls-private-key-file="" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485146 2572 flags.go:64] FLAG: --topology-manager-policy="none" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485149 2572 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485152 2572 flags.go:64] FLAG: --topology-manager-scope="container" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485155 2572 flags.go:64] FLAG: --v="2" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485159 2572 flags.go:64] FLAG: --version="false" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485164 2572 flags.go:64] FLAG: --vmodule="" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485169 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.485172 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485268 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485271 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:48:14.490260 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485274 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485277 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485280 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485282 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485289 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485291 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485294 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485297 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485300 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485303 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485306 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485309 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485311 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485314 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485317 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485319 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485322 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485324 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485327 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485330 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:48:14.490875 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485332 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485335 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485337 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485340 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485342 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485345 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485347 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485350 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485353 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485355 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485358 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485361 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485364 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485366 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485369 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485371 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485375 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485378 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485380 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485384 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:48:14.491384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485387 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485389 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485392 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485395 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485398 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485401 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485404 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485406 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485420 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485423 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485426 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485429 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485431 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485447 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485451 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485454 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485458 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485460 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485463 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:48:14.491898 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485465 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485469 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485473 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485476 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485479 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485482 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485485 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485488 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485490 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485494 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485497 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485500 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485504 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485506 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485509 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485512 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485515 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485518 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485521 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 11:48:14.492618 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485524 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:48:14.493186 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485527 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:48:14.493186 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485529 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:48:14.493186 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485532 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:48:14.493186 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485535 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:48:14.493186 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.485537 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:48:14.493186 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.486297 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 11:48:14.494375 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.494356 2572 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 11:48:14.494375 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.494375 2572 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 11:48:14.494456 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494425 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:48:14.494456 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494431 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:48:14.494456 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494449 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:48:14.494456 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494454 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494459 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494463 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494466 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494469 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494472 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494476 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494479 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494482 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494485 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494488 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494491 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494494 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494497 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494500 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494502 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494505 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494507 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494510 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494513 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:48:14.494563 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494515 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494518 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494520 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494523 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494526 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494535 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494538 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494540 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494543 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494546 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494549 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494551 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494554 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494557 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494560 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494563 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494567 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494571 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494574 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494577 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:48:14.495045 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494580 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494583 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494586 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494588 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494591 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494594 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494596 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494599 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494602 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494605 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494607 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494610 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494613 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494616 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494618 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494620 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494623 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494625 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494628 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494630 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:48:14.495632 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494633 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494636 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494638 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494641 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494643 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494646 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494649 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494652 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494654 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494657 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494661 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494665 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494668 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494672 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494676 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494678 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494681 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494684 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494686 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:48:14.496116 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494690 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494692 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494695 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494697 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.494702 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494804 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494810 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494813 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494816 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494819 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494822 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494825 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494827 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494830 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494833 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:48:14.496598 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494835 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494838 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494840 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494843 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494847 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494849 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494852 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494855 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494858 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494861 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494863 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494866 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494870 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494872 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494875 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494877 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494880 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494883 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494885 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494888 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:48:14.496960 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494890 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494893 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494896 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494898 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494901 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494903 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494906 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494908 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494911 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494913 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494916 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494918 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494921 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494925 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494929 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494932 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494936 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494939 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494942 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:48:14.497488 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494945 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494947 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494950 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494953 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494955 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494958 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494961 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494964 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494966 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494969 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494972 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494974 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494977 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494979 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494982 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494984 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494987 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494989 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494992 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494994 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:48:14.497941 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494997 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.494999 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495003 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495006 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495009 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495011 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495014 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495017 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495019 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495022 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495025 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495028 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495030 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495033 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495035 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495038 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:48:14.498417 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:14.495040 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:48:14.498854 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.495045 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 11:48:14.498854 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.495145 2572 server.go:962] "Client rotation is on, will bootstrap in background" May 26 11:48:14.501216 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.501201 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 11:48:14.502405 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.502394 2572 server.go:1019] "Starting client certificate rotation" May 26 11:48:14.502508 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.502491 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 11:48:14.502546 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.502528 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 11:48:14.529470 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.529431 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 11:48:14.532278 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.532236 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 11:48:14.544820 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.544800 2572 log.go:25] "Validated CRI v1 runtime API" May 26 11:48:14.551500 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.551485 2572 log.go:25] "Validated CRI v1 image API" May 26 11:48:14.553689 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.553668 2572 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 11:48:14.557555 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.557532 2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 92f13ea8-446d-402b-8eef-af2a777f90f5:/dev/nvme0n1p3 a8aa2f90-131a-4f5c-a9cf-77787fe76feb:/dev/nvme0n1p4] May 26 11:48:14.557635 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.557553 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 11:48:14.561789 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.561679 2572 manager.go:217] Machine: {Timestamp:2026-05-26 11:48:14.561155233 +0000 UTC m=+0.438153435 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099088 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec209a378cac13bbc119955168f53983 SystemUUID:ec209a37-8cac-13bb-c119-955168f53983 BootID:3328cecb-ebb3-49c4-92cf-edeafd2f9010 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:ee:06:96:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:ee:06:96:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:1b:8e:66:fc:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 11:48:14.562630 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.562616 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 11:48:14.562726 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.562711 2572 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 11:48:14.563217 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.563200 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 11:48:14.564549 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.564527 2572 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 11:48:14.564689 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.564553 2572 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-83.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 11:48:14.564730 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.564700 2572 topology_manager.go:138] "Creating topology manager with none policy" May 26 11:48:14.564730 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.564709 2572 container_manager_linux.go:306] "Creating device plugin manager" May 26 11:48:14.564730 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.564716 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 11:48:14.565522 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.565510 2572 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 11:48:14.567592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.567582 2572 state_mem.go:36] "Initialized new in-memory state store" May 26 11:48:14.567828 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.567819 2572 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 11:48:14.570492 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.570481 2572 kubelet.go:491] "Attempting to sync node with API server" May 26 11:48:14.570525 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.570496 2572 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 11:48:14.570525 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.570507 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 11:48:14.570525 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.570524 2572 kubelet.go:397] "Adding apiserver pod source" May 26 11:48:14.570650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.570536 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 11:48:14.571804 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.571790 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 11:48:14.571891 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.571809 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 11:48:14.575537 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.575523 2572 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 11:48:14.578372 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.578346 2572 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 11:48:14.579267 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579255 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 11:48:14.579326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579271 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 11:48:14.579326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579278 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 11:48:14.579326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579283 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 11:48:14.579326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579291 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 11:48:14.579326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579296 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 11:48:14.579326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579302 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 11:48:14.579326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579307 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 11:48:14.579326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579317 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 11:48:14.579326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579324 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 11:48:14.579605 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579336 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 11:48:14.579605 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.579562 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 11:48:14.580738 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.580728 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 11:48:14.580738 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.580737 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 11:48:14.581871 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.581835 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-szhwg" May 26 11:48:14.583836 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.583682 2572 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-83.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 26 11:48:14.583836 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.583748 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 26 11:48:14.583930 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.583875 2572 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 11:48:14.583930 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.583887 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 26 11:48:14.584030 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.583934 2572 server.go:1295] "Started kubelet" May 26 11:48:14.584078 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.584040 2572 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 11:48:14.584124 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.584081 2572 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 11:48:14.584746 ip-10-0-140-83 systemd[1]: Started Kubernetes Kubelet. May 26 11:48:14.585115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.584796 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 11:48:14.586014 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.586000 2572 server.go:317] "Adding debug handlers to kubelet server" May 26 11:48:14.587514 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.587498 2572 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 11:48:14.589002 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.588980 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-szhwg" May 26 11:48:14.593266 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.593249 2572 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 26 11:48:14.594131 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.594119 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 11:48:14.594180 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.594137 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 11:48:14.594260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.594246 2572 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 11:48:14.594316 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.594263 2572 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 11:48:14.594360 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.594346 2572 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 11:48:14.594412 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.594379 2572 reconstruct.go:97] "Volume reconstruction finished" May 26 11:48:14.594412 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.594390 2572 reconciler.go:26] "Reconciler: start to sync state" May 26 11:48:14.596217 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.596198 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:14.596527 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.596508 2572 factory.go:55] Registering systemd factory May 26 11:48:14.596608 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.596528 2572 factory.go:223] Registration of the systemd container factory successfully May 26 11:48:14.597922 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.597904 2572 factory.go:153] Registering CRI-O factory May 26 11:48:14.598022 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.598011 2572 factory.go:223] Registration of the crio container factory successfully May 26 11:48:14.598134 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.598125 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 11:48:14.598212 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.598204 2572 factory.go:103] Registering Raw factory May 26 11:48:14.598277 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.598271 2572 manager.go:1196] Started watching for new ooms in manager May 26 11:48:14.598782 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.598762 2572 manager.go:319] Starting recovery of all containers May 26 11:48:14.601721 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.601696 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:48:14.604746 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.604599 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-83.ec2.internal\" not found" node="ip-10-0-140-83.ec2.internal" May 26 11:48:14.609652 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.609638 2572 manager.go:324] Recovery completed May 26 11:48:14.613777 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.613764 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:48:14.615505 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.615489 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" May 26 11:48:14.615562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.615516 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:48:14.615562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.615532 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" May 26 11:48:14.616778 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.616762 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 11:48:14.616778 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.616777 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 11:48:14.616900 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.616792 2572 state_mem.go:36] "Initialized new in-memory state store" May 26 11:48:14.619086 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.619074 2572 policy_none.go:49] "None policy: Start" May 26 11:48:14.619138 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.619089 2572 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 11:48:14.619138 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.619098 2572 state_mem.go:35] "Initializing new in-memory state store" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.655520 2572 manager.go:341] "Starting Device Plugin manager" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.655550 2572 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.655559 2572 server.go:85] "Starting device plugin registration server" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.655766 2572 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.655779 2572 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.655862 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.655953 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.655976 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.656413 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 11:48:14.668562 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.656462 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:14.691006 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.690977 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 11:48:14.692057 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.692038 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 11:48:14.692123 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.692062 2572 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 11:48:14.692123 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.692080 2572 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 11:48:14.692123 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.692087 2572 kubelet.go:2451] "Starting kubelet main sync loop" May 26 11:48:14.692230 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.692119 2572 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 11:48:14.694478 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.694460 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:48:14.756570 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.756524 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:48:14.757431 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.757415 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" May 26 11:48:14.757515 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.757462 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:48:14.757515 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.757474 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" May 26 11:48:14.757515 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.757496 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-83.ec2.internal" May 26 11:48:14.769088 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.769073 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-83.ec2.internal" May 26 11:48:14.769133 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.769092 2572 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-83.ec2.internal\": node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:14.783581 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.783564 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:14.792319 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.792294 2572 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal"] May 26 11:48:14.792373 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.792356 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:48:14.794027 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.794013 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" May 26 11:48:14.794095 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.794039 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:48:14.794095 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.794048 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" May 26 11:48:14.795314 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.795302 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:48:14.795494 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.795479 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" May 26 11:48:14.795564 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.795507 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:48:14.795939 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.795923 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" May 26 11:48:14.796026 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.795948 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" May 26 11:48:14.796026 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.795970 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:48:14.796026 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.795979 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" May 26 11:48:14.796026 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.795950 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:48:14.796150 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.796038 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" May 26 11:48:14.797240 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.797228 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" May 26 11:48:14.797290 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.797251 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:48:14.797921 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.797908 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" May 26 11:48:14.797976 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.797931 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:48:14.797976 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.797942 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" May 26 11:48:14.817005 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.816986 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-83.ec2.internal\" not found" node="ip-10-0-140-83.ec2.internal" May 26 11:48:14.822517 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.822405 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-83.ec2.internal\" not found" node="ip-10-0-140-83.ec2.internal" May 26 11:48:14.884070 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.884046 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:14.895685 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.895667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3097206daf01a6079095f0123c2f3145-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"3097206daf01a6079095f0123c2f3145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" May 26 11:48:14.895761 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.895690 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3097206daf01a6079095f0123c2f3145-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"3097206daf01a6079095f0123c2f3145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" May 26 11:48:14.895761 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.895709 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/036a10e2095c05efa8434b24463fd654-config\") pod \"kube-apiserver-proxy-ip-10-0-140-83.ec2.internal\" (UID: \"036a10e2095c05efa8434b24463fd654\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" May 26 11:48:14.984863 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:14.984834 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:14.996127 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.996110 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3097206daf01a6079095f0123c2f3145-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"3097206daf01a6079095f0123c2f3145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" May 26 11:48:14.996188 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.996135 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3097206daf01a6079095f0123c2f3145-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"3097206daf01a6079095f0123c2f3145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" May 26 11:48:14.996188 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.996151 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/036a10e2095c05efa8434b24463fd654-config\") pod \"kube-apiserver-proxy-ip-10-0-140-83.ec2.internal\" (UID: \"036a10e2095c05efa8434b24463fd654\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" May 26 11:48:14.996258 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.996190 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3097206daf01a6079095f0123c2f3145-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"3097206daf01a6079095f0123c2f3145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" May 26 11:48:14.996258 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.996197 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3097206daf01a6079095f0123c2f3145-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"3097206daf01a6079095f0123c2f3145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" May 26 11:48:14.996258 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:14.996226 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/036a10e2095c05efa8434b24463fd654-config\") pod \"kube-apiserver-proxy-ip-10-0-140-83.ec2.internal\" (UID: \"036a10e2095c05efa8434b24463fd654\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" May 26 11:48:15.085527 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:15.085501 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:15.119931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.119913 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" May 26 11:48:15.125557 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.125539 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" May 26 11:48:15.185914 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:15.185893 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:15.286387 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:15.286366 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:15.386886 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:15.386826 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:15.487452 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:15.487402 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:15.501859 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.501841 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 11:48:15.501992 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.501976 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 11:48:15.502047 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.502007 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 11:48:15.588126 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:15.588100 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" May 26 11:48:15.591745 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.591703 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 11:43:14 +0000 UTC" deadline="2028-02-28 09:00:54.322780208 +0000 UTC" May 26 11:48:15.591795 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.591745 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15429h12m38.731037114s" May 26 11:48:15.594989 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.594972 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 11:48:15.605477 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.605448 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 11:48:15.630072 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.630052 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z9chg" May 26 11:48:15.636057 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.636039 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z9chg" May 26 11:48:15.646212 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:15.646152 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3097206daf01a6079095f0123c2f3145.slice/crio-5649c90716b6616cbd5145534966edea6bf0edd61d3454950e4879435071ef5b WatchSource:0}: Error finding container 5649c90716b6616cbd5145534966edea6bf0edd61d3454950e4879435071ef5b: Status 404 returned error can't find the container with id 5649c90716b6616cbd5145534966edea6bf0edd61d3454950e4879435071ef5b May 26 11:48:15.646380 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:15.646356 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036a10e2095c05efa8434b24463fd654.slice/crio-5babee2eb6cfd9a96688f025b051bc69841248e507c2fdc57ad499a5c589a789 WatchSource:0}: Error finding container 5babee2eb6cfd9a96688f025b051bc69841248e507c2fdc57ad499a5c589a789: Status 404 returned error can't find the container with id 5babee2eb6cfd9a96688f025b051bc69841248e507c2fdc57ad499a5c589a789 May 26 11:48:15.651647 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.651632 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 11:48:15.687620 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.687599 2572 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:48:15.694237 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.694221 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" May 26 11:48:15.694318 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.694236 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" event={"ID":"036a10e2095c05efa8434b24463fd654","Type":"ContainerStarted","Data":"5babee2eb6cfd9a96688f025b051bc69841248e507c2fdc57ad499a5c589a789"} May 26 11:48:15.695072 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.695053 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" event={"ID":"3097206daf01a6079095f0123c2f3145","Type":"ContainerStarted","Data":"5649c90716b6616cbd5145534966edea6bf0edd61d3454950e4879435071ef5b"} May 26 11:48:15.704946 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.704931 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 11:48:15.706959 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.706948 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" May 26 11:48:15.717357 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:15.717345 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 11:48:16.155783 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.155757 2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:48:16.563784 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.563704 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:48:16.571941 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.571923 2572 apiserver.go:52] "Watching apiserver" May 26 11:48:16.583032 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.583009 2572 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 11:48:16.584302 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.584266 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ptm26","kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw","openshift-cluster-node-tuning-operator/tuned-5w2cx","openshift-dns/node-resolver-njbrp","openshift-image-registry/node-ca-skrzv","openshift-network-diagnostics/network-check-target-bhm75","openshift-network-operator/iptables-alerter-8p9d8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal","openshift-multus/multus-additional-cni-plugins-xrclr","openshift-multus/multus-tb2p2","openshift-multus/network-metrics-daemon-jqqpm","openshift-ovn-kubernetes/ovnkube-node-dj85s"] May 26 11:48:16.586885 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.586855 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:16.586980 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:16.586938 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:16.590971 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.590945 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.591095 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.591074 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.593177 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.593154 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.594192 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.594025 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 11:48:16.594192 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.594051 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 11:48:16.594192 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.594058 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 11:48:16.594192 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.594123 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b5zhm\"" May 26 11:48:16.594192 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.594053 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 11:48:16.594192 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.594165 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 11:48:16.595411 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.595271 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.598751 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.598719 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hn62l\"" May 26 11:48:16.598950 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.598930 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 11:48:16.599065 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.598981 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 11:48:16.599065 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.599003 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gmrj7\"" May 26 11:48:16.599319 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.599280 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 11:48:16.599406 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.599291 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j4565\"" May 26 11:48:16.600126 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.600100 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 11:48:16.600725 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.600407 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 11:48:16.601381 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.600936 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:16.601381 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.601053 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.603178 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.603159 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.604116 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.604099 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hf2f6\"" May 26 11:48:16.604932 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.604886 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02f7eba3-d311-4f16-b8a6-163a864cc3b2-host\") pod \"node-ca-skrzv\" (UID: \"02f7eba3-d311-4f16-b8a6-163a864cc3b2\") " pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.604932 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.604919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-registration-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.605083 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.604945 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 11:48:16.605083 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.604945 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.605083 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605007 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b887901-ea71-4600-8553-3308f38905af-tmp\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605083 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-kubernetes\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-socket-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.605284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-var-lib-kubelet\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605196 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 11:48:16.605284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605200 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5baf7ffa-54d0-4039-8f49-0f965fb6e6b5-hosts-file\") pod \"node-resolver-njbrp\" (UID: \"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5\") " pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.605284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605222 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-sysctl-d\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605253 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-lib-modules\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605264 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 11:48:16.605284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-host\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605299 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5baf7ffa-54d0-4039-8f49-0f965fb6e6b5-tmp-dir\") pod \"node-resolver-njbrp\" (UID: \"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5\") " pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605340 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-device-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-sysconfig\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605386 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-sysctl-conf\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605400 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-sys\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605413 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wqz9v\"" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605454 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn7nj\" (UniqueName: \"kubernetes.io/projected/5baf7ffa-54d0-4039-8f49-0f965fb6e6b5-kube-api-access-wn7nj\") pod \"node-resolver-njbrp\" (UID: \"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5\") " pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605572 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4wz\" (UniqueName: \"kubernetes.io/projected/b249a2d0-d8dd-4d42-a116-9542f566c6ba-kube-api-access-mh4wz\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-systemd\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605632 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-run\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b887901-ea71-4600-8553-3308f38905af-etc-tuned\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.605671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzmd5\" (UniqueName: \"kubernetes.io/projected/9b887901-ea71-4600-8553-3308f38905af-kube-api-access-gzmd5\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.606247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-sys-fs\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.606247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605709 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z2lsw\"" May 26 11:48:16.606247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605722 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02f7eba3-d311-4f16-b8a6-163a864cc3b2-serviceca\") pod \"node-ca-skrzv\" (UID: \"02f7eba3-d311-4f16-b8a6-163a864cc3b2\") " pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.606247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxls\" (UniqueName: \"kubernetes.io/projected/02f7eba3-d311-4f16-b8a6-163a864cc3b2-kube-api-access-9hxls\") pod \"node-ca-skrzv\" (UID: \"02f7eba3-d311-4f16-b8a6-163a864cc3b2\") " pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.606247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.605776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-modprobe-d\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.606488 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.606328 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 11:48:16.606488 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.606340 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 11:48:16.606488 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.606418 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 11:48:16.606606 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.606504 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 11:48:16.606606 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.606557 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 11:48:16.607642 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.607609 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tb2p2" May 26 11:48:16.607971 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.607841 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:16.607971 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:16.607918 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:16.610025 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.610008 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.610153 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.610134 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 11:48:16.610225 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.610198 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f4fkd\"" May 26 11:48:16.612424 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.612405 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 11:48:16.612530 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.612518 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 11:48:16.612751 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.612736 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 11:48:16.612841 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.612822 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 11:48:16.612901 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.612822 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 11:48:16.614271 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.614253 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 11:48:16.614340 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.614283 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m628r\"" May 26 11:48:16.636945 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.636923 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 11:43:15 +0000 UTC" deadline="2028-01-09 16:23:59.351931094 +0000 UTC" May 26 11:48:16.636945 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.636943 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14236h35m42.714990633s" May 26 11:48:16.696013 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.695987 2572 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 11:48:16.706026 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-socket-dir-parent\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.706127 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-daemon-config\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.706127 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-run-systemd\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.706127 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7451ccca-c3a7-442e-8d1e-892dffdb4547-agent-certs\") pod \"konnectivity-agent-ptm26\" (UID: \"7451ccca-c3a7-442e-8d1e-892dffdb4547\") " pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:16.706127 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706116 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.706303 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706148 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b887901-ea71-4600-8553-3308f38905af-tmp\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.706303 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706176 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e657c0a-cfea-484b-86bf-bd51311e786f-env-overrides\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.706303 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a9ab16-21f2-46e0-b3a0-1014db031ffd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.706303 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706234 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9gkn\" (UniqueName: \"kubernetes.io/projected/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-kube-api-access-x9gkn\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:16.706303 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706261 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56f12581-17ab-4baf-9ed7-b0ef39c84361-iptables-alerter-script\") pod \"iptables-alerter-8p9d8\" (UID: \"56f12581-17ab-4baf-9ed7-b0ef39c84361\") " pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.706303 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706235 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.706303 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e657c0a-cfea-484b-86bf-bd51311e786f-ovn-node-metrics-cert\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706309 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-sysctl-d\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706348 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-lib-modules\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706371 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-host\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706396 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5baf7ffa-54d0-4039-8f49-0f965fb6e6b5-tmp-dir\") pod \"node-resolver-njbrp\" (UID: \"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5\") " pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7451ccca-c3a7-442e-8d1e-892dffdb4547-konnectivity-ca\") pod \"konnectivity-agent-ptm26\" (UID: \"7451ccca-c3a7-442e-8d1e-892dffdb4547\") " pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706456 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706465 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-sysctl-d\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706491 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-hostroot\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706529 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-device-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706538 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-lib-modules\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706491 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-host\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-var-lib-cni-bin\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706604 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-device-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.706650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706630 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-cni-bin\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706661 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e657c0a-cfea-484b-86bf-bd51311e786f-ovnkube-config\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706713 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5baf7ffa-54d0-4039-8f49-0f965fb6e6b5-tmp-dir\") pod \"node-resolver-njbrp\" (UID: \"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5\") " pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706717 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706744 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-systemd\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706768 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-run\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706794 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzmd5\" (UniqueName: \"kubernetes.io/projected/9b887901-ea71-4600-8553-3308f38905af-kube-api-access-gzmd5\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-kubelet\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706823 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-systemd\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706845 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-run-openvswitch\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgccv\" (UniqueName: \"kubernetes.io/projected/6e657c0a-cfea-484b-86bf-bd51311e786f-kube-api-access-lgccv\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706875 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-run\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706896 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02f7eba3-d311-4f16-b8a6-163a864cc3b2-serviceca\") pod \"node-ca-skrzv\" (UID: \"02f7eba3-d311-4f16-b8a6-163a864cc3b2\") " pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-os-release\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.706943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-cnibin\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707053 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-run-netns\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707089 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-modprobe-d\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-run-k8s-cni-cncf-io\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-systemd-units\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707176 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-run-ovn-kubernetes\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707200 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e657c0a-cfea-484b-86bf-bd51311e786f-ovnkube-script-lib\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707208 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-modprobe-d\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707224 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-registration-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a9ab16-21f2-46e0-b3a0-1014db031ffd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707271 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-registration-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707280 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707302 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-cni-dir\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-os-release\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707333 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02f7eba3-d311-4f16-b8a6-163a864cc3b2-serviceca\") pod \"node-ca-skrzv\" (UID: \"02f7eba3-d311-4f16-b8a6-163a864cc3b2\") " pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707345 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-var-lib-cni-multus\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-etc-kubernetes\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707416 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-conf-dir\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707458 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-kubernetes\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.707931 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707484 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-socket-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707508 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-var-lib-kubelet\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707512 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-kubernetes\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707532 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5baf7ffa-54d0-4039-8f49-0f965fb6e6b5-hosts-file\") pod \"node-resolver-njbrp\" (UID: \"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5\") " pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707566 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-var-lib-kubelet\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707571 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqccq\" (UniqueName: \"kubernetes.io/projected/25a9ab16-21f2-46e0-b3a0-1014db031ffd-kube-api-access-wqccq\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707599 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-socket-dir\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707613 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-etc-openvswitch\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707647 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-run-ovn\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707664 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5baf7ffa-54d0-4039-8f49-0f965fb6e6b5-hosts-file\") pod \"node-resolver-njbrp\" (UID: \"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5\") " pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-node-log\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707704 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707733 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-slash\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-log-socket\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707783 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-sysconfig\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707800 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-sysctl-conf\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707815 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-sys\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.708755 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-system-cni-dir\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707866 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-sysconfig\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707887 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/189fe7cc-65cb-4875-92ed-c2c6a07097ca-cni-binary-copy\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707891 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-sys\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-var-lib-kubelet\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707931 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b887901-ea71-4600-8553-3308f38905af-etc-sysctl-conf\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707946 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wn7nj\" (UniqueName: \"kubernetes.io/projected/5baf7ffa-54d0-4039-8f49-0f965fb6e6b5-kube-api-access-wn7nj\") pod \"node-resolver-njbrp\" (UID: \"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5\") " pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707973 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.707997 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4wz\" (UniqueName: \"kubernetes.io/projected/b249a2d0-d8dd-4d42-a116-9542f566c6ba-kube-api-access-mh4wz\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708021 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b887901-ea71-4600-8553-3308f38905af-etc-tuned\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-system-cni-dir\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-cnibin\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708098 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708109 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvfld\" (UniqueName: \"kubernetes.io/projected/189fe7cc-65cb-4875-92ed-c2c6a07097ca-kube-api-access-fvfld\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-run-netns\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708157 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-sys-fs\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708181 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxls\" (UniqueName: \"kubernetes.io/projected/02f7eba3-d311-4f16-b8a6-163a864cc3b2-kube-api-access-9hxls\") pod \"node-ca-skrzv\" (UID: \"02f7eba3-d311-4f16-b8a6-163a864cc3b2\") " pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.709566 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708206 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfz2f\" (UniqueName: \"kubernetes.io/projected/56f12581-17ab-4baf-9ed7-b0ef39c84361-kube-api-access-kfz2f\") pod \"iptables-alerter-8p9d8\" (UID: \"56f12581-17ab-4baf-9ed7-b0ef39c84361\") " pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.710310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b249a2d0-d8dd-4d42-a116-9542f566c6ba-sys-fs\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.710310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708319 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-var-lib-openvswitch\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.710310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708345 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-cni-netd\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.710310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708372 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02f7eba3-d311-4f16-b8a6-163a864cc3b2-host\") pod \"node-ca-skrzv\" (UID: \"02f7eba3-d311-4f16-b8a6-163a864cc3b2\") " pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.710310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708397 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-run-multus-certs\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.710310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708417 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a9ab16-21f2-46e0-b3a0-1014db031ffd-cni-binary-copy\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.710310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708453 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02f7eba3-d311-4f16-b8a6-163a864cc3b2-host\") pod \"node-ca-skrzv\" (UID: \"02f7eba3-d311-4f16-b8a6-163a864cc3b2\") " pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.710310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.708475 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56f12581-17ab-4baf-9ed7-b0ef39c84361-host-slash\") pod \"iptables-alerter-8p9d8\" (UID: \"56f12581-17ab-4baf-9ed7-b0ef39c84361\") " pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.710310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.709734 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b887901-ea71-4600-8553-3308f38905af-tmp\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.710727 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.710320 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b887901-ea71-4600-8553-3308f38905af-etc-tuned\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.715479 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:16.715421 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:48:16.715479 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:16.715459 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:48:16.715479 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:16.715472 2572 projected.go:194] Error preparing data for projected volume kube-api-access-4lpxz for pod openshift-network-diagnostics/network-check-target-bhm75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:16.715694 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:16.715531 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz podName:5f4ce227-15d5-4f1f-991d-be70314d08d9 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:17.215511745 +0000 UTC m=+3.092509939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4lpxz" (UniqueName: "kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz") pod "network-check-target-bhm75" (UID: "5f4ce227-15d5-4f1f-991d-be70314d08d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:16.718277 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.718202 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn7nj\" (UniqueName: \"kubernetes.io/projected/5baf7ffa-54d0-4039-8f49-0f965fb6e6b5-kube-api-access-wn7nj\") pod \"node-resolver-njbrp\" (UID: \"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5\") " pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.718277 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.718230 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4wz\" (UniqueName: \"kubernetes.io/projected/b249a2d0-d8dd-4d42-a116-9542f566c6ba-kube-api-access-mh4wz\") pod \"aws-ebs-csi-driver-node-d78nw\" (UID: \"b249a2d0-d8dd-4d42-a116-9542f566c6ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.719562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.719540 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxls\" (UniqueName: \"kubernetes.io/projected/02f7eba3-d311-4f16-b8a6-163a864cc3b2-kube-api-access-9hxls\") pod \"node-ca-skrzv\" (UID: \"02f7eba3-d311-4f16-b8a6-163a864cc3b2\") " pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.719754 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.719734 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzmd5\" (UniqueName: \"kubernetes.io/projected/9b887901-ea71-4600-8553-3308f38905af-kube-api-access-gzmd5\") pod \"tuned-5w2cx\" (UID: \"9b887901-ea71-4600-8553-3308f38905af\") " pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.809400 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809376 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-socket-dir-parent\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809405 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-daemon-config\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809427 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-run-systemd\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809468 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7451ccca-c3a7-442e-8d1e-892dffdb4547-agent-certs\") pod \"konnectivity-agent-ptm26\" (UID: \"7451ccca-c3a7-442e-8d1e-892dffdb4547\") " pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809494 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e657c0a-cfea-484b-86bf-bd51311e786f-env-overrides\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809492 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-socket-dir-parent\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809504 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-run-systemd\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809520 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a9ab16-21f2-46e0-b3a0-1014db031ffd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809548 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9gkn\" (UniqueName: \"kubernetes.io/projected/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-kube-api-access-x9gkn\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809588 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56f12581-17ab-4baf-9ed7-b0ef39c84361-iptables-alerter-script\") pod \"iptables-alerter-8p9d8\" (UID: \"56f12581-17ab-4baf-9ed7-b0ef39c84361\") " pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.809627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809624 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e657c0a-cfea-484b-86bf-bd51311e786f-ovn-node-metrics-cert\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809653 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7451ccca-c3a7-442e-8d1e-892dffdb4547-konnectivity-ca\") pod \"konnectivity-agent-ptm26\" (UID: \"7451ccca-c3a7-442e-8d1e-892dffdb4547\") " pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809676 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-hostroot\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809700 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-var-lib-cni-bin\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809724 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-cni-bin\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809749 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809774 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e657c0a-cfea-484b-86bf-bd51311e786f-ovnkube-config\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809816 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-kubelet\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809852 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-run-openvswitch\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809864 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-var-lib-cni-bin\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809877 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgccv\" (UniqueName: \"kubernetes.io/projected/6e657c0a-cfea-484b-86bf-bd51311e786f-kube-api-access-lgccv\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809932 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-cni-bin\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809937 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-run-openvswitch\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809964 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-kubelet\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809982 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-daemon-config\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.809992 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810025 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-os-release\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.810115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810058 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-cnibin\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810082 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-run-netns\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810108 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-run-k8s-cni-cncf-io\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810141 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56f12581-17ab-4baf-9ed7-b0ef39c84361-iptables-alerter-script\") pod \"iptables-alerter-8p9d8\" (UID: \"56f12581-17ab-4baf-9ed7-b0ef39c84361\") " pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810153 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-systemd-units\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810203 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-run-netns\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810242 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-systemd-units\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810243 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-os-release\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810289 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-run-k8s-cni-cncf-io\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810281 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-cnibin\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810344 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-run-ovn-kubernetes\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810353 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a9ab16-21f2-46e0-b3a0-1014db031ffd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810371 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e657c0a-cfea-484b-86bf-bd51311e786f-ovnkube-script-lib\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810399 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a9ab16-21f2-46e0-b3a0-1014db031ffd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810415 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7451ccca-c3a7-442e-8d1e-892dffdb4547-konnectivity-ca\") pod \"konnectivity-agent-ptm26\" (UID: \"7451ccca-c3a7-442e-8d1e-892dffdb4547\") " pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810431 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810474 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-cni-dir\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.810910 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810500 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-os-release\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810544 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-run-ovn-kubernetes\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:16.810583 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810619 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-cni-dir\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:16.810644 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs podName:3827d450-0d1d-4619-8cc9-8a3c6bc59bb7 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:17.310626316 +0000 UTC m=+3.187624521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs") pod "network-metrics-daemon-jqqpm" (UID: "3827d450-0d1d-4619-8cc9-8a3c6bc59bb7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810475 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-hostroot\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810687 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-var-lib-cni-multus\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810714 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-etc-kubernetes\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810720 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e657c0a-cfea-484b-86bf-bd51311e786f-ovnkube-config\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810738 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-conf-dir\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810756 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e657c0a-cfea-484b-86bf-bd51311e786f-env-overrides\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810768 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-var-lib-cni-multus\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810773 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqccq\" (UniqueName: \"kubernetes.io/projected/25a9ab16-21f2-46e0-b3a0-1014db031ffd-kube-api-access-wqccq\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810799 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-etc-openvswitch\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810831 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-os-release\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810829 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-multus-conf-dir\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810849 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-run-ovn\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810877 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-etc-kubernetes\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.811732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810922 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-run-ovn\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810933 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-node-log\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810952 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-etc-openvswitch\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810972 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a9ab16-21f2-46e0-b3a0-1014db031ffd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.810978 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e657c0a-cfea-484b-86bf-bd51311e786f-ovnkube-script-lib\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811007 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811051 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-slash\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811092 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-log-socket\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811120 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-slash\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811128 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-log-socket\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811184 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-system-cni-dir\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811212 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/189fe7cc-65cb-4875-92ed-c2c6a07097ca-cni-binary-copy\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811237 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-var-lib-kubelet\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811270 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-system-cni-dir\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811295 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-cnibin\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811300 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-system-cni-dir\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.812592 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811319 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvfld\" (UniqueName: \"kubernetes.io/projected/189fe7cc-65cb-4875-92ed-c2c6a07097ca-kube-api-access-fvfld\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811325 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-var-lib-kubelet\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811348 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-run-netns\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811351 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-system-cni-dir\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811370 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a9ab16-21f2-46e0-b3a0-1014db031ffd-cnibin\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811397 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kfz2f\" (UniqueName: \"kubernetes.io/projected/56f12581-17ab-4baf-9ed7-b0ef39c84361-kube-api-access-kfz2f\") pod \"iptables-alerter-8p9d8\" (UID: \"56f12581-17ab-4baf-9ed7-b0ef39c84361\") " pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811410 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-node-log\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811415 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-run-netns\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811422 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-var-lib-openvswitch\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811465 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-cni-netd\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811471 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-var-lib-openvswitch\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811491 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-run-multus-certs\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e657c0a-cfea-484b-86bf-bd51311e786f-host-cni-netd\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811518 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a9ab16-21f2-46e0-b3a0-1014db031ffd-cni-binary-copy\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811554 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/189fe7cc-65cb-4875-92ed-c2c6a07097ca-host-run-multus-certs\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811539 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56f12581-17ab-4baf-9ed7-b0ef39c84361-host-slash\") pod \"iptables-alerter-8p9d8\" (UID: \"56f12581-17ab-4baf-9ed7-b0ef39c84361\") " pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.811946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/189fe7cc-65cb-4875-92ed-c2c6a07097ca-cni-binary-copy\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.813323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.812109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56f12581-17ab-4baf-9ed7-b0ef39c84361-host-slash\") pod \"iptables-alerter-8p9d8\" (UID: \"56f12581-17ab-4baf-9ed7-b0ef39c84361\") " pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.814170 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.812336 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a9ab16-21f2-46e0-b3a0-1014db031ffd-cni-binary-copy\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.814708 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.814676 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7451ccca-c3a7-442e-8d1e-892dffdb4547-agent-certs\") pod \"konnectivity-agent-ptm26\" (UID: \"7451ccca-c3a7-442e-8d1e-892dffdb4547\") " pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:16.815708 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.815684 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e657c0a-cfea-484b-86bf-bd51311e786f-ovn-node-metrics-cert\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.819739 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.819696 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9gkn\" (UniqueName: \"kubernetes.io/projected/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-kube-api-access-x9gkn\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:16.820138 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.820119 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgccv\" (UniqueName: \"kubernetes.io/projected/6e657c0a-cfea-484b-86bf-bd51311e786f-kube-api-access-lgccv\") pod \"ovnkube-node-dj85s\" (UID: \"6e657c0a-cfea-484b-86bf-bd51311e786f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:16.821049 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.821009 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvfld\" (UniqueName: \"kubernetes.io/projected/189fe7cc-65cb-4875-92ed-c2c6a07097ca-kube-api-access-fvfld\") pod \"multus-tb2p2\" (UID: \"189fe7cc-65cb-4875-92ed-c2c6a07097ca\") " pod="openshift-multus/multus-tb2p2" May 26 11:48:16.821330 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.821297 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqccq\" (UniqueName: \"kubernetes.io/projected/25a9ab16-21f2-46e0-b3a0-1014db031ffd-kube-api-access-wqccq\") pod \"multus-additional-cni-plugins-xrclr\" (UID: \"25a9ab16-21f2-46e0-b3a0-1014db031ffd\") " pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.821407 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.821367 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfz2f\" (UniqueName: \"kubernetes.io/projected/56f12581-17ab-4baf-9ed7-b0ef39c84361-kube-api-access-kfz2f\") pod \"iptables-alerter-8p9d8\" (UID: \"56f12581-17ab-4baf-9ed7-b0ef39c84361\") " pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.850742 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.850721 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:48:16.904374 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.904352 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" May 26 11:48:16.911358 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.911337 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" May 26 11:48:16.920972 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.920955 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-njbrp" May 26 11:48:16.924431 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.924408 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-skrzv" May 26 11:48:16.931001 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.930985 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:16.938503 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.938486 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8p9d8" May 26 11:48:16.944990 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.944974 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xrclr" May 26 11:48:16.950558 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.950541 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tb2p2" May 26 11:48:16.955087 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:16.955070 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:17.253344 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:17.253307 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f12581_17ab_4baf_9ed7_b0ef39c84361.slice/crio-c00e3e1fb5d041ddd0e71c1530a578e88896f9debfab38a26f8b6e7e52ef85d3 WatchSource:0}: Error finding container c00e3e1fb5d041ddd0e71c1530a578e88896f9debfab38a26f8b6e7e52ef85d3: Status 404 returned error can't find the container with id c00e3e1fb5d041ddd0e71c1530a578e88896f9debfab38a26f8b6e7e52ef85d3 May 26 11:48:17.256392 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:17.256366 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f7eba3_d311_4f16_b8a6_163a864cc3b2.slice/crio-a28ffd7ac28e5031bcbc246dd5b7cf7de2b247751945fd1d0e27f9bed5d4a0fc WatchSource:0}: Error finding container a28ffd7ac28e5031bcbc246dd5b7cf7de2b247751945fd1d0e27f9bed5d4a0fc: Status 404 returned error can't find the container with id a28ffd7ac28e5031bcbc246dd5b7cf7de2b247751945fd1d0e27f9bed5d4a0fc May 26 11:48:17.257452 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:17.257390 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb249a2d0_d8dd_4d42_a116_9542f566c6ba.slice/crio-b85c9aa28b784d839e4d97b2cce5a01296291c13355e4ea5f6817e6a201968e8 WatchSource:0}: Error finding container b85c9aa28b784d839e4d97b2cce5a01296291c13355e4ea5f6817e6a201968e8: Status 404 returned error can't find the container with id b85c9aa28b784d839e4d97b2cce5a01296291c13355e4ea5f6817e6a201968e8 May 26 11:48:17.258009 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:17.257985 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e657c0a_cfea_484b_86bf_bd51311e786f.slice/crio-3fbf235851dba97f95099526130eb0cf7cd12887af99005d0ecbd645bc22043d WatchSource:0}: Error finding container 3fbf235851dba97f95099526130eb0cf7cd12887af99005d0ecbd645bc22043d: Status 404 returned error can't find the container with id 3fbf235851dba97f95099526130eb0cf7cd12887af99005d0ecbd645bc22043d May 26 11:48:17.279911 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:17.279895 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189fe7cc_65cb_4875_92ed_c2c6a07097ca.slice/crio-8594f12aa406d0c677776f6e88217f735eea8a97966c84392d3dc0cf84ae0c73 WatchSource:0}: Error finding container 8594f12aa406d0c677776f6e88217f735eea8a97966c84392d3dc0cf84ae0c73: Status 404 returned error can't find the container with id 8594f12aa406d0c677776f6e88217f735eea8a97966c84392d3dc0cf84ae0c73 May 26 11:48:17.281117 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:17.280949 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5baf7ffa_54d0_4039_8f49_0f965fb6e6b5.slice/crio-f1640afe5eb8bca9252d4dacb685840841e879713259b6ab8e44c2a454ffe407 WatchSource:0}: Error finding container f1640afe5eb8bca9252d4dacb685840841e879713259b6ab8e44c2a454ffe407: Status 404 returned error can't find the container with id f1640afe5eb8bca9252d4dacb685840841e879713259b6ab8e44c2a454ffe407 May 26 11:48:17.281661 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:17.281637 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b887901_ea71_4600_8553_3308f38905af.slice/crio-a97509fb9e0a8f48a0639299750c768df0963ad61b8e8259fe5ba2e6b6b626a0 WatchSource:0}: Error finding container a97509fb9e0a8f48a0639299750c768df0963ad61b8e8259fe5ba2e6b6b626a0: Status 404 returned error can't find the container with id a97509fb9e0a8f48a0639299750c768df0963ad61b8e8259fe5ba2e6b6b626a0 May 26 11:48:17.282373 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:17.282341 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7451ccca_c3a7_442e_8d1e_892dffdb4547.slice/crio-b0d22f3b04b72e60c99c7ddb7584cdb7f239e3bdca3d5afd8726f0a90ddddaaa WatchSource:0}: Error finding container b0d22f3b04b72e60c99c7ddb7584cdb7f239e3bdca3d5afd8726f0a90ddddaaa: Status 404 returned error can't find the container with id b0d22f3b04b72e60c99c7ddb7584cdb7f239e3bdca3d5afd8726f0a90ddddaaa May 26 11:48:17.283384 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:17.283325 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a9ab16_21f2_46e0_b3a0_1014db031ffd.slice/crio-9a429e8ef8a30dc6688df0b2821fc0ed580c4856fb668c200551a03fcaba9235 WatchSource:0}: Error finding container 9a429e8ef8a30dc6688df0b2821fc0ed580c4856fb668c200551a03fcaba9235: Status 404 returned error can't find the container with id 9a429e8ef8a30dc6688df0b2821fc0ed580c4856fb668c200551a03fcaba9235 May 26 11:48:17.315264 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.315118 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:17.315264 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:17.315251 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:48:17.315400 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:17.315271 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:48:17.315400 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.315278 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:17.315400 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:17.315282 2572 projected.go:194] Error preparing data for projected volume kube-api-access-4lpxz for pod openshift-network-diagnostics/network-check-target-bhm75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:17.315400 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:17.315339 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz podName:5f4ce227-15d5-4f1f-991d-be70314d08d9 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:18.315326461 +0000 UTC m=+4.192324652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lpxz" (UniqueName: "kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz") pod "network-check-target-bhm75" (UID: "5f4ce227-15d5-4f1f-991d-be70314d08d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:17.315400 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:17.315341 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:17.315400 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:17.315390 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs podName:3827d450-0d1d-4619-8cc9-8a3c6bc59bb7 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:18.315372053 +0000 UTC m=+4.192370258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs") pod "network-metrics-daemon-jqqpm" (UID: "3827d450-0d1d-4619-8cc9-8a3c6bc59bb7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:17.638144 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.638107 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 11:43:15 +0000 UTC" deadline="2028-02-21 19:03:13.9246105 +0000 UTC" May 26 11:48:17.638144 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.638143 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15271h14m56.286471074s" May 26 11:48:17.699969 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.699935 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" event={"ID":"036a10e2095c05efa8434b24463fd654","Type":"ContainerStarted","Data":"a718adaa02b6672916a6ecd080225b78dc4f2e1c2f5fffdb3e2f6c0eb37f2b5a"} May 26 11:48:17.704481 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.703655 2572 generic.go:358] "Generic (PLEG): container finished" podID="3097206daf01a6079095f0123c2f3145" containerID="b463f330ffbac50f07a23211246a9ff0a7c311b0a483c745e82660bb266e7190" exitCode=0 May 26 11:48:17.704481 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.703720 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" event={"ID":"3097206daf01a6079095f0123c2f3145","Type":"ContainerDied","Data":"b463f330ffbac50f07a23211246a9ff0a7c311b0a483c745e82660bb266e7190"} May 26 11:48:17.733465 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.713394 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ptm26" event={"ID":"7451ccca-c3a7-442e-8d1e-892dffdb4547","Type":"ContainerStarted","Data":"b0d22f3b04b72e60c99c7ddb7584cdb7f239e3bdca3d5afd8726f0a90ddddaaa"} May 26 11:48:17.733465 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.716081 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" podStartSLOduration=2.716068761 podStartE2EDuration="2.716068761s" podCreationTimestamp="2026-05-26 11:48:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:48:17.715757725 +0000 UTC m=+3.592755938" watchObservedRunningTime="2026-05-26 11:48:17.716068761 +0000 UTC m=+3.593066973" May 26 11:48:17.733465 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.719258 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" event={"ID":"9b887901-ea71-4600-8553-3308f38905af","Type":"ContainerStarted","Data":"a97509fb9e0a8f48a0639299750c768df0963ad61b8e8259fe5ba2e6b6b626a0"} May 26 11:48:17.733465 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.725376 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-njbrp" event={"ID":"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5","Type":"ContainerStarted","Data":"f1640afe5eb8bca9252d4dacb685840841e879713259b6ab8e44c2a454ffe407"} May 26 11:48:17.733465 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.726757 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerStarted","Data":"3fbf235851dba97f95099526130eb0cf7cd12887af99005d0ecbd645bc22043d"} May 26 11:48:17.733465 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.730746 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-skrzv" event={"ID":"02f7eba3-d311-4f16-b8a6-163a864cc3b2","Type":"ContainerStarted","Data":"a28ffd7ac28e5031bcbc246dd5b7cf7de2b247751945fd1d0e27f9bed5d4a0fc"} May 26 11:48:17.733465 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.732378 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8p9d8" event={"ID":"56f12581-17ab-4baf-9ed7-b0ef39c84361","Type":"ContainerStarted","Data":"c00e3e1fb5d041ddd0e71c1530a578e88896f9debfab38a26f8b6e7e52ef85d3"} May 26 11:48:17.737462 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.736927 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xrclr" event={"ID":"25a9ab16-21f2-46e0-b3a0-1014db031ffd","Type":"ContainerStarted","Data":"9a429e8ef8a30dc6688df0b2821fc0ed580c4856fb668c200551a03fcaba9235"} May 26 11:48:17.746035 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.745973 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tb2p2" event={"ID":"189fe7cc-65cb-4875-92ed-c2c6a07097ca","Type":"ContainerStarted","Data":"8594f12aa406d0c677776f6e88217f735eea8a97966c84392d3dc0cf84ae0c73"} May 26 11:48:17.751343 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:17.750454 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" event={"ID":"b249a2d0-d8dd-4d42-a116-9542f566c6ba","Type":"ContainerStarted","Data":"b85c9aa28b784d839e4d97b2cce5a01296291c13355e4ea5f6817e6a201968e8"} May 26 11:48:18.322693 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:18.322646 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:18.322876 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:18.322706 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:18.322876 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:18.322828 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:18.322997 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:18.322885 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs podName:3827d450-0d1d-4619-8cc9-8a3c6bc59bb7 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:20.322867529 +0000 UTC m=+6.199865724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs") pod "network-metrics-daemon-jqqpm" (UID: "3827d450-0d1d-4619-8cc9-8a3c6bc59bb7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:18.323306 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:18.323288 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:48:18.323384 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:18.323311 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:48:18.323384 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:18.323323 2572 projected.go:194] Error preparing data for projected volume kube-api-access-4lpxz for pod openshift-network-diagnostics/network-check-target-bhm75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:18.323384 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:18.323369 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz podName:5f4ce227-15d5-4f1f-991d-be70314d08d9 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:20.323354431 +0000 UTC m=+6.200352624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lpxz" (UniqueName: "kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz") pod "network-check-target-bhm75" (UID: "5f4ce227-15d5-4f1f-991d-be70314d08d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:18.693516 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:18.693184 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:18.693516 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:18.693305 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:18.693516 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:18.693341 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:18.693516 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:18.693427 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:18.778984 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:18.778558 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" event={"ID":"3097206daf01a6079095f0123c2f3145","Type":"ContainerStarted","Data":"58219fc29e70d9121d9d2cdc39bcbdae84319605250584cd022259a9aac793c1"} May 26 11:48:20.344107 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:20.343793 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:20.344107 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:20.343854 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:20.344107 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:20.343971 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:20.344107 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:20.344016 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:48:20.344107 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:20.344042 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs podName:3827d450-0d1d-4619-8cc9-8a3c6bc59bb7 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:24.344023104 +0000 UTC m=+10.221021297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs") pod "network-metrics-daemon-jqqpm" (UID: "3827d450-0d1d-4619-8cc9-8a3c6bc59bb7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:20.344107 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:20.344043 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:48:20.344107 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:20.344077 2572 projected.go:194] Error preparing data for projected volume kube-api-access-4lpxz for pod openshift-network-diagnostics/network-check-target-bhm75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:20.344901 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:20.344132 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz podName:5f4ce227-15d5-4f1f-991d-be70314d08d9 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:24.344115236 +0000 UTC m=+10.221113442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lpxz" (UniqueName: "kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz") pod "network-check-target-bhm75" (UID: "5f4ce227-15d5-4f1f-991d-be70314d08d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:20.693538 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:20.692982 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:20.693538 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:20.693014 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:20.693538 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:20.693109 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:20.693538 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:20.693220 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:22.259115 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.259004 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" podStartSLOduration=7.258986083 podStartE2EDuration="7.258986083s" podCreationTimestamp="2026-05-26 11:48:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:48:18.797003445 +0000 UTC m=+4.674001658" watchObservedRunningTime="2026-05-26 11:48:22.258986083 +0000 UTC m=+8.135984296" May 26 11:48:22.259673 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.259401 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kmk8t"] May 26 11:48:22.263509 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.263481 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.263629 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:22.263564 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:22.360610 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.360575 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-dbus\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.360833 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.360618 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.360833 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.360658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-kubelet-config\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.462748 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.461991 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-dbus\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.462748 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.462070 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.462748 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.462118 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-kubelet-config\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.462748 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.462234 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-kubelet-config\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.462748 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.462365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-dbus\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.462748 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:22.462484 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 11:48:22.462748 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:22.462539 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret podName:b6086d7b-3f08-4547-a3b0-8c9f406a71fb nodeName:}" failed. No retries permitted until 2026-05-26 11:48:22.962521418 +0000 UTC m=+8.839519615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret") pod "global-pull-secret-syncer-kmk8t" (UID: "b6086d7b-3f08-4547-a3b0-8c9f406a71fb") : object "kube-system"/"original-pull-secret" not registered May 26 11:48:22.692563 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.692529 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:22.692739 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:22.692674 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:22.692739 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.692724 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:22.692855 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:22.692793 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:22.966429 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:22.966351 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:22.966586 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:22.966516 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 11:48:22.966586 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:22.966586 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret podName:b6086d7b-3f08-4547-a3b0-8c9f406a71fb nodeName:}" failed. No retries permitted until 2026-05-26 11:48:23.966568141 +0000 UTC m=+9.843566334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret") pod "global-pull-secret-syncer-kmk8t" (UID: "b6086d7b-3f08-4547-a3b0-8c9f406a71fb") : object "kube-system"/"original-pull-secret" not registered May 26 11:48:23.692561 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:23.692529 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:23.692946 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:23.692672 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:23.976114 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:23.975752 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:23.976114 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:23.975938 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 11:48:23.976114 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:23.976014 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret podName:b6086d7b-3f08-4547-a3b0-8c9f406a71fb nodeName:}" failed. No retries permitted until 2026-05-26 11:48:25.97598597 +0000 UTC m=+11.852984175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret") pod "global-pull-secret-syncer-kmk8t" (UID: "b6086d7b-3f08-4547-a3b0-8c9f406a71fb") : object "kube-system"/"original-pull-secret" not registered May 26 11:48:24.380136 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:24.380094 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:24.380324 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:24.380158 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:24.380324 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:24.380306 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:24.380467 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:24.380336 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:48:24.380467 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:24.380360 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:48:24.380467 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:24.380365 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs podName:3827d450-0d1d-4619-8cc9-8a3c6bc59bb7 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:32.380346133 +0000 UTC m=+18.257344330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs") pod "network-metrics-daemon-jqqpm" (UID: "3827d450-0d1d-4619-8cc9-8a3c6bc59bb7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:24.380467 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:24.380374 2572 projected.go:194] Error preparing data for projected volume kube-api-access-4lpxz for pod openshift-network-diagnostics/network-check-target-bhm75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:24.380467 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:24.380428 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz podName:5f4ce227-15d5-4f1f-991d-be70314d08d9 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:32.380411828 +0000 UTC m=+18.257410024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lpxz" (UniqueName: "kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz") pod "network-check-target-bhm75" (UID: "5f4ce227-15d5-4f1f-991d-be70314d08d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:24.693477 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:24.693387 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:24.693903 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:24.693519 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:24.693903 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:24.693882 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:24.694017 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:24.693985 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:25.692619 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:25.692587 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:25.692784 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:25.692709 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:25.993362 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:25.993274 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:25.993785 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:25.993394 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 11:48:25.993785 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:25.993471 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret podName:b6086d7b-3f08-4547-a3b0-8c9f406a71fb nodeName:}" failed. No retries permitted until 2026-05-26 11:48:29.993453789 +0000 UTC m=+15.870451999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret") pod "global-pull-secret-syncer-kmk8t" (UID: "b6086d7b-3f08-4547-a3b0-8c9f406a71fb") : object "kube-system"/"original-pull-secret" not registered May 26 11:48:26.692495 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:26.692453 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:26.692735 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:26.692501 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:26.692735 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:26.692578 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:26.692735 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:26.692703 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:27.692216 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:27.692189 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:27.692705 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:27.692295 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:28.692890 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:28.692851 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:28.693340 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:28.692981 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:28.693340 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:28.693037 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:28.693340 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:28.693154 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:29.693163 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:29.693129 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:29.693660 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:29.693252 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:30.026634 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:30.026557 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:30.026781 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:30.026711 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 11:48:30.026781 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:30.026772 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret podName:b6086d7b-3f08-4547-a3b0-8c9f406a71fb nodeName:}" failed. No retries permitted until 2026-05-26 11:48:38.026751992 +0000 UTC m=+23.903750195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret") pod "global-pull-secret-syncer-kmk8t" (UID: "b6086d7b-3f08-4547-a3b0-8c9f406a71fb") : object "kube-system"/"original-pull-secret" not registered May 26 11:48:30.693217 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:30.693180 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:30.693689 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:30.693316 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:30.693689 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:30.693323 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:30.693689 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:30.693425 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:31.692453 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:31.692405 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:31.692617 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:31.692567 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:32.444393 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:32.444341 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:32.444843 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:32.444409 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:32.444843 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:32.444501 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:48:32.444843 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:32.444527 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:48:32.444843 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:32.444542 2572 projected.go:194] Error preparing data for projected volume kube-api-access-4lpxz for pod openshift-network-diagnostics/network-check-target-bhm75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:32.444843 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:32.444552 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:32.444843 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:32.444609 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz podName:5f4ce227-15d5-4f1f-991d-be70314d08d9 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:48.444590115 +0000 UTC m=+34.321588321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lpxz" (UniqueName: "kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz") pod "network-check-target-bhm75" (UID: "5f4ce227-15d5-4f1f-991d-be70314d08d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:32.444843 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:32.444631 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs podName:3827d450-0d1d-4619-8cc9-8a3c6bc59bb7 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:48.444620547 +0000 UTC m=+34.321618741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs") pod "network-metrics-daemon-jqqpm" (UID: "3827d450-0d1d-4619-8cc9-8a3c6bc59bb7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:32.692792 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:32.692760 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:32.692956 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:32.692897 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:32.693017 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:32.692954 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:32.693086 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:32.693066 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:33.692943 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:33.692909 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:33.693352 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:33.693016 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:34.693507 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:34.693477 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:34.693924 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:34.693477 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:34.693924 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:34.693567 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:34.693924 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:34.693645 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:35.693105 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.692953 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:35.693203 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:35.693167 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:35.807354 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.807259 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ptm26" event={"ID":"7451ccca-c3a7-442e-8d1e-892dffdb4547","Type":"ContainerStarted","Data":"151d97141a6b46c97298b3d39933dcf8a7942e326815947846f17fe8cebceafa"} May 26 11:48:35.808945 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.808919 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" event={"ID":"9b887901-ea71-4600-8553-3308f38905af","Type":"ContainerStarted","Data":"10adb3fdfa056f62f0d11fd9e9146e150ceee8cd84e8a27b143f89aaa71cbcfc"} May 26 11:48:35.810326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.810290 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-njbrp" event={"ID":"5baf7ffa-54d0-4039-8f49-0f965fb6e6b5","Type":"ContainerStarted","Data":"6c9af40b41800d248f3bc6efbc4da6a7a68475733778f720d1c4e037e0462b9f"} May 26 11:48:35.813123 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.813103 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/0.log" May 26 11:48:35.813475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.813452 2572 generic.go:358] "Generic (PLEG): container finished" podID="6e657c0a-cfea-484b-86bf-bd51311e786f" containerID="add3dfdf047300b42020961a368769dc11836cda69dc4d965b6c150badf22cb2" exitCode=1 May 26 11:48:35.813475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.813467 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerStarted","Data":"9250e45c7cd113f710b074b780357468c5d803ff13b23a5b736d27638b69aa3d"} May 26 11:48:35.813637 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.813491 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerStarted","Data":"c3ebe4ca4245568676da0c3de9172e0043de4cb3f1fde23af763be8275c4bb10"} May 26 11:48:35.813637 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.813507 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerStarted","Data":"a2546a3f6fd215a917adbd10b76aaf0e3bd0d0eca9b0c2a318dc537d22d0504e"} May 26 11:48:35.813637 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.813520 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerStarted","Data":"81b58a6d2534bf1495930f704153df19e552a6944f20c4e7d73aa2eceddeb2f2"} May 26 11:48:35.813637 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.813533 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerDied","Data":"add3dfdf047300b42020961a368769dc11836cda69dc4d965b6c150badf22cb2"} May 26 11:48:35.813637 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.813542 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerStarted","Data":"68220cb65ef28c083964c3a058912c330468ae15e80adb05b87f7157fadb1a7e"} May 26 11:48:35.815046 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.815025 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-skrzv" event={"ID":"02f7eba3-d311-4f16-b8a6-163a864cc3b2","Type":"ContainerStarted","Data":"8f3d1ef67111eedea53dd903483d4a82b1247596ef22774f290731055e3f5d5a"} May 26 11:48:35.816494 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.816471 2572 generic.go:358] "Generic (PLEG): container finished" podID="25a9ab16-21f2-46e0-b3a0-1014db031ffd" containerID="34b20be8343087606548481f7a2acbb8330a98bb72bcf81c1b46bc3e9c803570" exitCode=0 May 26 11:48:35.816604 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.816541 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xrclr" event={"ID":"25a9ab16-21f2-46e0-b3a0-1014db031ffd","Type":"ContainerDied","Data":"34b20be8343087606548481f7a2acbb8330a98bb72bcf81c1b46bc3e9c803570"} May 26 11:48:35.818327 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.818293 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tb2p2" event={"ID":"189fe7cc-65cb-4875-92ed-c2c6a07097ca","Type":"ContainerStarted","Data":"f07aa1fde5df0ef18828aeb6ed99a77c9fa0d23b5af033e96e485e83bb8ec796"} May 26 11:48:35.819666 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.819637 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" event={"ID":"b249a2d0-d8dd-4d42-a116-9542f566c6ba","Type":"ContainerStarted","Data":"0c9bdca78169c4495cf7ec99516fc9265cb3e7dda987df903fe81cbd31871b06"} May 26 11:48:35.822519 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.822482 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ptm26" podStartSLOduration=4.097854738 podStartE2EDuration="21.822471582s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:48:17.287112897 +0000 UTC m=+3.164111087" lastFinishedPulling="2026-05-26 11:48:35.011729727 +0000 UTC m=+20.888727931" observedRunningTime="2026-05-26 11:48:35.822157343 +0000 UTC m=+21.699155557" watchObservedRunningTime="2026-05-26 11:48:35.822471582 +0000 UTC m=+21.699469795" May 26 11:48:35.853016 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.852970 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5w2cx" podStartSLOduration=4.126629642 podStartE2EDuration="21.852954992s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:48:17.286922938 +0000 UTC m=+3.163921143" lastFinishedPulling="2026-05-26 11:48:35.013248296 +0000 UTC m=+20.890246493" observedRunningTime="2026-05-26 11:48:35.838730164 +0000 UTC m=+21.715728390" watchObservedRunningTime="2026-05-26 11:48:35.852954992 +0000 UTC m=+21.729953205" May 26 11:48:35.853117 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.853097 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-njbrp" podStartSLOduration=4.128299871 podStartE2EDuration="21.853090402s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:48:17.286917342 +0000 UTC m=+3.163915547" lastFinishedPulling="2026-05-26 11:48:35.011707874 +0000 UTC m=+20.888706078" observedRunningTime="2026-05-26 11:48:35.852719705 +0000 UTC m=+21.729717921" watchObservedRunningTime="2026-05-26 11:48:35.853090402 +0000 UTC m=+21.730088616" May 26 11:48:35.867505 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:35.867410 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-skrzv" podStartSLOduration=7.939912402 podStartE2EDuration="21.867396416s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:48:17.279040675 +0000 UTC m=+3.156038879" lastFinishedPulling="2026-05-26 11:48:31.206524689 +0000 UTC m=+17.083522893" observedRunningTime="2026-05-26 11:48:35.867324853 +0000 UTC m=+21.744323066" watchObservedRunningTime="2026-05-26 11:48:35.867396416 +0000 UTC m=+21.744394628" May 26 11:48:36.006943 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.006915 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:36.007622 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.007602 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:36.028127 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.028085 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-tb2p2" podStartSLOduration=4.257904594 podStartE2EDuration="22.02807206s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:48:17.281883729 +0000 UTC m=+3.158881920" lastFinishedPulling="2026-05-26 11:48:35.052051193 +0000 UTC m=+20.929049386" observedRunningTime="2026-05-26 11:48:35.908533377 +0000 UTC m=+21.785531590" watchObservedRunningTime="2026-05-26 11:48:36.02807206 +0000 UTC m=+21.905070272" May 26 11:48:36.493253 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.493226 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 11:48:36.666758 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.666587 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T11:48:36.493248156Z","UUID":"0a70c780-514f-40c1-95f2-f6094ae055ee","Handler":null,"Name":"","Endpoint":""} May 26 11:48:36.668527 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.668505 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 11:48:36.668643 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.668543 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 11:48:36.692609 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.692584 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:36.692609 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.692596 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:36.692772 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:36.692686 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:36.692848 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:36.692827 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:36.822347 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.822312 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8p9d8" event={"ID":"56f12581-17ab-4baf-9ed7-b0ef39c84361","Type":"ContainerStarted","Data":"9da132498517778eff9209d0eed16a98ce5e64476320f689f3cc9acdbd6ae196"} May 26 11:48:36.823938 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.823915 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" event={"ID":"b249a2d0-d8dd-4d42-a116-9542f566c6ba","Type":"ContainerStarted","Data":"ca6727cd48d3f7295ad0db2ad8d4b2f40c3e8d9a34345eef62d5c80cd10ac695"} May 26 11:48:36.824558 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.824523 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:36.824743 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.824725 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ptm26" May 26 11:48:36.839095 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:36.839060 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8p9d8" podStartSLOduration=5.083078057 podStartE2EDuration="22.839050742s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:48:17.255706571 +0000 UTC m=+3.132704761" lastFinishedPulling="2026-05-26 11:48:35.01167925 +0000 UTC m=+20.888677446" observedRunningTime="2026-05-26 11:48:36.838760591 +0000 UTC m=+22.715758813" watchObservedRunningTime="2026-05-26 11:48:36.839050742 +0000 UTC m=+22.716048959" May 26 11:48:37.692771 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:37.692747 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:37.692893 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:37.692855 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:37.827891 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:37.827841 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" event={"ID":"b249a2d0-d8dd-4d42-a116-9542f566c6ba","Type":"ContainerStarted","Data":"f645eb149357d53047828de9e90a04f13d73737fbfabb307c124baf6419fb019"} May 26 11:48:38.094004 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:38.093804 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:38.094158 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:38.093934 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 11:48:38.094158 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:38.094090 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret podName:b6086d7b-3f08-4547-a3b0-8c9f406a71fb nodeName:}" failed. No retries permitted until 2026-05-26 11:48:54.094068496 +0000 UTC m=+39.971066689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret") pod "global-pull-secret-syncer-kmk8t" (UID: "b6086d7b-3f08-4547-a3b0-8c9f406a71fb") : object "kube-system"/"original-pull-secret" not registered May 26 11:48:38.693014 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:38.692960 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:38.693213 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:38.693080 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:38.693213 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:38.693149 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:38.693339 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:38.693243 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:38.832770 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:38.832743 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/0.log" May 26 11:48:38.833225 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:38.833165 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerStarted","Data":"f1d775ed36ba266eaef5bd3e80879bed5fb56a1cd3a520f64153796e6c0fe914"} May 26 11:48:39.693197 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:39.693165 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:39.693377 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:39.693282 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:40.692675 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.692509 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:40.693183 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.692507 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:40.693183 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:40.692749 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:40.693183 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:40.692840 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:40.838918 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.838900 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/0.log" May 26 11:48:40.839198 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.839181 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerStarted","Data":"446b5243cdb91416ac9d8b73f345a7d4063cfef4c8223b444656ec2a945695c6"} May 26 11:48:40.839508 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.839489 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:40.839629 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.839614 2572 scope.go:117] "RemoveContainer" containerID="add3dfdf047300b42020961a368769dc11836cda69dc4d965b6c150badf22cb2" May 26 11:48:40.840980 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.840955 2572 generic.go:358] "Generic (PLEG): container finished" podID="25a9ab16-21f2-46e0-b3a0-1014db031ffd" containerID="dfb966fb8521c5ce5badd51b5d7fadf3ebb2e87ecd2632eccf7d576aa14349d5" exitCode=0 May 26 11:48:40.841074 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.841005 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xrclr" event={"ID":"25a9ab16-21f2-46e0-b3a0-1014db031ffd","Type":"ContainerDied","Data":"dfb966fb8521c5ce5badd51b5d7fadf3ebb2e87ecd2632eccf7d576aa14349d5"} May 26 11:48:40.855265 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.855249 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:40.866302 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:40.866265 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d78nw" podStartSLOduration=6.501624141 podStartE2EDuration="26.866255382s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:48:17.279051902 +0000 UTC m=+3.156050097" lastFinishedPulling="2026-05-26 11:48:37.643683144 +0000 UTC m=+23.520681338" observedRunningTime="2026-05-26 11:48:37.845900175 +0000 UTC m=+23.722898386" watchObservedRunningTime="2026-05-26 11:48:40.866255382 +0000 UTC m=+26.743253594" May 26 11:48:41.692714 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:41.692691 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:41.692977 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:41.692776 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:41.846013 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:41.845992 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/0.log" May 26 11:48:41.846384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:41.846348 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" event={"ID":"6e657c0a-cfea-484b-86bf-bd51311e786f","Type":"ContainerStarted","Data":"227fa1514e48b5f8bdb37927a7ef608bd398cb0d9de0147e9a984066bb8571d1"} May 26 11:48:41.846675 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:41.846653 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:41.846780 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:41.846690 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:41.848461 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:41.848425 2572 generic.go:358] "Generic (PLEG): container finished" podID="25a9ab16-21f2-46e0-b3a0-1014db031ffd" containerID="dcaee685a2223bd0ef6fb35a894f79f29b6800474502a46a8999553a79c58983" exitCode=0 May 26 11:48:41.848548 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:41.848468 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xrclr" event={"ID":"25a9ab16-21f2-46e0-b3a0-1014db031ffd","Type":"ContainerDied","Data":"dcaee685a2223bd0ef6fb35a894f79f29b6800474502a46a8999553a79c58983"} May 26 11:48:41.861537 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:41.861519 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:48:41.874828 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:41.874792 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" podStartSLOduration=10.110839441 podStartE2EDuration="27.874781377s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:48:17.279058639 +0000 UTC m=+3.156056843" lastFinishedPulling="2026-05-26 11:48:35.043000571 +0000 UTC m=+20.919998779" observedRunningTime="2026-05-26 11:48:41.873203151 +0000 UTC m=+27.750201403" watchObservedRunningTime="2026-05-26 11:48:41.874781377 +0000 UTC m=+27.751779588" May 26 11:48:42.164073 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:42.164015 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bhm75"] May 26 11:48:42.164197 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:42.164122 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:42.164236 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:42.164203 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:42.166719 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:42.166694 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqqpm"] May 26 11:48:42.166823 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:42.166786 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:42.166877 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:42.166857 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:42.174530 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:42.174507 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmk8t"] May 26 11:48:42.174622 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:42.174582 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:42.174708 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:42.174688 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:42.851994 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:42.851783 2572 generic.go:358] "Generic (PLEG): container finished" podID="25a9ab16-21f2-46e0-b3a0-1014db031ffd" containerID="f86d02fdfc03dddf17858e633d4896d31f0d4acf508b0a68d2d3a2df6c176705" exitCode=0 May 26 11:48:42.852285 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:42.851865 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xrclr" event={"ID":"25a9ab16-21f2-46e0-b3a0-1014db031ffd","Type":"ContainerDied","Data":"f86d02fdfc03dddf17858e633d4896d31f0d4acf508b0a68d2d3a2df6c176705"} May 26 11:48:43.693051 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:43.693022 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:43.693269 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:43.693132 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:43.693269 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:43.693250 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:43.693397 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:43.693136 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:43.693397 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:43.693132 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:43.693397 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:43.693353 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:45.692911 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:45.692877 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:45.693538 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:45.692877 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:45.693538 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:45.692993 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:45.693538 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:45.692877 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:45.693538 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:45.693076 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:45.693538 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:45.693148 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:47.693047 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:47.693014 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:47.693676 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:47.693014 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:47.693676 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:47.693128 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqqpm" podUID="3827d450-0d1d-4619-8cc9-8a3c6bc59bb7" May 26 11:48:47.693676 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:47.693014 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:47.693676 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:47.693210 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmk8t" podUID="b6086d7b-3f08-4547-a3b0-8c9f406a71fb" May 26 11:48:47.693676 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:47.693267 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhm75" podUID="5f4ce227-15d5-4f1f-991d-be70314d08d9" May 26 11:48:48.475264 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.475236 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:48.475432 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.475272 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:48.475432 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:48.475356 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:48.475432 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:48.475373 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:48:48.475432 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:48.475390 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:48:48.475432 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:48.475400 2572 projected.go:194] Error preparing data for projected volume kube-api-access-4lpxz for pod openshift-network-diagnostics/network-check-target-bhm75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:48.475432 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:48.475402 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs podName:3827d450-0d1d-4619-8cc9-8a3c6bc59bb7 nodeName:}" failed. No retries permitted until 2026-05-26 11:49:20.475387956 +0000 UTC m=+66.352386146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs") pod "network-metrics-daemon-jqqpm" (UID: "3827d450-0d1d-4619-8cc9-8a3c6bc59bb7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:48:48.475663 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:48.475460 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz podName:5f4ce227-15d5-4f1f-991d-be70314d08d9 nodeName:}" failed. No retries permitted until 2026-05-26 11:49:20.475449428 +0000 UTC m=+66.352447617 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lpxz" (UniqueName: "kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz") pod "network-check-target-bhm75" (UID: "5f4ce227-15d5-4f1f-991d-be70314d08d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:48:48.895963 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.895943 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeReady" May 26 11:48:48.896380 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.896057 2572 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 11:48:48.955344 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.955312 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nn9d2"] May 26 11:48:48.974519 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.974487 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fxhbl"] May 26 11:48:48.974685 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.974664 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nn9d2" May 26 11:48:48.977798 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.977566 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 11:48:48.977798 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.977648 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f88zv\"" May 26 11:48:48.977798 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.977694 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 11:48:48.998354 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.998298 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxhbl"] May 26 11:48:48.998354 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.998330 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nn9d2"] May 26 11:48:48.998533 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:48.998384 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:49.001231 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.001203 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 11:48:49.001327 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.001266 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 11:48:49.001414 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.001396 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mcktv\"" May 26 11:48:49.001493 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.001427 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 11:48:49.078960 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.078935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.079046 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.078981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13ee2e51-8fcc-4333-88c2-d7aa45761280-config-volume\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.079046 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.079007 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzp25\" (UniqueName: \"kubernetes.io/projected/13ee2e51-8fcc-4333-88c2-d7aa45761280-kube-api-access-kzp25\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.079046 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.079037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13ee2e51-8fcc-4333-88c2-d7aa45761280-tmp-dir\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.180171 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.180145 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13ee2e51-8fcc-4333-88c2-d7aa45761280-config-volume\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.180334 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.180177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dk78\" (UniqueName: \"kubernetes.io/projected/b1884da9-5484-4448-aaab-e96f107c7740-kube-api-access-4dk78\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:49.180334 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.180201 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzp25\" (UniqueName: \"kubernetes.io/projected/13ee2e51-8fcc-4333-88c2-d7aa45761280-kube-api-access-kzp25\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.180334 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.180233 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13ee2e51-8fcc-4333-88c2-d7aa45761280-tmp-dir\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.180334 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.180266 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.180334 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.180290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:49.180536 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:49.180393 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:48:49.180536 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:49.180475 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls podName:13ee2e51-8fcc-4333-88c2-d7aa45761280 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:49.680434049 +0000 UTC m=+35.557432239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls") pod "dns-default-nn9d2" (UID: "13ee2e51-8fcc-4333-88c2-d7aa45761280") : secret "dns-default-metrics-tls" not found May 26 11:48:49.180612 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.180544 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13ee2e51-8fcc-4333-88c2-d7aa45761280-tmp-dir\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.180727 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.180711 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13ee2e51-8fcc-4333-88c2-d7aa45761280-config-volume\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.194316 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.194293 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzp25\" (UniqueName: \"kubernetes.io/projected/13ee2e51-8fcc-4333-88c2-d7aa45761280-kube-api-access-kzp25\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.281319 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.281265 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:49.281390 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.281320 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dk78\" (UniqueName: \"kubernetes.io/projected/b1884da9-5484-4448-aaab-e96f107c7740-kube-api-access-4dk78\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:49.281458 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:49.281390 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:48:49.281504 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:49.281478 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert podName:b1884da9-5484-4448-aaab-e96f107c7740 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:49.781462372 +0000 UTC m=+35.658460562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert") pod "ingress-canary-fxhbl" (UID: "b1884da9-5484-4448-aaab-e96f107c7740") : secret "canary-serving-cert" not found May 26 11:48:49.290567 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.290429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dk78\" (UniqueName: \"kubernetes.io/projected/b1884da9-5484-4448-aaab-e96f107c7740-kube-api-access-4dk78\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:49.684567 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.684548 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:49.684689 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:49.684673 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:48:49.684730 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:49.684722 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls podName:13ee2e51-8fcc-4333-88c2-d7aa45761280 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:50.684710154 +0000 UTC m=+36.561708349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls") pod "dns-default-nn9d2" (UID: "13ee2e51-8fcc-4333-88c2-d7aa45761280") : secret "dns-default-metrics-tls" not found May 26 11:48:49.693167 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.693145 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:49.693245 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.693147 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:48:49.693398 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.693147 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:48:49.697350 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.697334 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 11:48:49.697637 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.697336 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 11:48:49.697637 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.697357 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-52jct\"" May 26 11:48:49.697637 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.697638 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 11:48:49.697786 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.697646 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcq5d\"" May 26 11:48:49.697786 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.697672 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 11:48:49.785662 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.785641 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:49.785743 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:49.785730 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:48:49.785782 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:49.785767 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert podName:b1884da9-5484-4448-aaab-e96f107c7740 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:50.785756587 +0000 UTC m=+36.662754776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert") pod "ingress-canary-fxhbl" (UID: "b1884da9-5484-4448-aaab-e96f107c7740") : secret "canary-serving-cert" not found May 26 11:48:49.870613 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.870592 2572 generic.go:358] "Generic (PLEG): container finished" podID="25a9ab16-21f2-46e0-b3a0-1014db031ffd" containerID="f9c7ebd5b035cfaf21695b1146c80c4a2674a7038035eecf1613e385029df2bc" exitCode=0 May 26 11:48:49.870698 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:49.870633 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xrclr" event={"ID":"25a9ab16-21f2-46e0-b3a0-1014db031ffd","Type":"ContainerDied","Data":"f9c7ebd5b035cfaf21695b1146c80c4a2674a7038035eecf1613e385029df2bc"} May 26 11:48:50.693136 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:50.693103 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:50.693495 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:50.693265 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:48:50.693495 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:50.693351 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls podName:13ee2e51-8fcc-4333-88c2-d7aa45761280 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:52.693330976 +0000 UTC m=+38.570329177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls") pod "dns-default-nn9d2" (UID: "13ee2e51-8fcc-4333-88c2-d7aa45761280") : secret "dns-default-metrics-tls" not found May 26 11:48:50.793581 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:50.793554 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:50.793711 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:50.793659 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:48:50.793751 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:50.793717 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert podName:b1884da9-5484-4448-aaab-e96f107c7740 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:52.793702496 +0000 UTC m=+38.670700686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert") pod "ingress-canary-fxhbl" (UID: "b1884da9-5484-4448-aaab-e96f107c7740") : secret "canary-serving-cert" not found May 26 11:48:50.874970 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:50.874946 2572 generic.go:358] "Generic (PLEG): container finished" podID="25a9ab16-21f2-46e0-b3a0-1014db031ffd" containerID="06b9930625e37c0097d8b188c4274c7629313b171f58db7cd43c13529176820b" exitCode=0 May 26 11:48:50.875085 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:50.874990 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xrclr" event={"ID":"25a9ab16-21f2-46e0-b3a0-1014db031ffd","Type":"ContainerDied","Data":"06b9930625e37c0097d8b188c4274c7629313b171f58db7cd43c13529176820b"} May 26 11:48:51.879129 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:51.879064 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xrclr" event={"ID":"25a9ab16-21f2-46e0-b3a0-1014db031ffd","Type":"ContainerStarted","Data":"71854ce344b7a2e5721446becbaab03141c6b144eef5bbfc57508aaaec3543e1"} May 26 11:48:51.903860 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:51.903817 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xrclr" podStartSLOduration=6.443945779 podStartE2EDuration="37.903803583s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:48:17.287031757 +0000 UTC m=+3.164029947" lastFinishedPulling="2026-05-26 11:48:48.746889548 +0000 UTC m=+34.623887751" observedRunningTime="2026-05-26 11:48:51.902154992 +0000 UTC m=+37.779153204" watchObservedRunningTime="2026-05-26 11:48:51.903803583 +0000 UTC m=+37.780801795" May 26 11:48:52.706991 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:52.706959 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:52.707139 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:52.707091 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:48:52.707195 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:52.707147 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls podName:13ee2e51-8fcc-4333-88c2-d7aa45761280 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:56.707132409 +0000 UTC m=+42.584130599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls") pod "dns-default-nn9d2" (UID: "13ee2e51-8fcc-4333-88c2-d7aa45761280") : secret "dns-default-metrics-tls" not found May 26 11:48:52.808223 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:52.808196 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:52.808355 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:52.808305 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:48:52.808419 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:52.808362 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert podName:b1884da9-5484-4448-aaab-e96f107c7740 nodeName:}" failed. No retries permitted until 2026-05-26 11:48:56.80834475 +0000 UTC m=+42.685342947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert") pod "ingress-canary-fxhbl" (UID: "b1884da9-5484-4448-aaab-e96f107c7740") : secret "canary-serving-cert" not found May 26 11:48:54.115853 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:54.115822 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:54.118960 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:54.118941 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6086d7b-3f08-4547-a3b0-8c9f406a71fb-original-pull-secret\") pod \"global-pull-secret-syncer-kmk8t\" (UID: \"b6086d7b-3f08-4547-a3b0-8c9f406a71fb\") " pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:54.201999 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:54.201973 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmk8t" May 26 11:48:54.337979 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:54.337951 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmk8t"] May 26 11:48:54.341037 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:48:54.341009 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6086d7b_3f08_4547_a3b0_8c9f406a71fb.slice/crio-7adbba783c2fc14aa2c60a2625b0cdc6fb1f6f61a9e092784d1d3b552f76380b WatchSource:0}: Error finding container 7adbba783c2fc14aa2c60a2625b0cdc6fb1f6f61a9e092784d1d3b552f76380b: Status 404 returned error can't find the container with id 7adbba783c2fc14aa2c60a2625b0cdc6fb1f6f61a9e092784d1d3b552f76380b May 26 11:48:54.885087 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:54.885058 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmk8t" event={"ID":"b6086d7b-3f08-4547-a3b0-8c9f406a71fb","Type":"ContainerStarted","Data":"7adbba783c2fc14aa2c60a2625b0cdc6fb1f6f61a9e092784d1d3b552f76380b"} May 26 11:48:56.735252 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:56.735212 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:48:56.735729 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:56.735342 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:48:56.735729 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:56.735397 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls podName:13ee2e51-8fcc-4333-88c2-d7aa45761280 nodeName:}" failed. No retries permitted until 2026-05-26 11:49:04.735382227 +0000 UTC m=+50.612380416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls") pod "dns-default-nn9d2" (UID: "13ee2e51-8fcc-4333-88c2-d7aa45761280") : secret "dns-default-metrics-tls" not found May 26 11:48:56.836204 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:56.836172 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:48:56.836369 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:56.836349 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:48:56.836451 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:48:56.836424 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert podName:b1884da9-5484-4448-aaab-e96f107c7740 nodeName:}" failed. No retries permitted until 2026-05-26 11:49:04.836402595 +0000 UTC m=+50.713400794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert") pod "ingress-canary-fxhbl" (UID: "b1884da9-5484-4448-aaab-e96f107c7740") : secret "canary-serving-cert" not found May 26 11:48:58.893955 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:48:58.893920 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmk8t" event={"ID":"b6086d7b-3f08-4547-a3b0-8c9f406a71fb","Type":"ContainerStarted","Data":"87ecac3ab55bb81a67391fdf747c0d75e7ebcc6fcdc1fb1eea6657d92296f491"} May 26 11:49:04.793605 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:04.793572 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:49:04.794012 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:04.793674 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:49:04.794012 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:04.793728 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls podName:13ee2e51-8fcc-4333-88c2-d7aa45761280 nodeName:}" failed. No retries permitted until 2026-05-26 11:49:20.793714497 +0000 UTC m=+66.670712687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls") pod "dns-default-nn9d2" (UID: "13ee2e51-8fcc-4333-88c2-d7aa45761280") : secret "dns-default-metrics-tls" not found May 26 11:49:04.894280 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:04.894257 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:49:04.894385 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:04.894366 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:49:04.894452 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:04.894429 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert podName:b1884da9-5484-4448-aaab-e96f107c7740 nodeName:}" failed. No retries permitted until 2026-05-26 11:49:20.894411362 +0000 UTC m=+66.771409553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert") pod "ingress-canary-fxhbl" (UID: "b1884da9-5484-4448-aaab-e96f107c7740") : secret "canary-serving-cert" not found May 26 11:49:13.863639 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:13.863605 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj85s" May 26 11:49:13.894851 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:13.894769 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kmk8t" podStartSLOduration=48.39351274 podStartE2EDuration="51.894752033s" podCreationTimestamp="2026-05-26 11:48:22 +0000 UTC" firstStartedPulling="2026-05-26 11:48:54.343092625 +0000 UTC m=+40.220090816" lastFinishedPulling="2026-05-26 11:48:57.844331919 +0000 UTC m=+43.721330109" observedRunningTime="2026-05-26 11:48:58.909319338 +0000 UTC m=+44.786317550" watchObservedRunningTime="2026-05-26 11:49:13.894752033 +0000 UTC m=+59.771750247" May 26 11:49:20.496045 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.496008 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:49:20.496045 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.496051 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:49:20.499077 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.499061 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 11:49:20.499130 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.499066 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 11:49:20.506663 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:20.506648 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 11:49:20.506718 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:20.506708 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs podName:3827d450-0d1d-4619-8cc9-8a3c6bc59bb7 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:24.506694922 +0000 UTC m=+130.383693111 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs") pod "network-metrics-daemon-jqqpm" (UID: "3827d450-0d1d-4619-8cc9-8a3c6bc59bb7") : secret "metrics-daemon-secret" not found May 26 11:49:20.509044 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.509029 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 11:49:20.519678 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.519655 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lpxz\" (UniqueName: \"kubernetes.io/projected/5f4ce227-15d5-4f1f-991d-be70314d08d9-kube-api-access-4lpxz\") pod \"network-check-target-bhm75\" (UID: \"5f4ce227-15d5-4f1f-991d-be70314d08d9\") " pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:49:20.614629 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.614605 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcq5d\"" May 26 11:49:20.622708 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.622693 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:49:20.758505 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.758425 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bhm75"] May 26 11:49:20.761177 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:49:20.761153 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4ce227_15d5_4f1f_991d_be70314d08d9.slice/crio-cb8acb9fdc00ef982b8d8a96a330702ae34da14537ea23961579cd0dd8fb82d1 WatchSource:0}: Error finding container cb8acb9fdc00ef982b8d8a96a330702ae34da14537ea23961579cd0dd8fb82d1: Status 404 returned error can't find the container with id cb8acb9fdc00ef982b8d8a96a330702ae34da14537ea23961579cd0dd8fb82d1 May 26 11:49:20.799619 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.799588 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:49:20.799753 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:20.799734 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:49:20.799814 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:20.799804 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls podName:13ee2e51-8fcc-4333-88c2-d7aa45761280 nodeName:}" failed. No retries permitted until 2026-05-26 11:49:52.799788971 +0000 UTC m=+98.676787161 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls") pod "dns-default-nn9d2" (UID: "13ee2e51-8fcc-4333-88c2-d7aa45761280") : secret "dns-default-metrics-tls" not found May 26 11:49:20.900068 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.900040 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:49:20.900203 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:20.900184 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:49:20.900253 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:20.900242 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert podName:b1884da9-5484-4448-aaab-e96f107c7740 nodeName:}" failed. No retries permitted until 2026-05-26 11:49:52.900227459 +0000 UTC m=+98.777225649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert") pod "ingress-canary-fxhbl" (UID: "b1884da9-5484-4448-aaab-e96f107c7740") : secret "canary-serving-cert" not found May 26 11:49:20.929352 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:20.929326 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bhm75" event={"ID":"5f4ce227-15d5-4f1f-991d-be70314d08d9","Type":"ContainerStarted","Data":"cb8acb9fdc00ef982b8d8a96a330702ae34da14537ea23961579cd0dd8fb82d1"} May 26 11:49:23.935886 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:23.935855 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bhm75" event={"ID":"5f4ce227-15d5-4f1f-991d-be70314d08d9","Type":"ContainerStarted","Data":"f0636e3e7430c0c053814904b31223189614cce12be5ca554e8f6a59a5fe4d54"} May 26 11:49:23.936175 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:23.936001 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:49:23.955198 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:23.955152 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bhm75" podStartSLOduration=67.352584125 podStartE2EDuration="1m9.955141353s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:49:20.763006528 +0000 UTC m=+66.640004719" lastFinishedPulling="2026-05-26 11:49:23.36556375 +0000 UTC m=+69.242561947" observedRunningTime="2026-05-26 11:49:23.9543178 +0000 UTC m=+69.831316012" watchObservedRunningTime="2026-05-26 11:49:23.955141353 +0000 UTC m=+69.832139564" May 26 11:49:52.803130 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:52.803096 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:49:52.803541 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:52.803224 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:49:52.803541 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:52.803292 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls podName:13ee2e51-8fcc-4333-88c2-d7aa45761280 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:56.803277775 +0000 UTC m=+162.680275965 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls") pod "dns-default-nn9d2" (UID: "13ee2e51-8fcc-4333-88c2-d7aa45761280") : secret "dns-default-metrics-tls" not found May 26 11:49:52.903654 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:52.903630 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:49:52.903771 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:52.903714 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:49:52.903771 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:52.903764 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert podName:b1884da9-5484-4448-aaab-e96f107c7740 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:56.903751588 +0000 UTC m=+162.780749779 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert") pod "ingress-canary-fxhbl" (UID: "b1884da9-5484-4448-aaab-e96f107c7740") : secret "canary-serving-cert" not found May 26 11:49:54.939878 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:54.939853 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bhm75" May 26 11:49:59.718656 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.718627 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k"] May 26 11:49:59.721310 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.721292 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k" May 26 11:49:59.724369 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.724345 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 26 11:49:59.724523 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.724384 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 26 11:49:59.725653 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.725631 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tllj8\"" May 26 11:49:59.726292 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.726273 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-766db55d5b-k6rg6"] May 26 11:49:59.728176 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.728161 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.731463 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.731283 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 26 11:49:59.733891 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.731659 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8m9xf\"" May 26 11:49:59.733891 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.732049 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 26 11:49:59.733891 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.732486 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 26 11:49:59.733891 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.732708 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 26 11:49:59.733891 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.732739 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 26 11:49:59.733891 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.733220 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 26 11:49:59.734206 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.734190 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k"] May 26 11:49:59.739094 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.739075 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-766db55d5b-k6rg6"] May 26 11:49:59.834281 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.834256 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-v4hsc"] May 26 11:49:59.836109 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.836094 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:49:59.840628 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.840608 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-npvh7\"" May 26 11:49:59.840753 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.840735 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 26 11:49:59.840831 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.840751 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 11:49:59.840893 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.840831 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 26 11:49:59.840893 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.840859 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 11:49:59.845745 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.845719 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-stats-auth\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.845823 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.845780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-default-certificate\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.845862 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.845834 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.845912 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.845860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.845912 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.845876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lrxz\" (UniqueName: \"kubernetes.io/projected/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-kube-api-access-7lrxz\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.845912 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.845896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbjlt\" (UniqueName: \"kubernetes.io/projected/10a4c29d-df61-496d-8ef4-56307b4eb2ca-kube-api-access-nbjlt\") pod \"volume-data-source-validator-5cf8c89d64-bss7k\" (UID: \"10a4c29d-df61-496d-8ef4-56307b4eb2ca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k" May 26 11:49:59.846275 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.846260 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 26 11:49:59.849185 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.849167 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-v4hsc"] May 26 11:49:59.926687 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.926667 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-7r7rk"] May 26 11:49:59.928544 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.928531 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:49:59.931067 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.931043 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 26 11:49:59.931279 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.931264 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 26 11:49:59.931363 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.931288 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 26 11:49:59.931412 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.931379 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 26 11:49:59.931594 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.931580 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kmds9\"" May 26 11:49:59.937306 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.937290 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 26 11:49:59.940692 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.940673 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-7r7rk"] May 26 11:49:59.947114 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947094 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/642ea59b-2b49-4db7-a9be-56e807229e4b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:49:59.947192 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947123 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/642ea59b-2b49-4db7-a9be-56e807229e4b-serving-cert\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:49:59.947192 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947146 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.947259 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947208 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.947259 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947233 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lrxz\" (UniqueName: \"kubernetes.io/projected/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-kube-api-access-7lrxz\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.947324 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:59.947263 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:00.447246866 +0000 UTC m=+106.324245079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : configmap references non-existent config key: service-ca.crt May 26 11:49:59.947324 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqsds\" (UniqueName: \"kubernetes.io/projected/642ea59b-2b49-4db7-a9be-56e807229e4b-kube-api-access-vqsds\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:49:59.947324 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947315 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbjlt\" (UniqueName: \"kubernetes.io/projected/10a4c29d-df61-496d-8ef4-56307b4eb2ca-kube-api-access-nbjlt\") pod \"volume-data-source-validator-5cf8c89d64-bss7k\" (UID: \"10a4c29d-df61-496d-8ef4-56307b4eb2ca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k" May 26 11:49:59.947431 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947348 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-stats-auth\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.947431 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:59.947374 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:49:59.947431 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947383 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-default-certificate\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.947431 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947409 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/642ea59b-2b49-4db7-a9be-56e807229e4b-tmp\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:49:59.947573 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:49:59.947431 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:00.447404338 +0000 UTC m=+106.324402530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : secret "router-metrics-certs-default" not found May 26 11:49:59.947573 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/642ea59b-2b49-4db7-a9be-56e807229e4b-snapshots\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:49:59.947573 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.947553 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/642ea59b-2b49-4db7-a9be-56e807229e4b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:49:59.949761 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.949736 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-stats-auth\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.949844 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.949794 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-default-certificate\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:49:59.958323 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.958299 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbjlt\" (UniqueName: \"kubernetes.io/projected/10a4c29d-df61-496d-8ef4-56307b4eb2ca-kube-api-access-nbjlt\") pod \"volume-data-source-validator-5cf8c89d64-bss7k\" (UID: \"10a4c29d-df61-496d-8ef4-56307b4eb2ca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k" May 26 11:49:59.958970 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:49:59.958955 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lrxz\" (UniqueName: \"kubernetes.io/projected/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-kube-api-access-7lrxz\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:00.030521 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.030475 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k" May 26 11:50:00.048255 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048232 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/642ea59b-2b49-4db7-a9be-56e807229e4b-snapshots\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.048352 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-config\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.048352 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hnk\" (UniqueName: \"kubernetes.io/projected/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-kube-api-access-49hnk\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.048352 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048312 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/642ea59b-2b49-4db7-a9be-56e807229e4b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.048525 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048433 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/642ea59b-2b49-4db7-a9be-56e807229e4b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.048525 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048487 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/642ea59b-2b49-4db7-a9be-56e807229e4b-serving-cert\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.048613 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-serving-cert\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.048613 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048586 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsds\" (UniqueName: \"kubernetes.io/projected/642ea59b-2b49-4db7-a9be-56e807229e4b-kube-api-access-vqsds\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.048712 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-trusted-ca\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.048760 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048731 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/642ea59b-2b49-4db7-a9be-56e807229e4b-tmp\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.048985 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048950 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/642ea59b-2b49-4db7-a9be-56e807229e4b-snapshots\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.049071 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.048983 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/642ea59b-2b49-4db7-a9be-56e807229e4b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.049155 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.049134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/642ea59b-2b49-4db7-a9be-56e807229e4b-tmp\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.049195 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.049175 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/642ea59b-2b49-4db7-a9be-56e807229e4b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.050593 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.050571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/642ea59b-2b49-4db7-a9be-56e807229e4b-serving-cert\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.057429 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.057407 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqsds\" (UniqueName: \"kubernetes.io/projected/642ea59b-2b49-4db7-a9be-56e807229e4b-kube-api-access-vqsds\") pod \"insights-operator-78bdfb888c-v4hsc\" (UID: \"642ea59b-2b49-4db7-a9be-56e807229e4b\") " pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.144736 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.144709 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" May 26 11:50:00.146319 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.146294 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k"] May 26 11:50:00.149077 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.149060 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-serving-cert\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.149183 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.149105 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-trusted-ca\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.149260 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.149244 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-config\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.149519 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.149423 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49hnk\" (UniqueName: \"kubernetes.io/projected/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-kube-api-access-49hnk\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.149939 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.149920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-config\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.150007 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:00.149921 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a4c29d_df61_496d_8ef4_56307b4eb2ca.slice/crio-0ee00b4e0343be3cef5558738fb4de02a2b7e46570d4e9e223f4f7df53d14acd WatchSource:0}: Error finding container 0ee00b4e0343be3cef5558738fb4de02a2b7e46570d4e9e223f4f7df53d14acd: Status 404 returned error can't find the container with id 0ee00b4e0343be3cef5558738fb4de02a2b7e46570d4e9e223f4f7df53d14acd May 26 11:50:00.150717 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.150691 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-trusted-ca\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.151734 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.151712 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-serving-cert\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.157600 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.157572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hnk\" (UniqueName: \"kubernetes.io/projected/0681cbe3-f564-4ce6-bbd3-0da4a12e0f00-kube-api-access-49hnk\") pod \"console-operator-76dff48d59-7r7rk\" (UID: \"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00\") " pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.236781 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.236743 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:00.262782 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.262755 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-v4hsc"] May 26 11:50:00.265194 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:00.265170 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642ea59b_2b49_4db7_a9be_56e807229e4b.slice/crio-254cee0f8592508c8adab9feb0aa7b8c7a62bc495ef48f796eb340f0a911fb18 WatchSource:0}: Error finding container 254cee0f8592508c8adab9feb0aa7b8c7a62bc495ef48f796eb340f0a911fb18: Status 404 returned error can't find the container with id 254cee0f8592508c8adab9feb0aa7b8c7a62bc495ef48f796eb340f0a911fb18 May 26 11:50:00.355575 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.355548 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-7r7rk"] May 26 11:50:00.358427 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:00.358394 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0681cbe3_f564_4ce6_bbd3_0da4a12e0f00.slice/crio-e96d4e727d95411a2ef6a69e1eca3002fcffc3dd56ae9a78986cc7b1656539f6 WatchSource:0}: Error finding container e96d4e727d95411a2ef6a69e1eca3002fcffc3dd56ae9a78986cc7b1656539f6: Status 404 returned error can't find the container with id e96d4e727d95411a2ef6a69e1eca3002fcffc3dd56ae9a78986cc7b1656539f6 May 26 11:50:00.452271 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.452244 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:00.452365 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:00.452287 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:00.452412 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:00.452406 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:50:00.452466 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:00.452413 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:01.452391805 +0000 UTC m=+107.329389997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : configmap references non-existent config key: service-ca.crt May 26 11:50:00.452513 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:00.452468 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:01.452456647 +0000 UTC m=+107.329454837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : secret "router-metrics-certs-default" not found May 26 11:50:01.001407 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:01.001359 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k" event={"ID":"10a4c29d-df61-496d-8ef4-56307b4eb2ca","Type":"ContainerStarted","Data":"0ee00b4e0343be3cef5558738fb4de02a2b7e46570d4e9e223f4f7df53d14acd"} May 26 11:50:01.002622 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:01.002592 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" event={"ID":"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00","Type":"ContainerStarted","Data":"e96d4e727d95411a2ef6a69e1eca3002fcffc3dd56ae9a78986cc7b1656539f6"} May 26 11:50:01.003728 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:01.003704 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" event={"ID":"642ea59b-2b49-4db7-a9be-56e807229e4b","Type":"ContainerStarted","Data":"254cee0f8592508c8adab9feb0aa7b8c7a62bc495ef48f796eb340f0a911fb18"} May 26 11:50:01.461075 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:01.461037 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:01.461252 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:01.461168 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:01.461252 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:01.461213 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:50:01.461372 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:01.461292 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:03.461270341 +0000 UTC m=+109.338268562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : secret "router-metrics-certs-default" not found May 26 11:50:01.461372 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:01.461312 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:03.461303277 +0000 UTC m=+109.338301473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : configmap references non-existent config key: service-ca.crt May 26 11:50:02.007003 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:02.006966 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k" event={"ID":"10a4c29d-df61-496d-8ef4-56307b4eb2ca","Type":"ContainerStarted","Data":"da3abc3b7e88a426cc25b12a31742e33241b66b2dcbabf3831959c4af0ea319b"} May 26 11:50:02.022125 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:02.022075 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bss7k" podStartSLOduration=1.5541293760000001 podStartE2EDuration="3.022061553s" podCreationTimestamp="2026-05-26 11:49:59 +0000 UTC" firstStartedPulling="2026-05-26 11:50:00.151687896 +0000 UTC m=+106.028686086" lastFinishedPulling="2026-05-26 11:50:01.619620071 +0000 UTC m=+107.496618263" observedRunningTime="2026-05-26 11:50:02.021944369 +0000 UTC m=+107.898942581" watchObservedRunningTime="2026-05-26 11:50:02.022061553 +0000 UTC m=+107.899059746" May 26 11:50:03.010420 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:03.010342 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" event={"ID":"642ea59b-2b49-4db7-a9be-56e807229e4b","Type":"ContainerStarted","Data":"7929acf75165510624e8e747dd4ce80076e11efa14cd62888bff6d814f0208e8"} May 26 11:50:03.011807 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:03.011787 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/0.log" May 26 11:50:03.011893 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:03.011826 2572 generic.go:358] "Generic (PLEG): container finished" podID="0681cbe3-f564-4ce6-bbd3-0da4a12e0f00" containerID="5ad3d0999832fac5f4f07a62d5c8100b25140402bc0a604d24c9f178eaff1fcd" exitCode=255 May 26 11:50:03.011893 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:03.011848 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" event={"ID":"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00","Type":"ContainerDied","Data":"5ad3d0999832fac5f4f07a62d5c8100b25140402bc0a604d24c9f178eaff1fcd"} May 26 11:50:03.012036 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:03.012023 2572 scope.go:117] "RemoveContainer" containerID="5ad3d0999832fac5f4f07a62d5c8100b25140402bc0a604d24c9f178eaff1fcd" May 26 11:50:03.028558 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:03.028516 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" podStartSLOduration=1.604442863 podStartE2EDuration="4.028499318s" podCreationTimestamp="2026-05-26 11:49:59 +0000 UTC" firstStartedPulling="2026-05-26 11:50:00.267019562 +0000 UTC m=+106.144017751" lastFinishedPulling="2026-05-26 11:50:02.691076001 +0000 UTC m=+108.568074206" observedRunningTime="2026-05-26 11:50:03.027359841 +0000 UTC m=+108.904358053" watchObservedRunningTime="2026-05-26 11:50:03.028499318 +0000 UTC m=+108.905497531" May 26 11:50:03.478433 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:03.478402 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:03.478573 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:03.478459 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:03.478573 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:03.478564 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:50:03.478640 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:03.478622 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:07.478597412 +0000 UTC m=+113.355595607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : configmap references non-existent config key: service-ca.crt May 26 11:50:03.478680 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:03.478651 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:07.478639625 +0000 UTC m=+113.355637817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : secret "router-metrics-certs-default" not found May 26 11:50:04.015579 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.015553 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/1.log" May 26 11:50:04.015926 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.015911 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/0.log" May 26 11:50:04.015978 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.015948 2572 generic.go:358] "Generic (PLEG): container finished" podID="0681cbe3-f564-4ce6-bbd3-0da4a12e0f00" containerID="e061a23e522d979169927c5debb2047ccf60ea4d6a69ab252b06e24f39274815" exitCode=255 May 26 11:50:04.016071 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.016050 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" event={"ID":"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00","Type":"ContainerDied","Data":"e061a23e522d979169927c5debb2047ccf60ea4d6a69ab252b06e24f39274815"} May 26 11:50:04.016131 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.016100 2572 scope.go:117] "RemoveContainer" containerID="5ad3d0999832fac5f4f07a62d5c8100b25140402bc0a604d24c9f178eaff1fcd" May 26 11:50:04.016296 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.016274 2572 scope.go:117] "RemoveContainer" containerID="e061a23e522d979169927c5debb2047ccf60ea4d6a69ab252b06e24f39274815" May 26 11:50:04.016538 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:04.016517 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-7r7rk_openshift-console-operator(0681cbe3-f564-4ce6-bbd3-0da4a12e0f00)\"" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" podUID="0681cbe3-f564-4ce6-bbd3-0da4a12e0f00" May 26 11:50:04.714628 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.714596 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg"] May 26 11:50:04.718554 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.718539 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg" May 26 11:50:04.721390 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.721369 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 26 11:50:04.722677 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.722659 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 26 11:50:04.722677 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.722666 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6phjx\"" May 26 11:50:04.730320 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.730301 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg"] May 26 11:50:04.789076 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.789056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l5hf\" (UniqueName: \"kubernetes.io/projected/244c432c-21b2-4768-9e04-51f8357d58a4-kube-api-access-8l5hf\") pod \"migrator-b985f5d89-dgjbg\" (UID: \"244c432c-21b2-4768-9e04-51f8357d58a4\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg" May 26 11:50:04.890252 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.890223 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8l5hf\" (UniqueName: \"kubernetes.io/projected/244c432c-21b2-4768-9e04-51f8357d58a4-kube-api-access-8l5hf\") pod \"migrator-b985f5d89-dgjbg\" (UID: \"244c432c-21b2-4768-9e04-51f8357d58a4\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg" May 26 11:50:04.899993 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:04.899975 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l5hf\" (UniqueName: \"kubernetes.io/projected/244c432c-21b2-4768-9e04-51f8357d58a4-kube-api-access-8l5hf\") pod \"migrator-b985f5d89-dgjbg\" (UID: \"244c432c-21b2-4768-9e04-51f8357d58a4\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg" May 26 11:50:05.019168 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:05.019121 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/1.log" May 26 11:50:05.019456 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:05.019395 2572 scope.go:117] "RemoveContainer" containerID="e061a23e522d979169927c5debb2047ccf60ea4d6a69ab252b06e24f39274815" May 26 11:50:05.019613 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:05.019598 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-7r7rk_openshift-console-operator(0681cbe3-f564-4ce6-bbd3-0da4a12e0f00)\"" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" podUID="0681cbe3-f564-4ce6-bbd3-0da4a12e0f00" May 26 11:50:05.027210 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:05.027195 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg" May 26 11:50:05.146053 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:05.146024 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg"] May 26 11:50:05.149743 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:05.149720 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244c432c_21b2_4768_9e04_51f8357d58a4.slice/crio-ac01d70bcb5e871ef9550767bc4d042ea44a17c80eb4e843ae0cfc25ef00ed12 WatchSource:0}: Error finding container ac01d70bcb5e871ef9550767bc4d042ea44a17c80eb4e843ae0cfc25ef00ed12: Status 404 returned error can't find the container with id ac01d70bcb5e871ef9550767bc4d042ea44a17c80eb4e843ae0cfc25ef00ed12 May 26 11:50:06.023553 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.023509 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg" event={"ID":"244c432c-21b2-4768-9e04-51f8357d58a4","Type":"ContainerStarted","Data":"ac01d70bcb5e871ef9550767bc4d042ea44a17c80eb4e843ae0cfc25ef00ed12"} May 26 11:50:06.113760 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.113730 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-pp5wd"] May 26 11:50:06.116974 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.116954 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.120060 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.120030 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 26 11:50:06.120060 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.120030 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 26 11:50:06.121385 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.121363 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 26 11:50:06.121496 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.121402 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kbmtn\"" May 26 11:50:06.121496 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.121464 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 26 11:50:06.125318 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.125132 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-pp5wd"] May 26 11:50:06.142918 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.142899 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-njbrp_5baf7ffa-54d0-4039-8f49-0f965fb6e6b5/dns-node-resolver/0.log" May 26 11:50:06.199393 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.199367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ac81be3d-4e6d-4579-a42f-857b746ffd70-signing-cabundle\") pod \"service-ca-67d667c7d-pp5wd\" (UID: \"ac81be3d-4e6d-4579-a42f-857b746ffd70\") " pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.199510 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.199418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ac81be3d-4e6d-4579-a42f-857b746ffd70-signing-key\") pod \"service-ca-67d667c7d-pp5wd\" (UID: \"ac81be3d-4e6d-4579-a42f-857b746ffd70\") " pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.199510 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.199463 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brx7h\" (UniqueName: \"kubernetes.io/projected/ac81be3d-4e6d-4579-a42f-857b746ffd70-kube-api-access-brx7h\") pod \"service-ca-67d667c7d-pp5wd\" (UID: \"ac81be3d-4e6d-4579-a42f-857b746ffd70\") " pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.300224 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.300202 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ac81be3d-4e6d-4579-a42f-857b746ffd70-signing-key\") pod \"service-ca-67d667c7d-pp5wd\" (UID: \"ac81be3d-4e6d-4579-a42f-857b746ffd70\") " pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.300309 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.300237 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brx7h\" (UniqueName: \"kubernetes.io/projected/ac81be3d-4e6d-4579-a42f-857b746ffd70-kube-api-access-brx7h\") pod \"service-ca-67d667c7d-pp5wd\" (UID: \"ac81be3d-4e6d-4579-a42f-857b746ffd70\") " pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.300309 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.300293 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ac81be3d-4e6d-4579-a42f-857b746ffd70-signing-cabundle\") pod \"service-ca-67d667c7d-pp5wd\" (UID: \"ac81be3d-4e6d-4579-a42f-857b746ffd70\") " pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.300894 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.300873 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ac81be3d-4e6d-4579-a42f-857b746ffd70-signing-cabundle\") pod \"service-ca-67d667c7d-pp5wd\" (UID: \"ac81be3d-4e6d-4579-a42f-857b746ffd70\") " pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.302604 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.302582 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ac81be3d-4e6d-4579-a42f-857b746ffd70-signing-key\") pod \"service-ca-67d667c7d-pp5wd\" (UID: \"ac81be3d-4e6d-4579-a42f-857b746ffd70\") " pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.308846 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.308823 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brx7h\" (UniqueName: \"kubernetes.io/projected/ac81be3d-4e6d-4579-a42f-857b746ffd70-kube-api-access-brx7h\") pod \"service-ca-67d667c7d-pp5wd\" (UID: \"ac81be3d-4e6d-4579-a42f-857b746ffd70\") " pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.428031 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.428007 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" May 26 11:50:06.550779 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:06.550718 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-pp5wd"] May 26 11:50:06.554193 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:06.554159 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac81be3d_4e6d_4579_a42f_857b746ffd70.slice/crio-fb442f24aaed393e45b6f67c806c267be9f6313fbf27a1a8c78c003ab39731db WatchSource:0}: Error finding container fb442f24aaed393e45b6f67c806c267be9f6313fbf27a1a8c78c003ab39731db: Status 404 returned error can't find the container with id fb442f24aaed393e45b6f67c806c267be9f6313fbf27a1a8c78c003ab39731db May 26 11:50:07.027623 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:07.027586 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" event={"ID":"ac81be3d-4e6d-4579-a42f-857b746ffd70","Type":"ContainerStarted","Data":"fb442f24aaed393e45b6f67c806c267be9f6313fbf27a1a8c78c003ab39731db"} May 26 11:50:07.029174 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:07.029143 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg" event={"ID":"244c432c-21b2-4768-9e04-51f8357d58a4","Type":"ContainerStarted","Data":"4b2f461137ebe779a6f88f92746ad694eb68b73d6a9116e2295d9d45658ccc6e"} May 26 11:50:07.029297 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:07.029179 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg" event={"ID":"244c432c-21b2-4768-9e04-51f8357d58a4","Type":"ContainerStarted","Data":"40dd4f68bf69eb2fa87246616026a3cdc5f4b637dec1388fd3c806d9a8c11fc5"} May 26 11:50:07.049783 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:07.049742 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dgjbg" podStartSLOduration=1.986966444 podStartE2EDuration="3.049728765s" podCreationTimestamp="2026-05-26 11:50:04 +0000 UTC" firstStartedPulling="2026-05-26 11:50:05.15149624 +0000 UTC m=+111.028494431" lastFinishedPulling="2026-05-26 11:50:06.214258559 +0000 UTC m=+112.091256752" observedRunningTime="2026-05-26 11:50:07.049649701 +0000 UTC m=+112.926647914" watchObservedRunningTime="2026-05-26 11:50:07.049728765 +0000 UTC m=+112.926726977" May 26 11:50:07.143724 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:07.143698 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-skrzv_02f7eba3-d311-4f16-b8a6-163a864cc3b2/node-ca/0.log" May 26 11:50:07.510824 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:07.510787 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:07.511019 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:07.510941 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:07.511019 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:07.510988 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:15.510959921 +0000 UTC m=+121.387958123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : configmap references non-existent config key: service-ca.crt May 26 11:50:07.511147 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:07.511041 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:50:07.511147 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:07.511098 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:15.5110844 +0000 UTC m=+121.388082610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : secret "router-metrics-certs-default" not found May 26 11:50:09.034452 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:09.034414 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" event={"ID":"ac81be3d-4e6d-4579-a42f-857b746ffd70","Type":"ContainerStarted","Data":"1d3a70eaa654bbad68862efe558d5255a453982ed676ef40a0cf69a2f7ce32ea"} May 26 11:50:09.053201 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:09.053155 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-pp5wd" podStartSLOduration=1.5011860609999998 podStartE2EDuration="3.053144081s" podCreationTimestamp="2026-05-26 11:50:06 +0000 UTC" firstStartedPulling="2026-05-26 11:50:06.55597667 +0000 UTC m=+112.432974860" lastFinishedPulling="2026-05-26 11:50:08.107934687 +0000 UTC m=+113.984932880" observedRunningTime="2026-05-26 11:50:09.052343927 +0000 UTC m=+114.929342151" watchObservedRunningTime="2026-05-26 11:50:09.053144081 +0000 UTC m=+114.930142292" May 26 11:50:10.237200 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:10.237170 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:10.237200 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:10.237204 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:10.237606 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:10.237519 2572 scope.go:117] "RemoveContainer" containerID="e061a23e522d979169927c5debb2047ccf60ea4d6a69ab252b06e24f39274815" May 26 11:50:10.237677 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:10.237661 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-7r7rk_openshift-console-operator(0681cbe3-f564-4ce6-bbd3-0da4a12e0f00)\"" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" podUID="0681cbe3-f564-4ce6-bbd3-0da4a12e0f00" May 26 11:50:15.566454 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:15.566408 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:15.566820 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:15.566570 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle podName:8d80b656-2bd7-4f7b-94e4-dc043776c9b2 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:31.566548978 +0000 UTC m=+137.443547168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle") pod "router-default-766db55d5b-k6rg6" (UID: "8d80b656-2bd7-4f7b-94e4-dc043776c9b2") : configmap references non-existent config key: service-ca.crt May 26 11:50:15.566820 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:15.566599 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:15.568768 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:15.568743 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-metrics-certs\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:20.692703 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:20.692674 2572 scope.go:117] "RemoveContainer" containerID="e061a23e522d979169927c5debb2047ccf60ea4d6a69ab252b06e24f39274815" May 26 11:50:21.061761 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:21.061707 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/2.log" May 26 11:50:21.062061 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:21.062044 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/1.log" May 26 11:50:21.062123 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:21.062077 2572 generic.go:358] "Generic (PLEG): container finished" podID="0681cbe3-f564-4ce6-bbd3-0da4a12e0f00" containerID="a348767a54bc358ac24ab9872a9426935fed70ca512255636c7abbc1c087b402" exitCode=255 May 26 11:50:21.062158 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:21.062124 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" event={"ID":"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00","Type":"ContainerDied","Data":"a348767a54bc358ac24ab9872a9426935fed70ca512255636c7abbc1c087b402"} May 26 11:50:21.062158 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:21.062150 2572 scope.go:117] "RemoveContainer" containerID="e061a23e522d979169927c5debb2047ccf60ea4d6a69ab252b06e24f39274815" May 26 11:50:21.062543 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:21.062522 2572 scope.go:117] "RemoveContainer" containerID="a348767a54bc358ac24ab9872a9426935fed70ca512255636c7abbc1c087b402" May 26 11:50:21.062720 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:21.062699 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-7r7rk_openshift-console-operator(0681cbe3-f564-4ce6-bbd3-0da4a12e0f00)\"" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" podUID="0681cbe3-f564-4ce6-bbd3-0da4a12e0f00" May 26 11:50:22.066088 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:22.066066 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/2.log" May 26 11:50:24.529725 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:24.529696 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:50:24.531868 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:24.531844 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3827d450-0d1d-4619-8cc9-8a3c6bc59bb7-metrics-certs\") pod \"network-metrics-daemon-jqqpm\" (UID: \"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7\") " pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:50:24.810644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:24.810574 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-52jct\"" May 26 11:50:24.818848 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:24.818831 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqqpm" May 26 11:50:24.935069 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:24.935042 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqqpm"] May 26 11:50:24.938828 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:24.938799 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3827d450_0d1d_4619_8cc9_8a3c6bc59bb7.slice/crio-bf016bc3a58275a75b290fcf08ef0aab0c804b01e6cf6a9f863577eca3c07352 WatchSource:0}: Error finding container bf016bc3a58275a75b290fcf08ef0aab0c804b01e6cf6a9f863577eca3c07352: Status 404 returned error can't find the container with id bf016bc3a58275a75b290fcf08ef0aab0c804b01e6cf6a9f863577eca3c07352 May 26 11:50:25.073848 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:25.073820 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqqpm" event={"ID":"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7","Type":"ContainerStarted","Data":"bf016bc3a58275a75b290fcf08ef0aab0c804b01e6cf6a9f863577eca3c07352"} May 26 11:50:27.079955 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:27.079922 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqqpm" event={"ID":"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7","Type":"ContainerStarted","Data":"c669e40bc2cfb94eff55809a48cb4265cc42f4630b5908cb888003db52f5616a"} May 26 11:50:27.079955 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:27.079956 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqqpm" event={"ID":"3827d450-0d1d-4619-8cc9-8a3c6bc59bb7","Type":"ContainerStarted","Data":"792a497bf6fdf941068b4b31025812d159ba17c2c8defb7806b798a750af2462"} May 26 11:50:27.097041 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:27.096994 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jqqpm" podStartSLOduration=131.997851176 podStartE2EDuration="2m13.096980536s" podCreationTimestamp="2026-05-26 11:48:14 +0000 UTC" firstStartedPulling="2026-05-26 11:50:24.940714455 +0000 UTC m=+130.817712645" lastFinishedPulling="2026-05-26 11:50:26.039843802 +0000 UTC m=+131.916842005" observedRunningTime="2026-05-26 11:50:27.096056709 +0000 UTC m=+132.973054920" watchObservedRunningTime="2026-05-26 11:50:27.096980536 +0000 UTC m=+132.973978727" May 26 11:50:30.043001 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.042972 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7ggd2"] May 26 11:50:30.045983 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.045965 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.049837 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.049815 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b2qv2\"" May 26 11:50:30.049959 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.049858 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 11:50:30.049959 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.049890 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 11:50:30.061498 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.061475 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7ggd2"] May 26 11:50:30.167531 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.167508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.167638 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.167553 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.167677 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.167643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-crio-socket\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.167677 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.167671 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-data-volume\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.167747 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.167705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9hwj\" (UniqueName: \"kubernetes.io/projected/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-kube-api-access-n9hwj\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.236825 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.236803 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:30.236921 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.236834 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:30.237131 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.237119 2572 scope.go:117] "RemoveContainer" containerID="a348767a54bc358ac24ab9872a9426935fed70ca512255636c7abbc1c087b402" May 26 11:50:30.237289 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:30.237274 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-7r7rk_openshift-console-operator(0681cbe3-f564-4ce6-bbd3-0da4a12e0f00)\"" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" podUID="0681cbe3-f564-4ce6-bbd3-0da4a12e0f00" May 26 11:50:30.268529 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.268509 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.268616 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.268554 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.268616 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.268598 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-crio-socket\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.268616 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.268613 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-data-volume\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.268736 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.268645 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9hwj\" (UniqueName: \"kubernetes.io/projected/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-kube-api-access-n9hwj\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.268736 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.268705 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-crio-socket\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.268960 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.268940 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-data-volume\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.269185 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.269170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.270699 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.270682 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.277223 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.277205 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9hwj\" (UniqueName: \"kubernetes.io/projected/f2a370bd-a5e6-4633-acd7-501b2ec0dad5-kube-api-access-n9hwj\") pod \"insights-runtime-extractor-7ggd2\" (UID: \"f2a370bd-a5e6-4633-acd7-501b2ec0dad5\") " pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.354444 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.354419 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7ggd2" May 26 11:50:30.480866 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:30.479197 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7ggd2"] May 26 11:50:30.482311 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:30.482281 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a370bd_a5e6_4633_acd7_501b2ec0dad5.slice/crio-56de3c8493c0e8938a1413b1edce07082003028e30da9c86fb2324d9449169da WatchSource:0}: Error finding container 56de3c8493c0e8938a1413b1edce07082003028e30da9c86fb2324d9449169da: Status 404 returned error can't find the container with id 56de3c8493c0e8938a1413b1edce07082003028e30da9c86fb2324d9449169da May 26 11:50:31.093493 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:31.093462 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ggd2" event={"ID":"f2a370bd-a5e6-4633-acd7-501b2ec0dad5","Type":"ContainerStarted","Data":"22b076a0684e9d7c69a9eadd60a0592bda9f672efe15cd5b878fecad01e9a9b6"} May 26 11:50:31.093846 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:31.093499 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ggd2" event={"ID":"f2a370bd-a5e6-4633-acd7-501b2ec0dad5","Type":"ContainerStarted","Data":"56de3c8493c0e8938a1413b1edce07082003028e30da9c86fb2324d9449169da"} May 26 11:50:31.578759 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:31.578728 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:31.579222 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:31.579206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d80b656-2bd7-4f7b-94e4-dc043776c9b2-service-ca-bundle\") pod \"router-default-766db55d5b-k6rg6\" (UID: \"8d80b656-2bd7-4f7b-94e4-dc043776c9b2\") " pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:31.844092 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:31.844020 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8m9xf\"" May 26 11:50:31.851542 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:31.851518 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:31.994731 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:31.994593 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-766db55d5b-k6rg6"] May 26 11:50:31.997540 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:31.997510 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d80b656_2bd7_4f7b_94e4_dc043776c9b2.slice/crio-84421a880534cc59e93966f1d9accdea0e3db40e25219dfb69c5f7d813fb6bd1 WatchSource:0}: Error finding container 84421a880534cc59e93966f1d9accdea0e3db40e25219dfb69c5f7d813fb6bd1: Status 404 returned error can't find the container with id 84421a880534cc59e93966f1d9accdea0e3db40e25219dfb69c5f7d813fb6bd1 May 26 11:50:32.099148 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:32.099048 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ggd2" event={"ID":"f2a370bd-a5e6-4633-acd7-501b2ec0dad5","Type":"ContainerStarted","Data":"ed160f037ffd433140186fba5406fdb5ecf18e4ef21736467e2ec69861d49487"} May 26 11:50:32.102295 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:32.102267 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-766db55d5b-k6rg6" event={"ID":"8d80b656-2bd7-4f7b-94e4-dc043776c9b2","Type":"ContainerStarted","Data":"93708abd76876ea8be3247df51850db51634ec263808570dd382eaa690f05f4e"} May 26 11:50:32.102393 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:32.102303 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-766db55d5b-k6rg6" event={"ID":"8d80b656-2bd7-4f7b-94e4-dc043776c9b2","Type":"ContainerStarted","Data":"84421a880534cc59e93966f1d9accdea0e3db40e25219dfb69c5f7d813fb6bd1"} May 26 11:50:32.125874 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:32.125833 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-766db55d5b-k6rg6" podStartSLOduration=33.125819355 podStartE2EDuration="33.125819355s" podCreationTimestamp="2026-05-26 11:49:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:50:32.124965239 +0000 UTC m=+138.001963451" watchObservedRunningTime="2026-05-26 11:50:32.125819355 +0000 UTC m=+138.002817567" May 26 11:50:32.852476 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:32.852387 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:32.854875 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:32.854854 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:33.106782 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:33.106710 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ggd2" event={"ID":"f2a370bd-a5e6-4633-acd7-501b2ec0dad5","Type":"ContainerStarted","Data":"307587d659135c05ab71ce9c8adb84d17ebc555a544b4af663b18dab60fefc55"} May 26 11:50:33.107324 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:33.106867 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:33.108060 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:33.108042 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-766db55d5b-k6rg6" May 26 11:50:33.127868 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:33.127830 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7ggd2" podStartSLOduration=1.073989534 podStartE2EDuration="3.127818045s" podCreationTimestamp="2026-05-26 11:50:30 +0000 UTC" firstStartedPulling="2026-05-26 11:50:30.535273257 +0000 UTC m=+136.412271451" lastFinishedPulling="2026-05-26 11:50:32.589101768 +0000 UTC m=+138.466099962" observedRunningTime="2026-05-26 11:50:33.126310819 +0000 UTC m=+139.003309030" watchObservedRunningTime="2026-05-26 11:50:33.127818045 +0000 UTC m=+139.004816256" May 26 11:50:38.320876 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.320846 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv"] May 26 11:50:38.353935 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.353902 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv"] May 26 11:50:38.354080 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.354013 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.357091 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.357063 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 11:50:38.358537 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.358508 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 11:50:38.358537 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.358528 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 11:50:38.358692 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.358582 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 26 11:50:38.358746 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.358704 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 26 11:50:38.358746 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.358714 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-l7785\"" May 26 11:50:38.527338 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.527306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/179164e5-6a71-4f81-b4b1-b002f338c995-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.527469 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.527348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/179164e5-6a71-4f81-b4b1-b002f338c995-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.527469 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.527387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/179164e5-6a71-4f81-b4b1-b002f338c995-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.527469 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.527429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnltj\" (UniqueName: \"kubernetes.io/projected/179164e5-6a71-4f81-b4b1-b002f338c995-kube-api-access-hnltj\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.627994 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.627971 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/179164e5-6a71-4f81-b4b1-b002f338c995-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.628103 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.628019 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/179164e5-6a71-4f81-b4b1-b002f338c995-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.628103 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.628081 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/179164e5-6a71-4f81-b4b1-b002f338c995-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.628216 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.628114 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnltj\" (UniqueName: \"kubernetes.io/projected/179164e5-6a71-4f81-b4b1-b002f338c995-kube-api-access-hnltj\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.628553 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.628525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/179164e5-6a71-4f81-b4b1-b002f338c995-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.630493 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.630465 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/179164e5-6a71-4f81-b4b1-b002f338c995-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.630493 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.630480 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/179164e5-6a71-4f81-b4b1-b002f338c995-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.636857 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.636839 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnltj\" (UniqueName: \"kubernetes.io/projected/179164e5-6a71-4f81-b4b1-b002f338c995-kube-api-access-hnltj\") pod \"prometheus-operator-7779bbdd78-sw4pv\" (UID: \"179164e5-6a71-4f81-b4b1-b002f338c995\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.662736 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.662717 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" May 26 11:50:38.803198 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:38.803174 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv"] May 26 11:50:38.804128 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:38.804100 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179164e5_6a71_4f81_b4b1_b002f338c995.slice/crio-e03d00c2944a3483d08c157398ec6e151a9f0b92dd94300c7c46be6ccca3d602 WatchSource:0}: Error finding container e03d00c2944a3483d08c157398ec6e151a9f0b92dd94300c7c46be6ccca3d602: Status 404 returned error can't find the container with id e03d00c2944a3483d08c157398ec6e151a9f0b92dd94300c7c46be6ccca3d602 May 26 11:50:39.121588 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:39.121560 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" event={"ID":"179164e5-6a71-4f81-b4b1-b002f338c995","Type":"ContainerStarted","Data":"e03d00c2944a3483d08c157398ec6e151a9f0b92dd94300c7c46be6ccca3d602"} May 26 11:50:40.125405 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:40.125374 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" event={"ID":"179164e5-6a71-4f81-b4b1-b002f338c995","Type":"ContainerStarted","Data":"65db3f6cad4eab970b7ca0c77954d476a356ad63033641f379388a39ca7d76fc"} May 26 11:50:40.125801 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:40.125414 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" event={"ID":"179164e5-6a71-4f81-b4b1-b002f338c995","Type":"ContainerStarted","Data":"be6b2ec5eb65fe13655fe094d335614a146eaba3cfcd494735dde9de80c445fc"} May 26 11:50:40.146130 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:40.146088 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sw4pv" podStartSLOduration=0.961428927 podStartE2EDuration="2.146075595s" podCreationTimestamp="2026-05-26 11:50:38 +0000 UTC" firstStartedPulling="2026-05-26 11:50:38.805833322 +0000 UTC m=+144.682831513" lastFinishedPulling="2026-05-26 11:50:39.990479976 +0000 UTC m=+145.867478181" observedRunningTime="2026-05-26 11:50:40.145716069 +0000 UTC m=+146.022714282" watchObservedRunningTime="2026-05-26 11:50:40.146075595 +0000 UTC m=+146.023073808" May 26 11:50:40.693351 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:40.693319 2572 scope.go:117] "RemoveContainer" containerID="a348767a54bc358ac24ab9872a9426935fed70ca512255636c7abbc1c087b402" May 26 11:50:40.693577 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:40.693557 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-7r7rk_openshift-console-operator(0681cbe3-f564-4ce6-bbd3-0da4a12e0f00)\"" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" podUID="0681cbe3-f564-4ce6-bbd3-0da4a12e0f00" May 26 11:50:41.646766 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.646728 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4"] May 26 11:50:41.649097 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.649078 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.652713 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.652688 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4c7kp\"" May 26 11:50:41.654072 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.654021 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 26 11:50:41.654072 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.654032 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 26 11:50:41.660399 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.660376 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx"] May 26 11:50:41.662834 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.662485 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.663879 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.663840 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4"] May 26 11:50:41.665272 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.665243 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 26 11:50:41.665707 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.665690 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tk62s\"" May 26 11:50:41.666026 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.666004 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 26 11:50:41.666119 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.666014 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 26 11:50:41.674188 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.674166 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx"] May 26 11:50:41.698052 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.698032 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l2m24"] May 26 11:50:41.700067 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.700053 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.702968 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.702786 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 11:50:41.702968 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.702839 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 11:50:41.702968 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.702845 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7cpqv\"" May 26 11:50:41.702968 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.702870 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 11:50:41.749843 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.749817 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41149b18-29eb-4db9-9596-9b11f4783e3e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.749998 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.749856 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41149b18-29eb-4db9-9596-9b11f4783e3e-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.749998 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.749882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkf6z\" (UniqueName: \"kubernetes.io/projected/41149b18-29eb-4db9-9596-9b11f4783e3e-kube-api-access-mkf6z\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.750103 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.750011 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/41149b18-29eb-4db9-9596-9b11f4783e3e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.850992 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.850970 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.851119 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851005 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ttz\" (UniqueName: \"kubernetes.io/projected/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-kube-api-access-59ttz\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.851119 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851049 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41149b18-29eb-4db9-9596-9b11f4783e3e-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.851237 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851216 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkf6z\" (UniqueName: \"kubernetes.io/projected/41149b18-29eb-4db9-9596-9b11f4783e3e-kube-api-access-mkf6z\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.851283 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851260 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-textfile\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.851335 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nld82\" (UniqueName: \"kubernetes.io/projected/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-api-access-nld82\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.851384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851340 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-metrics-client-ca\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.851384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851374 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-wtmp\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.851510 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851405 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.851510 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851454 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-sys\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.851510 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.851656 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851510 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-tls\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.851656 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.851656 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851568 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/41149b18-29eb-4db9-9596-9b11f4783e3e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.851801 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851768 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41149b18-29eb-4db9-9596-9b11f4783e3e-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.851935 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.852103 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.852103 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.851969 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.852103 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.852002 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41149b18-29eb-4db9-9596-9b11f4783e3e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.852103 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.852028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-root\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.854338 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.854312 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41149b18-29eb-4db9-9596-9b11f4783e3e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.854448 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.854348 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/41149b18-29eb-4db9-9596-9b11f4783e3e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.860756 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.860726 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkf6z\" (UniqueName: \"kubernetes.io/projected/41149b18-29eb-4db9-9596-9b11f4783e3e-kube-api-access-mkf6z\") pod \"openshift-state-metrics-9c959559f-nxcw4\" (UID: \"41149b18-29eb-4db9-9596-9b11f4783e3e\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.953093 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953033 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nld82\" (UniqueName: \"kubernetes.io/projected/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-api-access-nld82\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.953093 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953070 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-metrics-client-ca\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953093 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953090 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-wtmp\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953299 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953109 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.953299 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953220 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-sys\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953299 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953238 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-wtmp\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953299 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953275 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.953526 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953300 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-sys\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953526 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953305 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-tls\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953526 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953349 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953526 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953409 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.953526 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953459 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.953526 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953487 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953526 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953517 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-root\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953872 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:41.953535 2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 26 11:50:41.953872 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953549 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.953872 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:41.953593 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-tls podName:e6d0dd2a-e1a8-4034-85ce-a9358f2b112f nodeName:}" failed. No retries permitted until 2026-05-26 11:50:42.453575924 +0000 UTC m=+148.330574115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-2dtjx" (UID: "e6d0dd2a-e1a8-4034-85ce-a9358f2b112f") : secret "kube-state-metrics-tls" not found May 26 11:50:41.953872 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953613 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59ttz\" (UniqueName: \"kubernetes.io/projected/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-kube-api-access-59ttz\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953872 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953653 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-textfile\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953872 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953669 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.953872 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953743 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-root\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.953872 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.953772 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-metrics-client-ca\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.954284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.954134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-textfile\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.954284 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.954158 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.954390 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.954298 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.954467 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.954399 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.955602 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.955581 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-tls\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.955695 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.955615 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.956089 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.956073 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:41.959641 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.959627 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" May 26 11:50:41.962253 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.962228 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ttz\" (UniqueName: \"kubernetes.io/projected/b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e-kube-api-access-59ttz\") pod \"node-exporter-l2m24\" (UID: \"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e\") " pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:41.962423 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:41.962406 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nld82\" (UniqueName: \"kubernetes.io/projected/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-api-access-nld82\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:42.008991 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:42.008965 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l2m24" May 26 11:50:42.020716 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:42.020676 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ba0f2d_e4fd_4f22_a46c_862802ba1d9e.slice/crio-aaebf040b5e4637ac4080feb2ed3e6a73bb8aac2b403e7a6ae0d91ad4327257c WatchSource:0}: Error finding container aaebf040b5e4637ac4080feb2ed3e6a73bb8aac2b403e7a6ae0d91ad4327257c: Status 404 returned error can't find the container with id aaebf040b5e4637ac4080feb2ed3e6a73bb8aac2b403e7a6ae0d91ad4327257c May 26 11:50:42.099642 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:42.099616 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4"] May 26 11:50:42.101525 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:42.101499 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41149b18_29eb_4db9_9596_9b11f4783e3e.slice/crio-fedb45cfbc475848c2b58c38abac4cb384e3795099d4dd0067b90ea5ed1b4684 WatchSource:0}: Error finding container fedb45cfbc475848c2b58c38abac4cb384e3795099d4dd0067b90ea5ed1b4684: Status 404 returned error can't find the container with id fedb45cfbc475848c2b58c38abac4cb384e3795099d4dd0067b90ea5ed1b4684 May 26 11:50:42.131104 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:42.131070 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2m24" event={"ID":"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e","Type":"ContainerStarted","Data":"aaebf040b5e4637ac4080feb2ed3e6a73bb8aac2b403e7a6ae0d91ad4327257c"} May 26 11:50:42.132122 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:42.132099 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" event={"ID":"41149b18-29eb-4db9-9596-9b11f4783e3e","Type":"ContainerStarted","Data":"fedb45cfbc475848c2b58c38abac4cb384e3795099d4dd0067b90ea5ed1b4684"} May 26 11:50:42.458640 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:42.458593 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:42.458817 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:42.458765 2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 26 11:50:42.458895 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:42.458848 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-tls podName:e6d0dd2a-e1a8-4034-85ce-a9358f2b112f nodeName:}" failed. No retries permitted until 2026-05-26 11:50:43.458827092 +0000 UTC m=+149.335825286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-2dtjx" (UID: "e6d0dd2a-e1a8-4034-85ce-a9358f2b112f") : secret "kube-state-metrics-tls" not found May 26 11:50:43.137927 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:43.137894 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" event={"ID":"41149b18-29eb-4db9-9596-9b11f4783e3e","Type":"ContainerStarted","Data":"92aee4e505aea2846495db9c0a11ef110933c1e51e328417300cd32665aa6b65"} May 26 11:50:43.138243 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:43.137937 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" event={"ID":"41149b18-29eb-4db9-9596-9b11f4783e3e","Type":"ContainerStarted","Data":"df93ba394e14d80d1373262a0cfed7f0527f32e333af8a6d1cf5482a6228535c"} May 26 11:50:43.468334 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:43.468275 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:43.470379 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:43.470359 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6d0dd2a-e1a8-4034-85ce-a9358f2b112f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-2dtjx\" (UID: \"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:43.472256 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:43.472235 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" May 26 11:50:43.596861 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:43.596834 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx"] May 26 11:50:43.598977 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:43.598946 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d0dd2a_e1a8_4034_85ce_a9358f2b112f.slice/crio-0664a296504e710411a78b0d4d7b34074d1d7606ee75cc242212e8911907427c WatchSource:0}: Error finding container 0664a296504e710411a78b0d4d7b34074d1d7606ee75cc242212e8911907427c: Status 404 returned error can't find the container with id 0664a296504e710411a78b0d4d7b34074d1d7606ee75cc242212e8911907427c May 26 11:50:44.141735 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:44.141700 2572 generic.go:358] "Generic (PLEG): container finished" podID="b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e" containerID="cf73ffb09710fc7ffd6c2d9ad002436a1401f6ee91c6508a3ddc520dcdcaaf6b" exitCode=0 May 26 11:50:44.142164 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:44.141798 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2m24" event={"ID":"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e","Type":"ContainerDied","Data":"cf73ffb09710fc7ffd6c2d9ad002436a1401f6ee91c6508a3ddc520dcdcaaf6b"} May 26 11:50:44.144147 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:44.144120 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" event={"ID":"41149b18-29eb-4db9-9596-9b11f4783e3e","Type":"ContainerStarted","Data":"e8262ed2ebcbd884c70a0d04d58a4830c57b4a3c60cdfa6e31410cb8b85617ed"} May 26 11:50:44.145243 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:44.145218 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" event={"ID":"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f","Type":"ContainerStarted","Data":"0664a296504e710411a78b0d4d7b34074d1d7606ee75cc242212e8911907427c"} May 26 11:50:44.187475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:44.187403 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nxcw4" podStartSLOduration=2.252963957 podStartE2EDuration="3.18738773s" podCreationTimestamp="2026-05-26 11:50:41 +0000 UTC" firstStartedPulling="2026-05-26 11:50:42.201739944 +0000 UTC m=+148.078738134" lastFinishedPulling="2026-05-26 11:50:43.136163695 +0000 UTC m=+149.013161907" observedRunningTime="2026-05-26 11:50:44.184639987 +0000 UTC m=+150.061638200" watchObservedRunningTime="2026-05-26 11:50:44.18738773 +0000 UTC m=+150.064385943" May 26 11:50:45.149893 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:45.149854 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2m24" event={"ID":"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e","Type":"ContainerStarted","Data":"da224fd7534792816b154fbc273cc17f977d29d6beb0f98e81a4455aba36811d"} May 26 11:50:45.150367 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:45.150341 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2m24" event={"ID":"b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e","Type":"ContainerStarted","Data":"fe8f67254f88b565cfbc621275ed64e5f77ae7da0028dd52fbf53bdc723065e3"} May 26 11:50:45.151966 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:45.151935 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" event={"ID":"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f","Type":"ContainerStarted","Data":"21f64eaeeadc2513fdd27cf37cbeabe4f95002fb2c6bd66240ab548fb5d87e22"} May 26 11:50:45.152068 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:45.151976 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" event={"ID":"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f","Type":"ContainerStarted","Data":"0de19868b485508c065b6701271194fe830d5aee16c3a187703af71f625db8dc"} May 26 11:50:45.152068 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:45.151991 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" event={"ID":"e6d0dd2a-e1a8-4034-85ce-a9358f2b112f","Type":"ContainerStarted","Data":"b183d773f9e8a5c33ff68bfc0a1a5b3edf5662c9b4b2ab4bc6b369e54306598d"} May 26 11:50:45.172417 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:45.172381 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l2m24" podStartSLOduration=3.318316903 podStartE2EDuration="4.172369728s" podCreationTimestamp="2026-05-26 11:50:41 +0000 UTC" firstStartedPulling="2026-05-26 11:50:42.023179769 +0000 UTC m=+147.900177964" lastFinishedPulling="2026-05-26 11:50:42.877232597 +0000 UTC m=+148.754230789" observedRunningTime="2026-05-26 11:50:45.172113556 +0000 UTC m=+151.049111771" watchObservedRunningTime="2026-05-26 11:50:45.172369728 +0000 UTC m=+151.049367939" May 26 11:50:45.192782 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:45.192737 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2dtjx" podStartSLOduration=3.068117205 podStartE2EDuration="4.192721343s" podCreationTimestamp="2026-05-26 11:50:41 +0000 UTC" firstStartedPulling="2026-05-26 11:50:43.600730647 +0000 UTC m=+149.477728837" lastFinishedPulling="2026-05-26 11:50:44.725334768 +0000 UTC m=+150.602332975" observedRunningTime="2026-05-26 11:50:45.191982354 +0000 UTC m=+151.068980569" watchObservedRunningTime="2026-05-26 11:50:45.192721343 +0000 UTC m=+151.069719556" May 26 11:50:46.442426 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:46.442389 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz"] May 26 11:50:46.444556 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:46.444539 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" May 26 11:50:46.447489 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:46.447012 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 26 11:50:46.447489 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:46.447299 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-6c27k\"" May 26 11:50:46.452226 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:46.452203 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz"] May 26 11:50:46.490642 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:46.490615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32a533fd-0e22-4d7a-b2b5-156441e211e4-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-b2xrz\" (UID: \"32a533fd-0e22-4d7a-b2b5-156441e211e4\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" May 26 11:50:46.591208 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:46.591182 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32a533fd-0e22-4d7a-b2b5-156441e211e4-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-b2xrz\" (UID: \"32a533fd-0e22-4d7a-b2b5-156441e211e4\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" May 26 11:50:46.591337 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:46.591322 2572 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 26 11:50:46.591411 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:46.591402 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a533fd-0e22-4d7a-b2b5-156441e211e4-monitoring-plugin-cert podName:32a533fd-0e22-4d7a-b2b5-156441e211e4 nodeName:}" failed. No retries permitted until 2026-05-26 11:50:47.091383617 +0000 UTC m=+152.968381816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/32a533fd-0e22-4d7a-b2b5-156441e211e4-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-b2xrz" (UID: "32a533fd-0e22-4d7a-b2b5-156441e211e4") : secret "monitoring-plugin-cert" not found May 26 11:50:47.094360 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:47.094331 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32a533fd-0e22-4d7a-b2b5-156441e211e4-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-b2xrz\" (UID: \"32a533fd-0e22-4d7a-b2b5-156441e211e4\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" May 26 11:50:47.096563 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:47.096546 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32a533fd-0e22-4d7a-b2b5-156441e211e4-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-b2xrz\" (UID: \"32a533fd-0e22-4d7a-b2b5-156441e211e4\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" May 26 11:50:47.354957 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:47.354881 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" May 26 11:50:47.472552 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:47.472525 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz"] May 26 11:50:47.474832 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:47.474795 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a533fd_0e22_4d7a_b2b5_156441e211e4.slice/crio-8df2e788bc1ca890c52d613a82200445faf1e546047e09a2be8ea91bdb8abd9c WatchSource:0}: Error finding container 8df2e788bc1ca890c52d613a82200445faf1e546047e09a2be8ea91bdb8abd9c: Status 404 returned error can't find the container with id 8df2e788bc1ca890c52d613a82200445faf1e546047e09a2be8ea91bdb8abd9c May 26 11:50:48.163554 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:48.163514 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" event={"ID":"32a533fd-0e22-4d7a-b2b5-156441e211e4","Type":"ContainerStarted","Data":"8df2e788bc1ca890c52d613a82200445faf1e546047e09a2be8ea91bdb8abd9c"} May 26 11:50:49.167118 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:49.167088 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" event={"ID":"32a533fd-0e22-4d7a-b2b5-156441e211e4","Type":"ContainerStarted","Data":"2d9e2c1862f93335cdb73d186685abab87bc3c5a9f505416b35cecf64204ae1a"} May 26 11:50:49.167469 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:49.167263 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" May 26 11:50:49.171523 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:49.171503 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" May 26 11:50:49.185135 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:49.185095 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-b2xrz" podStartSLOduration=2.016001653 podStartE2EDuration="3.185085445s" podCreationTimestamp="2026-05-26 11:50:46 +0000 UTC" firstStartedPulling="2026-05-26 11:50:47.476608829 +0000 UTC m=+153.353607020" lastFinishedPulling="2026-05-26 11:50:48.645692619 +0000 UTC m=+154.522690812" observedRunningTime="2026-05-26 11:50:49.184337026 +0000 UTC m=+155.061335238" watchObservedRunningTime="2026-05-26 11:50:49.185085445 +0000 UTC m=+155.062083656" May 26 11:50:51.985362 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:51.985275 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nn9d2" podUID="13ee2e51-8fcc-4333-88c2-d7aa45761280" May 26 11:50:52.052688 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:50:52.052657 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fxhbl" podUID="b1884da9-5484-4448-aaab-e96f107c7740" May 26 11:50:52.174590 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:52.174569 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:50:52.174710 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:52.174574 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nn9d2" May 26 11:50:52.693355 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:52.693325 2572 scope.go:117] "RemoveContainer" containerID="a348767a54bc358ac24ab9872a9426935fed70ca512255636c7abbc1c087b402" May 26 11:50:53.179921 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.179895 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/2.log" May 26 11:50:53.180281 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.179992 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" event={"ID":"0681cbe3-f564-4ce6-bbd3-0da4a12e0f00","Type":"ContainerStarted","Data":"c4410886e2b3547dc141f00bf6458646dbe744cfc3c1e1b565c8638f8207e1a3"} May 26 11:50:53.180281 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.180256 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:53.186247 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.186221 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" May 26 11:50:53.197267 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.197220 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-7r7rk" podStartSLOduration=51.867774201 podStartE2EDuration="54.197208525s" podCreationTimestamp="2026-05-26 11:49:59 +0000 UTC" firstStartedPulling="2026-05-26 11:50:00.360146886 +0000 UTC m=+106.237145077" lastFinishedPulling="2026-05-26 11:50:02.689581198 +0000 UTC m=+108.566579401" observedRunningTime="2026-05-26 11:50:53.195964454 +0000 UTC m=+159.072962668" watchObservedRunningTime="2026-05-26 11:50:53.197208525 +0000 UTC m=+159.074206737" May 26 11:50:53.363066 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.363029 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-4qwcb"] May 26 11:50:53.365181 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.365160 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-4qwcb" May 26 11:50:53.368040 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.368011 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 26 11:50:53.368151 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.368090 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vjmf5\"" May 26 11:50:53.368151 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.368103 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 26 11:50:53.375185 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.375164 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-4qwcb"] May 26 11:50:53.436557 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.436502 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6rzg\" (UniqueName: \"kubernetes.io/projected/3c910ff8-f0a0-45a6-95b3-300c8e96ebf0-kube-api-access-v6rzg\") pod \"downloads-57bd96b888-4qwcb\" (UID: \"3c910ff8-f0a0-45a6-95b3-300c8e96ebf0\") " pod="openshift-console/downloads-57bd96b888-4qwcb" May 26 11:50:53.536842 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.536813 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6rzg\" (UniqueName: \"kubernetes.io/projected/3c910ff8-f0a0-45a6-95b3-300c8e96ebf0-kube-api-access-v6rzg\") pod \"downloads-57bd96b888-4qwcb\" (UID: \"3c910ff8-f0a0-45a6-95b3-300c8e96ebf0\") " pod="openshift-console/downloads-57bd96b888-4qwcb" May 26 11:50:53.545553 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.545532 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6rzg\" (UniqueName: \"kubernetes.io/projected/3c910ff8-f0a0-45a6-95b3-300c8e96ebf0-kube-api-access-v6rzg\") pod \"downloads-57bd96b888-4qwcb\" (UID: \"3c910ff8-f0a0-45a6-95b3-300c8e96ebf0\") " pod="openshift-console/downloads-57bd96b888-4qwcb" May 26 11:50:53.674614 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.674583 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-4qwcb" May 26 11:50:53.806185 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:53.806149 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-4qwcb"] May 26 11:50:53.811491 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:53.811464 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c910ff8_f0a0_45a6_95b3_300c8e96ebf0.slice/crio-7d4a7e0a881e3d16c1846593bd18e41ae87ecc5bf140e02cd1f9223a8c5b4dd6 WatchSource:0}: Error finding container 7d4a7e0a881e3d16c1846593bd18e41ae87ecc5bf140e02cd1f9223a8c5b4dd6: Status 404 returned error can't find the container with id 7d4a7e0a881e3d16c1846593bd18e41ae87ecc5bf140e02cd1f9223a8c5b4dd6 May 26 11:50:54.184155 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:54.184121 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-4qwcb" event={"ID":"3c910ff8-f0a0-45a6-95b3-300c8e96ebf0","Type":"ContainerStarted","Data":"7d4a7e0a881e3d16c1846593bd18e41ae87ecc5bf140e02cd1f9223a8c5b4dd6"} May 26 11:50:56.860357 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:56.860322 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:50:56.862552 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:56.862528 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13ee2e51-8fcc-4333-88c2-d7aa45761280-metrics-tls\") pod \"dns-default-nn9d2\" (UID: \"13ee2e51-8fcc-4333-88c2-d7aa45761280\") " pod="openshift-dns/dns-default-nn9d2" May 26 11:50:56.960909 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:56.960876 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:50:56.963553 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:56.963523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1884da9-5484-4448-aaab-e96f107c7740-cert\") pod \"ingress-canary-fxhbl\" (UID: \"b1884da9-5484-4448-aaab-e96f107c7740\") " pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:50:56.978553 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:56.978528 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mcktv\"" May 26 11:50:56.979497 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:56.979468 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f88zv\"" May 26 11:50:56.985850 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:56.985829 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nn9d2" May 26 11:50:56.985951 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:56.985854 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxhbl" May 26 11:50:57.147297 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:57.147226 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxhbl"] May 26 11:50:57.150236 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:57.150204 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1884da9_5484_4448_aaab_e96f107c7740.slice/crio-376d01adc11d8bc16ae9f9e4f63b9d66075354b0baab8c154c5126d7e64a5d8e WatchSource:0}: Error finding container 376d01adc11d8bc16ae9f9e4f63b9d66075354b0baab8c154c5126d7e64a5d8e: Status 404 returned error can't find the container with id 376d01adc11d8bc16ae9f9e4f63b9d66075354b0baab8c154c5126d7e64a5d8e May 26 11:50:57.167843 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:57.167817 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nn9d2"] May 26 11:50:57.170217 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:50:57.170194 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ee2e51_8fcc_4333_88c2_d7aa45761280.slice/crio-7b55b74fbf3d265d154cbcfcd3aa2b35aa7fa338207e2b3acf1565aa030e202f WatchSource:0}: Error finding container 7b55b74fbf3d265d154cbcfcd3aa2b35aa7fa338207e2b3acf1565aa030e202f: Status 404 returned error can't find the container with id 7b55b74fbf3d265d154cbcfcd3aa2b35aa7fa338207e2b3acf1565aa030e202f May 26 11:50:57.194222 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:57.194192 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxhbl" event={"ID":"b1884da9-5484-4448-aaab-e96f107c7740","Type":"ContainerStarted","Data":"376d01adc11d8bc16ae9f9e4f63b9d66075354b0baab8c154c5126d7e64a5d8e"} May 26 11:50:57.195265 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:50:57.195234 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nn9d2" event={"ID":"13ee2e51-8fcc-4333-88c2-d7aa45761280","Type":"ContainerStarted","Data":"7b55b74fbf3d265d154cbcfcd3aa2b35aa7fa338207e2b3acf1565aa030e202f"} May 26 11:51:00.206878 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:00.206837 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxhbl" event={"ID":"b1884da9-5484-4448-aaab-e96f107c7740","Type":"ContainerStarted","Data":"25b4a7384eb6bf4674b79b6bdd7d93fd33fc5e43c5dbbb9e227ac94d5a6446e9"} May 26 11:51:00.208664 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:00.208640 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nn9d2" event={"ID":"13ee2e51-8fcc-4333-88c2-d7aa45761280","Type":"ContainerStarted","Data":"065d69c0e1c7eb482a09432a5172102adabc7c397115caa841de79463103822f"} May 26 11:51:00.208664 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:00.208668 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nn9d2" event={"ID":"13ee2e51-8fcc-4333-88c2-d7aa45761280","Type":"ContainerStarted","Data":"96d5f65c5403fec57522b3226a8a7e9ef55bdcac706f2ff50c49f8dc2d0a278d"} May 26 11:51:00.208842 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:00.208763 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nn9d2" May 26 11:51:00.223431 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:00.223386 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fxhbl" podStartSLOduration=130.196815539 podStartE2EDuration="2m12.223370857s" podCreationTimestamp="2026-05-26 11:48:48 +0000 UTC" firstStartedPulling="2026-05-26 11:50:57.152805159 +0000 UTC m=+163.029803351" lastFinishedPulling="2026-05-26 11:50:59.179360478 +0000 UTC m=+165.056358669" observedRunningTime="2026-05-26 11:51:00.222141319 +0000 UTC m=+166.099139532" watchObservedRunningTime="2026-05-26 11:51:00.223370857 +0000 UTC m=+166.100369060" May 26 11:51:00.239707 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:00.239640 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-nn9d2" podStartSLOduration=130.235834408 podStartE2EDuration="2m12.23962338s" podCreationTimestamp="2026-05-26 11:48:48 +0000 UTC" firstStartedPulling="2026-05-26 11:50:57.172316088 +0000 UTC m=+163.049314285" lastFinishedPulling="2026-05-26 11:50:59.176105058 +0000 UTC m=+165.053103257" observedRunningTime="2026-05-26 11:51:00.23829043 +0000 UTC m=+166.115288644" watchObservedRunningTime="2026-05-26 11:51:00.23962338 +0000 UTC m=+166.116621594" May 26 11:51:02.495725 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.495681 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f8d79fffb-7z64p"] May 26 11:51:02.523806 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.523777 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8d79fffb-7z64p"] May 26 11:51:02.523964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.523907 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.528875 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.528596 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 26 11:51:02.528875 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.528650 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 26 11:51:02.528875 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.528688 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 26 11:51:02.528875 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.528608 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 26 11:51:02.528875 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.528652 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 26 11:51:02.528875 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.528604 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m86vv\"" May 26 11:51:02.621780 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.621696 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-config\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.621780 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.621743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-oauth-config\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.621780 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.621773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-service-ca\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.622159 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.621863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfrgc\" (UniqueName: \"kubernetes.io/projected/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-kube-api-access-tfrgc\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.622159 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.621916 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-serving-cert\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.622159 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.621987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-oauth-serving-cert\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.722732 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.722705 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-config\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.722858 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.722738 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-oauth-config\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.722858 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.722762 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-service-ca\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.722967 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.722918 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfrgc\" (UniqueName: \"kubernetes.io/projected/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-kube-api-access-tfrgc\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.722967 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.722962 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-serving-cert\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.723148 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.723126 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-oauth-serving-cert\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.723537 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.723514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-config\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.723650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.723611 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-service-ca\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.723760 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.723736 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-oauth-serving-cert\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.725591 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.725566 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-oauth-config\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.725704 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.725689 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-serving-cert\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.730957 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.730936 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfrgc\" (UniqueName: \"kubernetes.io/projected/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-kube-api-access-tfrgc\") pod \"console-7f8d79fffb-7z64p\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.835429 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.835403 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:02.972030 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:02.971990 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8d79fffb-7z64p"] May 26 11:51:02.974798 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:51:02.974757 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1a42c_2e49_4e2f_8545_e0cf772e88fd.slice/crio-e8da47d5a93cebf755f94a8b2ff568fdf4f17c9913914cdbf42de15add5bd0c2 WatchSource:0}: Error finding container e8da47d5a93cebf755f94a8b2ff568fdf4f17c9913914cdbf42de15add5bd0c2: Status 404 returned error can't find the container with id e8da47d5a93cebf755f94a8b2ff568fdf4f17c9913914cdbf42de15add5bd0c2 May 26 11:51:03.220137 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:03.220060 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8d79fffb-7z64p" event={"ID":"dad1a42c-2e49-4e2f-8545-e0cf772e88fd","Type":"ContainerStarted","Data":"e8da47d5a93cebf755f94a8b2ff568fdf4f17c9913914cdbf42de15add5bd0c2"} May 26 11:51:10.217023 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:10.216945 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nn9d2" May 26 11:51:10.261536 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:10.259979 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-4qwcb" event={"ID":"3c910ff8-f0a0-45a6-95b3-300c8e96ebf0","Type":"ContainerStarted","Data":"fbbd3a66c7eca9ed75820183e06f1d4e952390049dbecbaf764b7794c9e069bd"} May 26 11:51:10.262096 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:10.262047 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-4qwcb" May 26 11:51:10.274768 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:10.274741 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-4qwcb" May 26 11:51:10.279841 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:10.278816 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-4qwcb" podStartSLOduration=1.189333328 podStartE2EDuration="17.278799009s" podCreationTimestamp="2026-05-26 11:50:53 +0000 UTC" firstStartedPulling="2026-05-26 11:50:53.813876373 +0000 UTC m=+159.690874564" lastFinishedPulling="2026-05-26 11:51:09.903342052 +0000 UTC m=+175.780340245" observedRunningTime="2026-05-26 11:51:10.278156443 +0000 UTC m=+176.155154655" watchObservedRunningTime="2026-05-26 11:51:10.278799009 +0000 UTC m=+176.155797223" May 26 11:51:11.274790 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.274700 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f7b899df9-pq2rg"] May 26 11:51:11.280130 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.280105 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.301282 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.301255 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7b899df9-pq2rg"] May 26 11:51:11.302114 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.302084 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 26 11:51:11.403046 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.403011 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-oauth-serving-cert\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.403218 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.403064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-service-ca\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.403218 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.403162 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-oauth-config\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.403218 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.403199 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-console-config\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.403377 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.403230 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-trusted-ca-bundle\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.403377 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.403270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhkz9\" (UniqueName: \"kubernetes.io/projected/d6114745-b5d6-4068-a607-a2324f9e0c79-kube-api-access-nhkz9\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.403377 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.403297 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-serving-cert\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.504366 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.504324 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-oauth-serving-cert\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.504622 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.504392 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-service-ca\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.504622 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.504465 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-oauth-config\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.504622 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.504507 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-console-config\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.504622 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.504539 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-trusted-ca-bundle\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.504622 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.504578 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhkz9\" (UniqueName: \"kubernetes.io/projected/d6114745-b5d6-4068-a607-a2324f9e0c79-kube-api-access-nhkz9\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.504622 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.504603 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-serving-cert\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.505373 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.505319 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-oauth-serving-cert\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.505543 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.505517 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-service-ca\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.506929 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.506880 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-console-config\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.507506 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.507458 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-trusted-ca-bundle\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.509831 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.509788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-oauth-config\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.512537 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.512493 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-serving-cert\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.514025 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.513993 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhkz9\" (UniqueName: \"kubernetes.io/projected/d6114745-b5d6-4068-a607-a2324f9e0c79-kube-api-access-nhkz9\") pod \"console-f7b899df9-pq2rg\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:11.602459 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:11.602400 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:12.924684 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:12.924651 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7b899df9-pq2rg"] May 26 11:51:12.927237 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:51:12.927207 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6114745_b5d6_4068_a607_a2324f9e0c79.slice/crio-0f1fcf5778a33dc2c0636bf3efbbc250061f02ffa03de3698d554a0668fd12a7 WatchSource:0}: Error finding container 0f1fcf5778a33dc2c0636bf3efbbc250061f02ffa03de3698d554a0668fd12a7: Status 404 returned error can't find the container with id 0f1fcf5778a33dc2c0636bf3efbbc250061f02ffa03de3698d554a0668fd12a7 May 26 11:51:13.273240 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:13.273202 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7b899df9-pq2rg" event={"ID":"d6114745-b5d6-4068-a607-a2324f9e0c79","Type":"ContainerStarted","Data":"0f1fcf5778a33dc2c0636bf3efbbc250061f02ffa03de3698d554a0668fd12a7"} May 26 11:51:14.278222 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:14.278183 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8d79fffb-7z64p" event={"ID":"dad1a42c-2e49-4e2f-8545-e0cf772e88fd","Type":"ContainerStarted","Data":"8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e"} May 26 11:51:14.279698 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:14.279672 2572 generic.go:358] "Generic (PLEG): container finished" podID="642ea59b-2b49-4db7-a9be-56e807229e4b" containerID="7929acf75165510624e8e747dd4ce80076e11efa14cd62888bff6d814f0208e8" exitCode=0 May 26 11:51:14.279804 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:14.279753 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" event={"ID":"642ea59b-2b49-4db7-a9be-56e807229e4b","Type":"ContainerDied","Data":"7929acf75165510624e8e747dd4ce80076e11efa14cd62888bff6d814f0208e8"} May 26 11:51:14.280162 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:14.280137 2572 scope.go:117] "RemoveContainer" containerID="7929acf75165510624e8e747dd4ce80076e11efa14cd62888bff6d814f0208e8" May 26 11:51:14.281304 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:14.281269 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7b899df9-pq2rg" event={"ID":"d6114745-b5d6-4068-a607-a2324f9e0c79","Type":"ContainerStarted","Data":"b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4"} May 26 11:51:14.298603 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:14.298548 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f8d79fffb-7z64p" podStartSLOduration=2.051135403 podStartE2EDuration="12.298534842s" podCreationTimestamp="2026-05-26 11:51:02 +0000 UTC" firstStartedPulling="2026-05-26 11:51:02.97713824 +0000 UTC m=+168.854136430" lastFinishedPulling="2026-05-26 11:51:13.224537667 +0000 UTC m=+179.101535869" observedRunningTime="2026-05-26 11:51:14.296347672 +0000 UTC m=+180.173345887" watchObservedRunningTime="2026-05-26 11:51:14.298534842 +0000 UTC m=+180.175533055" May 26 11:51:14.331533 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:14.331051 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f7b899df9-pq2rg" podStartSLOduration=2.740263274 podStartE2EDuration="3.331036046s" podCreationTimestamp="2026-05-26 11:51:11 +0000 UTC" firstStartedPulling="2026-05-26 11:51:12.929765784 +0000 UTC m=+178.806763985" lastFinishedPulling="2026-05-26 11:51:13.52053855 +0000 UTC m=+179.397536757" observedRunningTime="2026-05-26 11:51:14.330417113 +0000 UTC m=+180.207415327" watchObservedRunningTime="2026-05-26 11:51:14.331036046 +0000 UTC m=+180.208034260" May 26 11:51:15.242726 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:15.242687 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nn9d2_13ee2e51-8fcc-4333-88c2-d7aa45761280/dns/0.log" May 26 11:51:15.248645 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:15.248617 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nn9d2_13ee2e51-8fcc-4333-88c2-d7aa45761280/kube-rbac-proxy/0.log" May 26 11:51:15.286456 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:15.286401 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-v4hsc" event={"ID":"642ea59b-2b49-4db7-a9be-56e807229e4b","Type":"ContainerStarted","Data":"b70716d161f1ea99ba97ecca9607361e11f7d35c73103ef39035759722d292a0"} May 26 11:51:15.794834 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:15.794803 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-njbrp_5baf7ffa-54d0-4039-8f49-0f965fb6e6b5/dns-node-resolver/0.log" May 26 11:51:21.603361 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:21.603327 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:21.603855 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:21.603382 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:21.607922 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:21.607902 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:22.309218 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:22.309192 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:51:22.355432 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:22.355405 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8d79fffb-7z64p"] May 26 11:51:22.836240 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:22.836212 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:47.374537 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.374477 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f8d79fffb-7z64p" podUID="dad1a42c-2e49-4e2f-8545-e0cf772e88fd" containerName="console" containerID="cri-o://8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e" gracePeriod=15 May 26 11:51:47.658757 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.658738 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f8d79fffb-7z64p_dad1a42c-2e49-4e2f-8545-e0cf772e88fd/console/0.log" May 26 11:51:47.658855 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.658807 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:47.779848 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.779821 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-config\") pod \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " May 26 11:51:47.779985 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.779855 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-serving-cert\") pod \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " May 26 11:51:47.779985 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.779879 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-oauth-config\") pod \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " May 26 11:51:47.779985 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.779911 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfrgc\" (UniqueName: \"kubernetes.io/projected/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-kube-api-access-tfrgc\") pod \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " May 26 11:51:47.779985 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.779929 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-service-ca\") pod \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " May 26 11:51:47.779985 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.779947 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-oauth-serving-cert\") pod \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\" (UID: \"dad1a42c-2e49-4e2f-8545-e0cf772e88fd\") " May 26 11:51:47.780326 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.780269 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-config" (OuterVolumeSpecName: "console-config") pod "dad1a42c-2e49-4e2f-8545-e0cf772e88fd" (UID: "dad1a42c-2e49-4e2f-8545-e0cf772e88fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:51:47.780408 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.780375 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dad1a42c-2e49-4e2f-8545-e0cf772e88fd" (UID: "dad1a42c-2e49-4e2f-8545-e0cf772e88fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:51:47.780408 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.780379 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "dad1a42c-2e49-4e2f-8545-e0cf772e88fd" (UID: "dad1a42c-2e49-4e2f-8545-e0cf772e88fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:51:47.782092 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.782063 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dad1a42c-2e49-4e2f-8545-e0cf772e88fd" (UID: "dad1a42c-2e49-4e2f-8545-e0cf772e88fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:51:47.782183 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.782116 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dad1a42c-2e49-4e2f-8545-e0cf772e88fd" (UID: "dad1a42c-2e49-4e2f-8545-e0cf772e88fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:51:47.782183 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.782128 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-kube-api-access-tfrgc" (OuterVolumeSpecName: "kube-api-access-tfrgc") pod "dad1a42c-2e49-4e2f-8545-e0cf772e88fd" (UID: "dad1a42c-2e49-4e2f-8545-e0cf772e88fd"). InnerVolumeSpecName "kube-api-access-tfrgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:51:47.880519 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.880493 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfrgc\" (UniqueName: \"kubernetes.io/projected/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-kube-api-access-tfrgc\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:51:47.880519 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.880517 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-service-ca\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:51:47.880649 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.880527 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-oauth-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:51:47.880649 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.880536 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:51:47.880649 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.880545 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:51:47.880649 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:47.880553 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad1a42c-2e49-4e2f-8545-e0cf772e88fd-console-oauth-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:51:48.377449 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.377416 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f8d79fffb-7z64p_dad1a42c-2e49-4e2f-8545-e0cf772e88fd/console/0.log" May 26 11:51:48.377798 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.377465 2572 generic.go:358] "Generic (PLEG): container finished" podID="dad1a42c-2e49-4e2f-8545-e0cf772e88fd" containerID="8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e" exitCode=2 May 26 11:51:48.377798 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.377498 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8d79fffb-7z64p" event={"ID":"dad1a42c-2e49-4e2f-8545-e0cf772e88fd","Type":"ContainerDied","Data":"8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e"} May 26 11:51:48.377798 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.377519 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8d79fffb-7z64p" event={"ID":"dad1a42c-2e49-4e2f-8545-e0cf772e88fd","Type":"ContainerDied","Data":"e8da47d5a93cebf755f94a8b2ff568fdf4f17c9913914cdbf42de15add5bd0c2"} May 26 11:51:48.377798 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.377534 2572 scope.go:117] "RemoveContainer" containerID="8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e" May 26 11:51:48.377798 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.377554 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8d79fffb-7z64p" May 26 11:51:48.385630 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.385605 2572 scope.go:117] "RemoveContainer" containerID="8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e" May 26 11:51:48.385945 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:51:48.385922 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e\": container with ID starting with 8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e not found: ID does not exist" containerID="8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e" May 26 11:51:48.386019 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.385952 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e"} err="failed to get container status \"8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e\": rpc error: code = NotFound desc = could not find container \"8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e\": container with ID starting with 8de592479ace010293166fa188faa1971cc6824c9cf54ca4de3efa01fca4736e not found: ID does not exist" May 26 11:51:48.398315 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.398294 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8d79fffb-7z64p"] May 26 11:51:48.401897 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.401881 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f8d79fffb-7z64p"] May 26 11:51:48.696433 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:51:48.696379 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dad1a42c-2e49-4e2f-8545-e0cf772e88fd" path="/var/lib/kubelet/pods/dad1a42c-2e49-4e2f-8545-e0cf772e88fd/volumes" May 26 11:52:09.531346 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.531314 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84d8d5bc7f-pp7zd"] May 26 11:52:09.532371 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.532347 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dad1a42c-2e49-4e2f-8545-e0cf772e88fd" containerName="console" May 26 11:52:09.532540 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.532524 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dad1a42c-2e49-4e2f-8545-e0cf772e88fd" containerName="console" May 26 11:52:09.532744 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.532729 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="dad1a42c-2e49-4e2f-8545-e0cf772e88fd" containerName="console" May 26 11:52:09.534706 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.534687 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.545958 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.545929 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84d8d5bc7f-pp7zd"] May 26 11:52:09.612549 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.612520 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-console-config\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.612656 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.612570 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-serving-cert\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.612656 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.612618 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sx49\" (UniqueName: \"kubernetes.io/projected/0c020965-83be-4084-9442-a835588d0752-kube-api-access-4sx49\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.612656 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.612646 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-oauth-serving-cert\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.612786 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.612688 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-oauth-config\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.612786 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.612722 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-service-ca\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.612786 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.612753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-trusted-ca-bundle\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.713047 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713021 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-trusted-ca-bundle\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.713141 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713052 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-console-config\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.713141 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713075 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-serving-cert\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.713141 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713119 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sx49\" (UniqueName: \"kubernetes.io/projected/0c020965-83be-4084-9442-a835588d0752-kube-api-access-4sx49\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.713301 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713147 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-oauth-serving-cert\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.713301 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713177 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-oauth-config\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.713301 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713207 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-service-ca\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.713923 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713899 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-console-config\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.714025 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713953 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-service-ca\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.714025 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713986 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-trusted-ca-bundle\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.714025 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.713989 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-oauth-serving-cert\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.715493 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.715463 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-oauth-config\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.715619 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.715601 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-serving-cert\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.721626 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.721606 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sx49\" (UniqueName: \"kubernetes.io/projected/0c020965-83be-4084-9442-a835588d0752-kube-api-access-4sx49\") pod \"console-84d8d5bc7f-pp7zd\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.845165 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.845143 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:09.965595 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:09.965570 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84d8d5bc7f-pp7zd"] May 26 11:52:09.967658 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:52:09.967630 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c020965_83be_4084_9442_a835588d0752.slice/crio-4b25f412c82a6240b924a32cc463d5933ddf2816e43157de3b0c7aabd68d46e3 WatchSource:0}: Error finding container 4b25f412c82a6240b924a32cc463d5933ddf2816e43157de3b0c7aabd68d46e3: Status 404 returned error can't find the container with id 4b25f412c82a6240b924a32cc463d5933ddf2816e43157de3b0c7aabd68d46e3 May 26 11:52:10.436644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:10.436614 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d8d5bc7f-pp7zd" event={"ID":"0c020965-83be-4084-9442-a835588d0752","Type":"ContainerStarted","Data":"b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62"} May 26 11:52:10.436644 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:10.436647 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d8d5bc7f-pp7zd" event={"ID":"0c020965-83be-4084-9442-a835588d0752","Type":"ContainerStarted","Data":"4b25f412c82a6240b924a32cc463d5933ddf2816e43157de3b0c7aabd68d46e3"} May 26 11:52:10.456294 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:10.456249 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84d8d5bc7f-pp7zd" podStartSLOduration=1.4562351119999999 podStartE2EDuration="1.456235112s" podCreationTimestamp="2026-05-26 11:52:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:52:10.455038238 +0000 UTC m=+236.332036455" watchObservedRunningTime="2026-05-26 11:52:10.456235112 +0000 UTC m=+236.333233324" May 26 11:52:19.845880 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:19.845847 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:19.845880 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:19.845882 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:19.850563 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:19.850542 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:20.467148 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:20.467122 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:52:20.512178 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:20.512153 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f7b899df9-pq2rg"] May 26 11:52:45.535348 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.535272 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f7b899df9-pq2rg" podUID="d6114745-b5d6-4068-a607-a2324f9e0c79" containerName="console" containerID="cri-o://b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4" gracePeriod=15 May 26 11:52:45.785495 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.785426 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f7b899df9-pq2rg_d6114745-b5d6-4068-a607-a2324f9e0c79/console/0.log" May 26 11:52:45.785588 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.785504 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:52:45.850700 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.850668 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-service-ca\") pod \"d6114745-b5d6-4068-a607-a2324f9e0c79\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " May 26 11:52:45.850850 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.850730 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-oauth-config\") pod \"d6114745-b5d6-4068-a607-a2324f9e0c79\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " May 26 11:52:45.850850 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.850760 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-serving-cert\") pod \"d6114745-b5d6-4068-a607-a2324f9e0c79\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " May 26 11:52:45.850850 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.850785 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhkz9\" (UniqueName: \"kubernetes.io/projected/d6114745-b5d6-4068-a607-a2324f9e0c79-kube-api-access-nhkz9\") pod \"d6114745-b5d6-4068-a607-a2324f9e0c79\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " May 26 11:52:45.850850 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.850813 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-trusted-ca-bundle\") pod \"d6114745-b5d6-4068-a607-a2324f9e0c79\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " May 26 11:52:45.851048 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.850865 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-oauth-serving-cert\") pod \"d6114745-b5d6-4068-a607-a2324f9e0c79\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " May 26 11:52:45.851048 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.850889 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-console-config\") pod \"d6114745-b5d6-4068-a607-a2324f9e0c79\" (UID: \"d6114745-b5d6-4068-a607-a2324f9e0c79\") " May 26 11:52:45.851203 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.851073 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6114745-b5d6-4068-a607-a2324f9e0c79" (UID: "d6114745-b5d6-4068-a607-a2324f9e0c79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:52:45.851273 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.851230 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6114745-b5d6-4068-a607-a2324f9e0c79" (UID: "d6114745-b5d6-4068-a607-a2324f9e0c79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:52:45.851375 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.851350 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d6114745-b5d6-4068-a607-a2324f9e0c79" (UID: "d6114745-b5d6-4068-a607-a2324f9e0c79"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:52:45.851459 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.851412 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-console-config" (OuterVolumeSpecName: "console-config") pod "d6114745-b5d6-4068-a607-a2324f9e0c79" (UID: "d6114745-b5d6-4068-a607-a2324f9e0c79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:52:45.857567 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.857418 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6114745-b5d6-4068-a607-a2324f9e0c79" (UID: "d6114745-b5d6-4068-a607-a2324f9e0c79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:52:45.857686 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.857584 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6114745-b5d6-4068-a607-a2324f9e0c79-kube-api-access-nhkz9" (OuterVolumeSpecName: "kube-api-access-nhkz9") pod "d6114745-b5d6-4068-a607-a2324f9e0c79" (UID: "d6114745-b5d6-4068-a607-a2324f9e0c79"). InnerVolumeSpecName "kube-api-access-nhkz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:52:45.857686 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.857595 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6114745-b5d6-4068-a607-a2324f9e0c79" (UID: "d6114745-b5d6-4068-a607-a2324f9e0c79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:52:45.951840 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.951813 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-oauth-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:52:45.951840 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.951837 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6114745-b5d6-4068-a607-a2324f9e0c79-console-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:52:45.952021 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.951850 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhkz9\" (UniqueName: \"kubernetes.io/projected/d6114745-b5d6-4068-a607-a2324f9e0c79-kube-api-access-nhkz9\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:52:45.952021 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.951863 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-trusted-ca-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:52:45.952021 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.951875 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-oauth-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:52:45.952021 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.951888 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-console-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:52:45.952021 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:45.951900 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6114745-b5d6-4068-a607-a2324f9e0c79-service-ca\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:52:46.538156 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.538137 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f7b899df9-pq2rg_d6114745-b5d6-4068-a607-a2324f9e0c79/console/0.log" May 26 11:52:46.538605 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.538171 2572 generic.go:358] "Generic (PLEG): container finished" podID="d6114745-b5d6-4068-a607-a2324f9e0c79" containerID="b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4" exitCode=2 May 26 11:52:46.538605 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.538241 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7b899df9-pq2rg" event={"ID":"d6114745-b5d6-4068-a607-a2324f9e0c79","Type":"ContainerDied","Data":"b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4"} May 26 11:52:46.538605 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.538267 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7b899df9-pq2rg" event={"ID":"d6114745-b5d6-4068-a607-a2324f9e0c79","Type":"ContainerDied","Data":"0f1fcf5778a33dc2c0636bf3efbbc250061f02ffa03de3698d554a0668fd12a7"} May 26 11:52:46.538605 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.538282 2572 scope.go:117] "RemoveContainer" containerID="b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4" May 26 11:52:46.538605 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.538284 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7b899df9-pq2rg" May 26 11:52:46.546368 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.546350 2572 scope.go:117] "RemoveContainer" containerID="b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4" May 26 11:52:46.546627 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:52:46.546610 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4\": container with ID starting with b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4 not found: ID does not exist" containerID="b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4" May 26 11:52:46.546702 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.546634 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4"} err="failed to get container status \"b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4\": rpc error: code = NotFound desc = could not find container \"b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4\": container with ID starting with b9495a63a8f5d8538e85eebd58cbedb7bda0c7b5b49e816f3309895cddc516e4 not found: ID does not exist" May 26 11:52:46.559147 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.559128 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f7b899df9-pq2rg"] May 26 11:52:46.561777 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.561756 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f7b899df9-pq2rg"] May 26 11:52:46.696531 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:52:46.696502 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6114745-b5d6-4068-a607-a2324f9e0c79" path="/var/lib/kubelet/pods/d6114745-b5d6-4068-a607-a2324f9e0c79/volumes" May 26 11:53:14.604691 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:14.604664 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/2.log" May 26 11:53:14.608315 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:14.608291 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/2.log" May 26 11:53:14.610210 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:14.610186 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/0.log" May 26 11:53:14.614091 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:14.614065 2572 kubelet.go:1628] "Image garbage collection succeeded" May 26 11:53:14.614250 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:14.614234 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/0.log" May 26 11:53:22.263433 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.263399 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-cf8468996-5t9dk"] May 26 11:53:22.265119 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.263678 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6114745-b5d6-4068-a607-a2324f9e0c79" containerName="console" May 26 11:53:22.265119 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.263690 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6114745-b5d6-4068-a607-a2324f9e0c79" containerName="console" May 26 11:53:22.265119 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.263741 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6114745-b5d6-4068-a607-a2324f9e0c79" containerName="console" May 26 11:53:22.265467 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.265431 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.285663 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.285641 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf8468996-5t9dk"] May 26 11:53:22.402841 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.402796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6px9\" (UniqueName: \"kubernetes.io/projected/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-kube-api-access-q6px9\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.402982 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.402853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-console-serving-cert\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.402982 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.402870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-oauth-serving-cert\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.402982 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.402930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-trusted-ca-bundle\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.402982 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.402973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-service-ca\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.403112 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.403006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-console-config\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.403112 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.403067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-console-oauth-config\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.504042 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.504011 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-console-config\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.504189 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.504052 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-console-oauth-config\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.504189 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.504168 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6px9\" (UniqueName: \"kubernetes.io/projected/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-kube-api-access-q6px9\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.504298 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.504213 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-console-serving-cert\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.504356 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.504326 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-oauth-serving-cert\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.504409 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.504376 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-trusted-ca-bundle\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.504513 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.504416 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-service-ca\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.504756 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.504732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-console-config\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.505011 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.504990 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-oauth-serving-cert\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.505141 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.505120 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-service-ca\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.505180 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.505154 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-trusted-ca-bundle\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.506520 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.506501 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-console-oauth-config\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.506574 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.506561 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-console-serving-cert\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.512841 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.512819 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6px9\" (UniqueName: \"kubernetes.io/projected/4ceefc4a-3de0-4dd6-a9e7-5301e5924043-kube-api-access-q6px9\") pod \"console-cf8468996-5t9dk\" (UID: \"4ceefc4a-3de0-4dd6-a9e7-5301e5924043\") " pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.574332 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.574308 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:22.697954 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.697930 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf8468996-5t9dk"] May 26 11:53:22.699884 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:53:22.699855 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ceefc4a_3de0_4dd6_a9e7_5301e5924043.slice/crio-8ce065f4195393517bff74ce7749c24ec95835123bceedc508dbbd496ff900fe WatchSource:0}: Error finding container 8ce065f4195393517bff74ce7749c24ec95835123bceedc508dbbd496ff900fe: Status 404 returned error can't find the container with id 8ce065f4195393517bff74ce7749c24ec95835123bceedc508dbbd496ff900fe May 26 11:53:22.701646 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:22.701631 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 11:53:23.640306 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:23.640273 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf8468996-5t9dk" event={"ID":"4ceefc4a-3de0-4dd6-a9e7-5301e5924043","Type":"ContainerStarted","Data":"18250bbeefcbb2eba22c4ac3743e8e56b76915342be96b13b6959261dc46f95f"} May 26 11:53:23.640306 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:23.640311 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf8468996-5t9dk" event={"ID":"4ceefc4a-3de0-4dd6-a9e7-5301e5924043","Type":"ContainerStarted","Data":"8ce065f4195393517bff74ce7749c24ec95835123bceedc508dbbd496ff900fe"} May 26 11:53:23.659642 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:23.659566 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-cf8468996-5t9dk" podStartSLOduration=1.659549747 podStartE2EDuration="1.659549747s" podCreationTimestamp="2026-05-26 11:53:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:53:23.658328485 +0000 UTC m=+309.535326708" watchObservedRunningTime="2026-05-26 11:53:23.659549747 +0000 UTC m=+309.536547962" May 26 11:53:32.574684 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:32.574652 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:32.575064 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:32.574693 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:32.579055 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:32.579034 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:32.671094 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:32.671069 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cf8468996-5t9dk" May 26 11:53:32.715951 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:32.715926 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84d8d5bc7f-pp7zd"] May 26 11:53:57.739716 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:57.739650 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-84d8d5bc7f-pp7zd" podUID="0c020965-83be-4084-9442-a835588d0752" containerName="console" containerID="cri-o://b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62" gracePeriod=15 May 26 11:53:57.975519 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:57.975499 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84d8d5bc7f-pp7zd_0c020965-83be-4084-9442-a835588d0752/console/0.log" May 26 11:53:57.975627 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:57.975556 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:53:58.154306 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154281 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-oauth-config\") pod \"0c020965-83be-4084-9442-a835588d0752\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " May 26 11:53:58.154463 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154315 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-serving-cert\") pod \"0c020965-83be-4084-9442-a835588d0752\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " May 26 11:53:58.154463 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154342 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-console-config\") pod \"0c020965-83be-4084-9442-a835588d0752\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " May 26 11:53:58.154463 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154359 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-trusted-ca-bundle\") pod \"0c020965-83be-4084-9442-a835588d0752\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " May 26 11:53:58.154463 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154376 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-oauth-serving-cert\") pod \"0c020965-83be-4084-9442-a835588d0752\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " May 26 11:53:58.154463 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154423 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-service-ca\") pod \"0c020965-83be-4084-9442-a835588d0752\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " May 26 11:53:58.154736 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154470 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sx49\" (UniqueName: \"kubernetes.io/projected/0c020965-83be-4084-9442-a835588d0752-kube-api-access-4sx49\") pod \"0c020965-83be-4084-9442-a835588d0752\" (UID: \"0c020965-83be-4084-9442-a835588d0752\") " May 26 11:53:58.154829 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154801 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-console-config" (OuterVolumeSpecName: "console-config") pod "0c020965-83be-4084-9442-a835588d0752" (UID: "0c020965-83be-4084-9442-a835588d0752"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:53:58.154829 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154812 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c020965-83be-4084-9442-a835588d0752" (UID: "0c020965-83be-4084-9442-a835588d0752"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:53:58.154945 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154821 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c020965-83be-4084-9442-a835588d0752" (UID: "0c020965-83be-4084-9442-a835588d0752"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:53:58.154945 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.154834 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c020965-83be-4084-9442-a835588d0752" (UID: "0c020965-83be-4084-9442-a835588d0752"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:53:58.156393 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.156368 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c020965-83be-4084-9442-a835588d0752" (UID: "0c020965-83be-4084-9442-a835588d0752"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:53:58.156486 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.156391 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c020965-83be-4084-9442-a835588d0752" (UID: "0c020965-83be-4084-9442-a835588d0752"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:53:58.156587 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.156568 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c020965-83be-4084-9442-a835588d0752-kube-api-access-4sx49" (OuterVolumeSpecName: "kube-api-access-4sx49") pod "0c020965-83be-4084-9442-a835588d0752" (UID: "0c020965-83be-4084-9442-a835588d0752"). InnerVolumeSpecName "kube-api-access-4sx49". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:53:58.254902 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.254876 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-console-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:53:58.254902 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.254898 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-trusted-ca-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:53:58.255023 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.254907 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-oauth-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:53:58.255023 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.254917 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c020965-83be-4084-9442-a835588d0752-service-ca\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:53:58.255023 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.254926 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sx49\" (UniqueName: \"kubernetes.io/projected/0c020965-83be-4084-9442-a835588d0752-kube-api-access-4sx49\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:53:58.255023 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.254934 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-oauth-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:53:58.255023 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.254942 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c020965-83be-4084-9442-a835588d0752-console-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:53:58.731906 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.731882 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84d8d5bc7f-pp7zd_0c020965-83be-4084-9442-a835588d0752/console/0.log" May 26 11:53:58.732040 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.731921 2572 generic.go:358] "Generic (PLEG): container finished" podID="0c020965-83be-4084-9442-a835588d0752" containerID="b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62" exitCode=2 May 26 11:53:58.732040 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.731949 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d8d5bc7f-pp7zd" event={"ID":"0c020965-83be-4084-9442-a835588d0752","Type":"ContainerDied","Data":"b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62"} May 26 11:53:58.732040 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.731971 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d8d5bc7f-pp7zd" event={"ID":"0c020965-83be-4084-9442-a835588d0752","Type":"ContainerDied","Data":"4b25f412c82a6240b924a32cc463d5933ddf2816e43157de3b0c7aabd68d46e3"} May 26 11:53:58.732040 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.731968 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d8d5bc7f-pp7zd" May 26 11:53:58.732040 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.731989 2572 scope.go:117] "RemoveContainer" containerID="b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62" May 26 11:53:58.739655 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.739638 2572 scope.go:117] "RemoveContainer" containerID="b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62" May 26 11:53:58.739910 ip-10-0-140-83 kubenswrapper[2572]: E0526 11:53:58.739892 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62\": container with ID starting with b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62 not found: ID does not exist" containerID="b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62" May 26 11:53:58.740146 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.739922 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62"} err="failed to get container status \"b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62\": rpc error: code = NotFound desc = could not find container \"b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62\": container with ID starting with b6a1bcd1cf08c8ad72108de7f02ba73915b0f4d622285be94d18e9d8be814a62 not found: ID does not exist" May 26 11:53:58.749688 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.749654 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84d8d5bc7f-pp7zd"] May 26 11:53:58.753098 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:53:58.753077 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84d8d5bc7f-pp7zd"] May 26 11:54:00.696787 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:00.696754 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c020965-83be-4084-9442-a835588d0752" path="/var/lib/kubelet/pods/0c020965-83be-4084-9442-a835588d0752/volumes" May 26 11:54:20.402988 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.402954 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff"] May 26 11:54:20.403384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.403254 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c020965-83be-4084-9442-a835588d0752" containerName="console" May 26 11:54:20.403384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.403265 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c020965-83be-4084-9442-a835588d0752" containerName="console" May 26 11:54:20.403384 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.403331 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c020965-83be-4084-9442-a835588d0752" containerName="console" May 26 11:54:20.406163 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.406144 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.408825 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.408807 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 26 11:54:20.408945 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.408885 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 26 11:54:20.410232 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.410218 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kmhnq\"" May 26 11:54:20.414520 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.414496 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff"] May 26 11:54:20.499036 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.499014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.499138 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.499059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.499178 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.499157 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j82hh\" (UniqueName: \"kubernetes.io/projected/9a02a1c4-394a-4063-b5b3-e3949116356e-kube-api-access-j82hh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.599493 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.599466 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j82hh\" (UniqueName: \"kubernetes.io/projected/9a02a1c4-394a-4063-b5b3-e3949116356e-kube-api-access-j82hh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.599603 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.599499 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.599603 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.599535 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.599831 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.599814 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.599880 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.599853 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.608050 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.608026 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j82hh\" (UniqueName: \"kubernetes.io/projected/9a02a1c4-394a-4063-b5b3-e3949116356e-kube-api-access-j82hh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.715897 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.715844 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:20.838549 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:20.838523 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff"] May 26 11:54:20.840281 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:54:20.840248 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a02a1c4_394a_4063_b5b3_e3949116356e.slice/crio-7a69c9a9c19911eea628720b08881fbd1ee26b2b65c11063cfccc31dc44b4024 WatchSource:0}: Error finding container 7a69c9a9c19911eea628720b08881fbd1ee26b2b65c11063cfccc31dc44b4024: Status 404 returned error can't find the container with id 7a69c9a9c19911eea628720b08881fbd1ee26b2b65c11063cfccc31dc44b4024 May 26 11:54:21.791216 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:21.791176 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" event={"ID":"9a02a1c4-394a-4063-b5b3-e3949116356e","Type":"ContainerStarted","Data":"7a69c9a9c19911eea628720b08881fbd1ee26b2b65c11063cfccc31dc44b4024"} May 26 11:54:26.805318 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:26.805285 2572 generic.go:358] "Generic (PLEG): container finished" podID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerID="dd1eb9a356d8f4573d0dbee422d46b928030decfc5de244da267acce10db6743" exitCode=0 May 26 11:54:26.805764 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:26.805321 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" event={"ID":"9a02a1c4-394a-4063-b5b3-e3949116356e","Type":"ContainerDied","Data":"dd1eb9a356d8f4573d0dbee422d46b928030decfc5de244da267acce10db6743"} May 26 11:54:29.817009 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:29.816975 2572 generic.go:358] "Generic (PLEG): container finished" podID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerID="dee2f9ac652888ac8071a2e6b56b0e2fc6c213fca1d36921b4fca5fc032d68d4" exitCode=0 May 26 11:54:29.817408 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:29.817036 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" event={"ID":"9a02a1c4-394a-4063-b5b3-e3949116356e","Type":"ContainerDied","Data":"dee2f9ac652888ac8071a2e6b56b0e2fc6c213fca1d36921b4fca5fc032d68d4"} May 26 11:54:35.835461 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:35.835402 2572 generic.go:358] "Generic (PLEG): container finished" podID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerID="58cf5560cbdb79307273880f8bea9f8392f0d8769d226b72bc9c685c7245c64c" exitCode=0 May 26 11:54:35.835827 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:35.835489 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" event={"ID":"9a02a1c4-394a-4063-b5b3-e3949116356e","Type":"ContainerDied","Data":"58cf5560cbdb79307273880f8bea9f8392f0d8769d226b72bc9c685c7245c64c"} May 26 11:54:36.955467 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:36.955428 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:37.032515 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.032491 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-bundle\") pod \"9a02a1c4-394a-4063-b5b3-e3949116356e\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " May 26 11:54:37.032626 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.032531 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j82hh\" (UniqueName: \"kubernetes.io/projected/9a02a1c4-394a-4063-b5b3-e3949116356e-kube-api-access-j82hh\") pod \"9a02a1c4-394a-4063-b5b3-e3949116356e\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " May 26 11:54:37.032626 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.032591 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-util\") pod \"9a02a1c4-394a-4063-b5b3-e3949116356e\" (UID: \"9a02a1c4-394a-4063-b5b3-e3949116356e\") " May 26 11:54:37.033215 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.033187 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-bundle" (OuterVolumeSpecName: "bundle") pod "9a02a1c4-394a-4063-b5b3-e3949116356e" (UID: "9a02a1c4-394a-4063-b5b3-e3949116356e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 11:54:37.034625 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.034601 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a02a1c4-394a-4063-b5b3-e3949116356e-kube-api-access-j82hh" (OuterVolumeSpecName: "kube-api-access-j82hh") pod "9a02a1c4-394a-4063-b5b3-e3949116356e" (UID: "9a02a1c4-394a-4063-b5b3-e3949116356e"). InnerVolumeSpecName "kube-api-access-j82hh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:54:37.036852 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.036812 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-util" (OuterVolumeSpecName: "util") pod "9a02a1c4-394a-4063-b5b3-e3949116356e" (UID: "9a02a1c4-394a-4063-b5b3-e3949116356e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 11:54:37.133983 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.133934 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:54:37.133983 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.133954 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j82hh\" (UniqueName: \"kubernetes.io/projected/9a02a1c4-394a-4063-b5b3-e3949116356e-kube-api-access-j82hh\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:54:37.133983 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.133965 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a02a1c4-394a-4063-b5b3-e3949116356e-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:54:37.842774 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.842744 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" event={"ID":"9a02a1c4-394a-4063-b5b3-e3949116356e","Type":"ContainerDied","Data":"7a69c9a9c19911eea628720b08881fbd1ee26b2b65c11063cfccc31dc44b4024"} May 26 11:54:37.842774 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.842777 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a69c9a9c19911eea628720b08881fbd1ee26b2b65c11063cfccc31dc44b4024" May 26 11:54:37.842964 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:37.842792 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcm5ff" May 26 11:54:43.379913 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.379878 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z"] May 26 11:54:43.380259 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.380148 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerName="pull" May 26 11:54:43.380259 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.380158 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerName="pull" May 26 11:54:43.380259 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.380165 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerName="extract" May 26 11:54:43.380259 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.380171 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerName="extract" May 26 11:54:43.380259 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.380182 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerName="util" May 26 11:54:43.380259 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.380188 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerName="util" May 26 11:54:43.380259 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.380240 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a02a1c4-394a-4063-b5b3-e3949116356e" containerName="extract" May 26 11:54:43.425075 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.425044 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z"] May 26 11:54:43.425211 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.425168 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" May 26 11:54:43.428520 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.428493 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vpkpg\"" May 26 11:54:43.428656 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.428556 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 26 11:54:43.428656 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.428610 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 26 11:54:43.478912 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.478882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f63a4eef-d403-4806-8341-e3473a7691d4-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-pbz5z\" (UID: \"f63a4eef-d403-4806-8341-e3473a7691d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" May 26 11:54:43.479016 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.478983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcf55\" (UniqueName: \"kubernetes.io/projected/f63a4eef-d403-4806-8341-e3473a7691d4-kube-api-access-pcf55\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-pbz5z\" (UID: \"f63a4eef-d403-4806-8341-e3473a7691d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" May 26 11:54:43.579399 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.579373 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcf55\" (UniqueName: \"kubernetes.io/projected/f63a4eef-d403-4806-8341-e3473a7691d4-kube-api-access-pcf55\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-pbz5z\" (UID: \"f63a4eef-d403-4806-8341-e3473a7691d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" May 26 11:54:43.579531 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.579416 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f63a4eef-d403-4806-8341-e3473a7691d4-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-pbz5z\" (UID: \"f63a4eef-d403-4806-8341-e3473a7691d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" May 26 11:54:43.579734 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.579718 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f63a4eef-d403-4806-8341-e3473a7691d4-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-pbz5z\" (UID: \"f63a4eef-d403-4806-8341-e3473a7691d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" May 26 11:54:43.588227 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.588208 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcf55\" (UniqueName: \"kubernetes.io/projected/f63a4eef-d403-4806-8341-e3473a7691d4-kube-api-access-pcf55\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-pbz5z\" (UID: \"f63a4eef-d403-4806-8341-e3473a7691d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" May 26 11:54:43.733547 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.733487 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" May 26 11:54:43.860166 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:43.860068 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z"] May 26 11:54:43.862813 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:54:43.862782 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63a4eef_d403_4806_8341_e3473a7691d4.slice/crio-d91ee8df7d0e4b6d558a8d276c3d29d725fa5cd05f8283bec6ce4d1767dcd7c2 WatchSource:0}: Error finding container d91ee8df7d0e4b6d558a8d276c3d29d725fa5cd05f8283bec6ce4d1767dcd7c2: Status 404 returned error can't find the container with id d91ee8df7d0e4b6d558a8d276c3d29d725fa5cd05f8283bec6ce4d1767dcd7c2 May 26 11:54:44.867090 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:44.867034 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" event={"ID":"f63a4eef-d403-4806-8341-e3473a7691d4","Type":"ContainerStarted","Data":"d91ee8df7d0e4b6d558a8d276c3d29d725fa5cd05f8283bec6ce4d1767dcd7c2"} May 26 11:54:45.871900 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:45.871865 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" event={"ID":"f63a4eef-d403-4806-8341-e3473a7691d4","Type":"ContainerStarted","Data":"9b3cd7078537fd3d6066780af3e5cc8588a1cf29f97eb54950f9b24f014f300d"} May 26 11:54:45.896741 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:45.896686 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-pbz5z" podStartSLOduration=1.36927562 podStartE2EDuration="2.896668841s" podCreationTimestamp="2026-05-26 11:54:43 +0000 UTC" firstStartedPulling="2026-05-26 11:54:43.865265838 +0000 UTC m=+389.742264029" lastFinishedPulling="2026-05-26 11:54:45.392659059 +0000 UTC m=+391.269657250" observedRunningTime="2026-05-26 11:54:45.894372999 +0000 UTC m=+391.771371213" watchObservedRunningTime="2026-05-26 11:54:45.896668841 +0000 UTC m=+391.773667055" May 26 11:54:48.129311 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.129281 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-v6t7z"] May 26 11:54:48.131562 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.131545 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:54:48.134226 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.134203 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 26 11:54:48.135508 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.135492 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8mkm4\"" May 26 11:54:48.135619 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.135604 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 26 11:54:48.142378 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.142357 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-v6t7z"] May 26 11:54:48.214658 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.214637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k8ck\" (UniqueName: \"kubernetes.io/projected/cbe8be4d-156b-4e9c-94be-8996f56018de-kube-api-access-4k8ck\") pod \"cert-manager-webhook-587ccfb98-v6t7z\" (UID: \"cbe8be4d-156b-4e9c-94be-8996f56018de\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:54:48.214764 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.214698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbe8be4d-156b-4e9c-94be-8996f56018de-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-v6t7z\" (UID: \"cbe8be4d-156b-4e9c-94be-8996f56018de\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:54:48.315336 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.315310 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbe8be4d-156b-4e9c-94be-8996f56018de-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-v6t7z\" (UID: \"cbe8be4d-156b-4e9c-94be-8996f56018de\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:54:48.315425 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.315351 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8ck\" (UniqueName: \"kubernetes.io/projected/cbe8be4d-156b-4e9c-94be-8996f56018de-kube-api-access-4k8ck\") pod \"cert-manager-webhook-587ccfb98-v6t7z\" (UID: \"cbe8be4d-156b-4e9c-94be-8996f56018de\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:54:48.327121 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.327101 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbe8be4d-156b-4e9c-94be-8996f56018de-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-v6t7z\" (UID: \"cbe8be4d-156b-4e9c-94be-8996f56018de\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:54:48.327206 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.327151 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k8ck\" (UniqueName: \"kubernetes.io/projected/cbe8be4d-156b-4e9c-94be-8996f56018de-kube-api-access-4k8ck\") pod \"cert-manager-webhook-587ccfb98-v6t7z\" (UID: \"cbe8be4d-156b-4e9c-94be-8996f56018de\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:54:48.448788 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.448735 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:54:48.570388 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.570358 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-v6t7z"] May 26 11:54:48.572636 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:54:48.572596 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbe8be4d_156b_4e9c_94be_8996f56018de.slice/crio-904e3c323d3d71a1068d083e96c4b6294498c3e746b5e1c283006889fba2e9fc WatchSource:0}: Error finding container 904e3c323d3d71a1068d083e96c4b6294498c3e746b5e1c283006889fba2e9fc: Status 404 returned error can't find the container with id 904e3c323d3d71a1068d083e96c4b6294498c3e746b5e1c283006889fba2e9fc May 26 11:54:48.880883 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:48.880848 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" event={"ID":"cbe8be4d-156b-4e9c-94be-8996f56018de","Type":"ContainerStarted","Data":"904e3c323d3d71a1068d083e96c4b6294498c3e746b5e1c283006889fba2e9fc"} May 26 11:54:51.801630 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:51.801592 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-z8t5l"] May 26 11:54:51.804361 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:51.804339 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" May 26 11:54:51.807192 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:51.807167 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-q59dz\"" May 26 11:54:51.815782 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:51.815745 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-z8t5l"] May 26 11:54:51.945401 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:51.945315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/500483bf-2d2e-4372-8ffc-5f1f38a2d512-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-z8t5l\" (UID: \"500483bf-2d2e-4372-8ffc-5f1f38a2d512\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" May 26 11:54:51.945401 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:51.945365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kr7v\" (UniqueName: \"kubernetes.io/projected/500483bf-2d2e-4372-8ffc-5f1f38a2d512-kube-api-access-7kr7v\") pod \"cert-manager-cainjector-68b757865b-z8t5l\" (UID: \"500483bf-2d2e-4372-8ffc-5f1f38a2d512\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" May 26 11:54:52.046315 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.046280 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/500483bf-2d2e-4372-8ffc-5f1f38a2d512-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-z8t5l\" (UID: \"500483bf-2d2e-4372-8ffc-5f1f38a2d512\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" May 26 11:54:52.046508 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.046325 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kr7v\" (UniqueName: \"kubernetes.io/projected/500483bf-2d2e-4372-8ffc-5f1f38a2d512-kube-api-access-7kr7v\") pod \"cert-manager-cainjector-68b757865b-z8t5l\" (UID: \"500483bf-2d2e-4372-8ffc-5f1f38a2d512\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" May 26 11:54:52.055529 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.055501 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/500483bf-2d2e-4372-8ffc-5f1f38a2d512-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-z8t5l\" (UID: \"500483bf-2d2e-4372-8ffc-5f1f38a2d512\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" May 26 11:54:52.055661 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.055639 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kr7v\" (UniqueName: \"kubernetes.io/projected/500483bf-2d2e-4372-8ffc-5f1f38a2d512-kube-api-access-7kr7v\") pod \"cert-manager-cainjector-68b757865b-z8t5l\" (UID: \"500483bf-2d2e-4372-8ffc-5f1f38a2d512\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" May 26 11:54:52.119737 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.119710 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" May 26 11:54:52.367820 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.367794 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-z8t5l"] May 26 11:54:52.370409 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:54:52.370385 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod500483bf_2d2e_4372_8ffc_5f1f38a2d512.slice/crio-c21b98b6f92c00491ee86696c9ff93f4701ec0f696c03c07c30d0220c87efbce WatchSource:0}: Error finding container c21b98b6f92c00491ee86696c9ff93f4701ec0f696c03c07c30d0220c87efbce: Status 404 returned error can't find the container with id c21b98b6f92c00491ee86696c9ff93f4701ec0f696c03c07c30d0220c87efbce May 26 11:54:52.894035 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.893995 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" event={"ID":"500483bf-2d2e-4372-8ffc-5f1f38a2d512","Type":"ContainerStarted","Data":"d1973908b7fa554c73489437091534bdae15d250a80a32bbe8997316b415120e"} May 26 11:54:52.894035 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.894036 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" event={"ID":"500483bf-2d2e-4372-8ffc-5f1f38a2d512","Type":"ContainerStarted","Data":"c21b98b6f92c00491ee86696c9ff93f4701ec0f696c03c07c30d0220c87efbce"} May 26 11:54:52.895368 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.895347 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" event={"ID":"cbe8be4d-156b-4e9c-94be-8996f56018de","Type":"ContainerStarted","Data":"cae0ad57d79b3fe4d4681528f039e46d6592537a7afbc876c137a8894e60bcd9"} May 26 11:54:52.895467 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.895383 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:54:52.911257 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.911219 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-z8t5l" podStartSLOduration=1.911207125 podStartE2EDuration="1.911207125s" podCreationTimestamp="2026-05-26 11:54:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:54:52.909744946 +0000 UTC m=+398.786743159" watchObservedRunningTime="2026-05-26 11:54:52.911207125 +0000 UTC m=+398.788205338" May 26 11:54:52.926553 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:52.926517 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" podStartSLOduration=1.225216029 podStartE2EDuration="4.926505288s" podCreationTimestamp="2026-05-26 11:54:48 +0000 UTC" firstStartedPulling="2026-05-26 11:54:48.574474363 +0000 UTC m=+394.451472553" lastFinishedPulling="2026-05-26 11:54:52.275763602 +0000 UTC m=+398.152761812" observedRunningTime="2026-05-26 11:54:52.925329897 +0000 UTC m=+398.802328113" watchObservedRunningTime="2026-05-26 11:54:52.926505288 +0000 UTC m=+398.803503500" May 26 11:54:58.901557 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:54:58.901526 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-v6t7z" May 26 11:55:05.989149 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:05.989107 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq"] May 26 11:55:06.004095 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.004064 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq"] May 26 11:55:06.004236 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.004095 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.007137 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.007117 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 26 11:55:06.007137 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.007133 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 26 11:55:06.008303 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.008285 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kmhnq\"" May 26 11:55:06.155063 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.155040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6n2b\" (UniqueName: \"kubernetes.io/projected/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-kube-api-access-d6n2b\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.155171 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.155090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.155216 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.155177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.256134 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.256074 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6n2b\" (UniqueName: \"kubernetes.io/projected/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-kube-api-access-d6n2b\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.256242 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.256154 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.256242 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.256199 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.256535 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.256516 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.256575 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.256541 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.266637 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.266615 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6n2b\" (UniqueName: \"kubernetes.io/projected/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-kube-api-access-d6n2b\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.313613 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.313592 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:06.442769 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.442740 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq"] May 26 11:55:06.445021 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:55:06.444994 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebbb367_92ed_4ae7_8a07_73fd3582cfb7.slice/crio-974e38364b5243e331eb9bc30c2fe3c9c1894ec1f1c1510b315eafc613b11567 WatchSource:0}: Error finding container 974e38364b5243e331eb9bc30c2fe3c9c1894ec1f1c1510b315eafc613b11567: Status 404 returned error can't find the container with id 974e38364b5243e331eb9bc30c2fe3c9c1894ec1f1c1510b315eafc613b11567 May 26 11:55:06.936958 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.936925 2572 generic.go:358] "Generic (PLEG): container finished" podID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerID="4bae5927afc68bc9c1bc2179e746554ad8dd76f35058c2e62cdaae4bdda33b18" exitCode=0 May 26 11:55:06.937086 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.936995 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" event={"ID":"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7","Type":"ContainerDied","Data":"4bae5927afc68bc9c1bc2179e746554ad8dd76f35058c2e62cdaae4bdda33b18"} May 26 11:55:06.937086 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:06.937021 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" event={"ID":"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7","Type":"ContainerStarted","Data":"974e38364b5243e331eb9bc30c2fe3c9c1894ec1f1c1510b315eafc613b11567"} May 26 11:55:09.948339 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:09.948311 2572 generic.go:358] "Generic (PLEG): container finished" podID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerID="4209556a075795634406704b8c3c5a06598f8a6abc40b79111d0946801535dc3" exitCode=0 May 26 11:55:09.948695 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:09.948401 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" event={"ID":"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7","Type":"ContainerDied","Data":"4209556a075795634406704b8c3c5a06598f8a6abc40b79111d0946801535dc3"} May 26 11:55:10.953587 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:10.953552 2572 generic.go:358] "Generic (PLEG): container finished" podID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerID="0947f2e4c8bb56abb5ad6dd5721a1ce17adbbe1b45d7a2242314a6fa37295268" exitCode=0 May 26 11:55:10.953938 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:10.953637 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" event={"ID":"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7","Type":"ContainerDied","Data":"0947f2e4c8bb56abb5ad6dd5721a1ce17adbbe1b45d7a2242314a6fa37295268"} May 26 11:55:12.073143 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.073122 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:12.202925 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.202901 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6n2b\" (UniqueName: \"kubernetes.io/projected/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-kube-api-access-d6n2b\") pod \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " May 26 11:55:12.203061 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.202952 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-util\") pod \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " May 26 11:55:12.203061 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.202988 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-bundle\") pod \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\" (UID: \"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7\") " May 26 11:55:12.203382 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.203349 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-bundle" (OuterVolumeSpecName: "bundle") pod "0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" (UID: "0ebbb367-92ed-4ae7-8a07-73fd3582cfb7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 11:55:12.204904 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.204884 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-kube-api-access-d6n2b" (OuterVolumeSpecName: "kube-api-access-d6n2b") pod "0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" (UID: "0ebbb367-92ed-4ae7-8a07-73fd3582cfb7"). InnerVolumeSpecName "kube-api-access-d6n2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:55:12.207427 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.207385 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-util" (OuterVolumeSpecName: "util") pod "0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" (UID: "0ebbb367-92ed-4ae7-8a07-73fd3582cfb7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 11:55:12.304312 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.304286 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6n2b\" (UniqueName: \"kubernetes.io/projected/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-kube-api-access-d6n2b\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:55:12.304312 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.304308 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:55:12.304427 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.304318 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb367-92ed-4ae7-8a07-73fd3582cfb7-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:55:12.960699 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.960621 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" event={"ID":"0ebbb367-92ed-4ae7-8a07-73fd3582cfb7","Type":"ContainerDied","Data":"974e38364b5243e331eb9bc30c2fe3c9c1894ec1f1c1510b315eafc613b11567"} May 26 11:55:12.960699 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.960658 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="974e38364b5243e331eb9bc30c2fe3c9c1894ec1f1c1510b315eafc613b11567" May 26 11:55:12.960699 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:12.960673 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78emgxzq" May 26 11:55:50.376805 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.376732 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l"] May 26 11:55:50.377475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.377174 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerName="util" May 26 11:55:50.377475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.377192 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerName="util" May 26 11:55:50.377475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.377221 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerName="extract" May 26 11:55:50.377475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.377230 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerName="extract" May 26 11:55:50.377475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.377252 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerName="pull" May 26 11:55:50.377475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.377260 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerName="pull" May 26 11:55:50.377475 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.377335 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ebbb367-92ed-4ae7-8a07-73fd3582cfb7" containerName="extract" May 26 11:55:50.384214 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.384193 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.387018 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.386993 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" May 26 11:55:50.387172 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.387024 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 26 11:55:50.388113 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.388088 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" May 26 11:55:50.388224 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.388137 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 26 11:55:50.388224 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.388093 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-9jl4r\"" May 26 11:55:50.388675 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.388652 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l"] May 26 11:55:50.478405 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.478375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz949\" (UniqueName: \"kubernetes.io/projected/d6e37813-6b26-49bd-ae61-f76b0588fdd1-kube-api-access-dz949\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l\" (UID: \"d6e37813-6b26-49bd-ae61-f76b0588fdd1\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.478539 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.478408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6e37813-6b26-49bd-ae61-f76b0588fdd1-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l\" (UID: \"d6e37813-6b26-49bd-ae61-f76b0588fdd1\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.478539 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.478479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d6e37813-6b26-49bd-ae61-f76b0588fdd1-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l\" (UID: \"d6e37813-6b26-49bd-ae61-f76b0588fdd1\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.578827 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.578802 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d6e37813-6b26-49bd-ae61-f76b0588fdd1-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l\" (UID: \"d6e37813-6b26-49bd-ae61-f76b0588fdd1\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.578940 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.578870 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dz949\" (UniqueName: \"kubernetes.io/projected/d6e37813-6b26-49bd-ae61-f76b0588fdd1-kube-api-access-dz949\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l\" (UID: \"d6e37813-6b26-49bd-ae61-f76b0588fdd1\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.578940 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.578901 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6e37813-6b26-49bd-ae61-f76b0588fdd1-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l\" (UID: \"d6e37813-6b26-49bd-ae61-f76b0588fdd1\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.579360 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.579341 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d6e37813-6b26-49bd-ae61-f76b0588fdd1-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l\" (UID: \"d6e37813-6b26-49bd-ae61-f76b0588fdd1\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.581088 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.581069 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6e37813-6b26-49bd-ae61-f76b0588fdd1-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l\" (UID: \"d6e37813-6b26-49bd-ae61-f76b0588fdd1\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.587919 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.587898 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz949\" (UniqueName: \"kubernetes.io/projected/d6e37813-6b26-49bd-ae61-f76b0588fdd1-kube-api-access-dz949\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l\" (UID: \"d6e37813-6b26-49bd-ae61-f76b0588fdd1\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.694625 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.694561 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:50.818351 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:50.818263 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l"] May 26 11:55:50.821005 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:55:50.820978 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6e37813_6b26_49bd_ae61_f76b0588fdd1.slice/crio-53a93e9f8bdc540debaf6acf0101d0e17375afc352c575b75e8590a5e0069313 WatchSource:0}: Error finding container 53a93e9f8bdc540debaf6acf0101d0e17375afc352c575b75e8590a5e0069313: Status 404 returned error can't find the container with id 53a93e9f8bdc540debaf6acf0101d0e17375afc352c575b75e8590a5e0069313 May 26 11:55:51.084733 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:51.084706 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" event={"ID":"d6e37813-6b26-49bd-ae61-f76b0588fdd1","Type":"ContainerStarted","Data":"53a93e9f8bdc540debaf6acf0101d0e17375afc352c575b75e8590a5e0069313"} May 26 11:55:54.096866 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:54.096818 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" event={"ID":"d6e37813-6b26-49bd-ae61-f76b0588fdd1","Type":"ContainerStarted","Data":"0330095ac53e88e3995003a423e87042ee0f5c2a1b1669e3d034713f985ff0f4"} May 26 11:55:54.097234 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:54.096946 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:55:54.113245 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:55:54.113195 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" podStartSLOduration=1.548900169 podStartE2EDuration="4.113179737s" podCreationTimestamp="2026-05-26 11:55:50 +0000 UTC" firstStartedPulling="2026-05-26 11:55:50.822744705 +0000 UTC m=+456.699742895" lastFinishedPulling="2026-05-26 11:55:53.387024259 +0000 UTC m=+459.264022463" observedRunningTime="2026-05-26 11:55:54.111816352 +0000 UTC m=+459.988814566" watchObservedRunningTime="2026-05-26 11:55:54.113179737 +0000 UTC m=+459.990177950" May 26 11:56:10.105184 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:56:10.105156 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l" May 26 11:57:44.487009 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.486973 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m"] May 26 11:57:44.490140 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.490124 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" May 26 11:57:44.493055 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.493034 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-l7fhx\"/\"default-dockercfg-kcxtr\"" May 26 11:57:44.493161 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.493034 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-l7fhx\"/\"openshift-service-ca.crt\"" May 26 11:57:44.494375 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.494360 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-l7fhx\"/\"kube-root-ca.crt\"" May 26 11:57:44.505671 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.505647 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m"] May 26 11:57:44.664635 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.664610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfnqd\" (UniqueName: \"kubernetes.io/projected/70c3db2d-053b-4326-b485-7d031a245ce0-kube-api-access-vfnqd\") pod \"test-trainjob-2rmkr-node-0-0-4qr8m\" (UID: \"70c3db2d-053b-4326-b485-7d031a245ce0\") " pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" May 26 11:57:44.765560 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.765503 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfnqd\" (UniqueName: \"kubernetes.io/projected/70c3db2d-053b-4326-b485-7d031a245ce0-kube-api-access-vfnqd\") pod \"test-trainjob-2rmkr-node-0-0-4qr8m\" (UID: \"70c3db2d-053b-4326-b485-7d031a245ce0\") " pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" May 26 11:57:44.774648 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.774628 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfnqd\" (UniqueName: \"kubernetes.io/projected/70c3db2d-053b-4326-b485-7d031a245ce0-kube-api-access-vfnqd\") pod \"test-trainjob-2rmkr-node-0-0-4qr8m\" (UID: \"70c3db2d-053b-4326-b485-7d031a245ce0\") " pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" May 26 11:57:44.799398 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.799376 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" May 26 11:57:44.923675 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:44.923651 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m"] May 26 11:57:44.927884 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:57:44.927854 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70c3db2d_053b_4326_b485_7d031a245ce0.slice/crio-cdd4ba2d6edfb52060b00e1ccebbcc43962f09e4fa3a71c27a9949f9dea13f2a WatchSource:0}: Error finding container cdd4ba2d6edfb52060b00e1ccebbcc43962f09e4fa3a71c27a9949f9dea13f2a: Status 404 returned error can't find the container with id cdd4ba2d6edfb52060b00e1ccebbcc43962f09e4fa3a71c27a9949f9dea13f2a May 26 11:57:45.451428 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:57:45.451387 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" event={"ID":"70c3db2d-053b-4326-b485-7d031a245ce0","Type":"ContainerStarted","Data":"cdd4ba2d6edfb52060b00e1ccebbcc43962f09e4fa3a71c27a9949f9dea13f2a"} May 26 11:58:14.629424 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:14.629397 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/2.log" May 26 11:58:14.634266 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:14.634240 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/2.log" May 26 11:58:14.637991 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:14.637972 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/0.log" May 26 11:58:14.640337 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:14.640322 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/0.log" May 26 11:58:52.706239 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:52.706198 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" event={"ID":"70c3db2d-053b-4326-b485-7d031a245ce0","Type":"ContainerStarted","Data":"964340bdd3c38c6f79d23ec0e27fe93cb8913c39d862eb138186f38a8e77f5a0"} May 26 11:58:52.725272 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:52.725223 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" podStartSLOduration=1.8834897879999999 podStartE2EDuration="1m8.725210356s" podCreationTimestamp="2026-05-26 11:57:44 +0000 UTC" firstStartedPulling="2026-05-26 11:57:44.929961579 +0000 UTC m=+570.806959773" lastFinishedPulling="2026-05-26 11:58:51.771682138 +0000 UTC m=+637.648680341" observedRunningTime="2026-05-26 11:58:52.722673751 +0000 UTC m=+638.599671985" watchObservedRunningTime="2026-05-26 11:58:52.725210356 +0000 UTC m=+638.602208605" May 26 11:58:53.349189 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:53.349164 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-l7fhx_test-trainjob-2rmkr-node-0-0-4qr8m_70c3db2d-053b-4326-b485-7d031a245ce0/node/0.log" May 26 11:58:54.713346 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:54.713280 2572 generic.go:358] "Generic (PLEG): container finished" podID="70c3db2d-053b-4326-b485-7d031a245ce0" containerID="964340bdd3c38c6f79d23ec0e27fe93cb8913c39d862eb138186f38a8e77f5a0" exitCode=0 May 26 11:58:54.713346 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:54.713334 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" event={"ID":"70c3db2d-053b-4326-b485-7d031a245ce0","Type":"ContainerDied","Data":"964340bdd3c38c6f79d23ec0e27fe93cb8913c39d862eb138186f38a8e77f5a0"} May 26 11:58:55.837650 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:55.837625 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" May 26 11:58:55.873258 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:55.873234 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfnqd\" (UniqueName: \"kubernetes.io/projected/70c3db2d-053b-4326-b485-7d031a245ce0-kube-api-access-vfnqd\") pod \"70c3db2d-053b-4326-b485-7d031a245ce0\" (UID: \"70c3db2d-053b-4326-b485-7d031a245ce0\") " May 26 11:58:55.875382 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:55.875357 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70c3db2d-053b-4326-b485-7d031a245ce0-kube-api-access-vfnqd" (OuterVolumeSpecName: "kube-api-access-vfnqd") pod "70c3db2d-053b-4326-b485-7d031a245ce0" (UID: "70c3db2d-053b-4326-b485-7d031a245ce0"). InnerVolumeSpecName "kube-api-access-vfnqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:58:55.974193 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:55.974146 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfnqd\" (UniqueName: \"kubernetes.io/projected/70c3db2d-053b-4326-b485-7d031a245ce0-kube-api-access-vfnqd\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" May 26 11:58:56.349852 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:56.349836 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-l7fhx_test-trainjob-2rmkr-node-0-0-4qr8m_70c3db2d-053b-4326-b485-7d031a245ce0/node/0.log" May 26 11:58:56.719680 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:56.719657 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" May 26 11:58:56.719680 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:56.719669 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m" event={"ID":"70c3db2d-053b-4326-b485-7d031a245ce0","Type":"ContainerDied","Data":"cdd4ba2d6edfb52060b00e1ccebbcc43962f09e4fa3a71c27a9949f9dea13f2a"} May 26 11:58:56.719828 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:56.719693 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdd4ba2d6edfb52060b00e1ccebbcc43962f09e4fa3a71c27a9949f9dea13f2a" May 26 11:58:57.718191 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:58:57.718164 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-l7fhx_test-trainjob-2rmkr-node-0-0-4qr8m_70c3db2d-053b-4326-b485-7d031a245ce0/node/0.log" May 26 11:59:02.748757 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:02.748716 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m"] May 26 11:59:02.755610 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:02.755580 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-l7fhx/test-trainjob-2rmkr-node-0-0-4qr8m"] May 26 11:59:04.697119 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:04.697087 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70c3db2d-053b-4326-b485-7d031a245ce0" path="/var/lib/kubelet/pods/70c3db2d-053b-4326-b485-7d031a245ce0/volumes" May 26 11:59:15.144731 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:15.144705 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l_d6e37813-6b26-49bd-ae61-f76b0588fdd1/manager/0.log" May 26 11:59:15.598250 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:15.598224 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l_d6e37813-6b26-49bd-ae61-f76b0588fdd1/manager/0.log" May 26 11:59:16.059205 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:16.059129 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-ncd9l_d6e37813-6b26-49bd-ae61-f76b0588fdd1/manager/0.log" May 26 11:59:52.930454 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:52.930408 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gwv45/must-gather-47856"] May 26 11:59:52.931014 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:52.930777 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c3db2d-053b-4326-b485-7d031a245ce0" containerName="node" May 26 11:59:52.931014 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:52.930826 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c3db2d-053b-4326-b485-7d031a245ce0" containerName="node" May 26 11:59:52.931161 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:52.931027 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="70c3db2d-053b-4326-b485-7d031a245ce0" containerName="node" May 26 11:59:52.937275 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:52.937251 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gwv45/must-gather-47856" May 26 11:59:52.940655 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:52.940630 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gwv45\"/\"openshift-service-ca.crt\"" May 26 11:59:52.940655 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:52.940645 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gwv45/must-gather-47856"] May 26 11:59:52.942016 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:52.941993 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gwv45\"/\"default-dockercfg-fls5d\"" May 26 11:59:52.942128 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:52.942038 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gwv45\"/\"kube-root-ca.crt\"" May 26 11:59:53.084430 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.084402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f52a26fc-579a-4736-bd1b-061cd6001c99-must-gather-output\") pod \"must-gather-47856\" (UID: \"f52a26fc-579a-4736-bd1b-061cd6001c99\") " pod="openshift-must-gather-gwv45/must-gather-47856" May 26 11:59:53.084564 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.084511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4gmv\" (UniqueName: \"kubernetes.io/projected/f52a26fc-579a-4736-bd1b-061cd6001c99-kube-api-access-h4gmv\") pod \"must-gather-47856\" (UID: \"f52a26fc-579a-4736-bd1b-061cd6001c99\") " pod="openshift-must-gather-gwv45/must-gather-47856" May 26 11:59:53.185485 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.185412 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f52a26fc-579a-4736-bd1b-061cd6001c99-must-gather-output\") pod \"must-gather-47856\" (UID: \"f52a26fc-579a-4736-bd1b-061cd6001c99\") " pod="openshift-must-gather-gwv45/must-gather-47856" May 26 11:59:53.185596 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.185507 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4gmv\" (UniqueName: \"kubernetes.io/projected/f52a26fc-579a-4736-bd1b-061cd6001c99-kube-api-access-h4gmv\") pod \"must-gather-47856\" (UID: \"f52a26fc-579a-4736-bd1b-061cd6001c99\") " pod="openshift-must-gather-gwv45/must-gather-47856" May 26 11:59:53.185713 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.185694 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f52a26fc-579a-4736-bd1b-061cd6001c99-must-gather-output\") pod \"must-gather-47856\" (UID: \"f52a26fc-579a-4736-bd1b-061cd6001c99\") " pod="openshift-must-gather-gwv45/must-gather-47856" May 26 11:59:53.194957 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.194936 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4gmv\" (UniqueName: \"kubernetes.io/projected/f52a26fc-579a-4736-bd1b-061cd6001c99-kube-api-access-h4gmv\") pod \"must-gather-47856\" (UID: \"f52a26fc-579a-4736-bd1b-061cd6001c99\") " pod="openshift-must-gather-gwv45/must-gather-47856" May 26 11:59:53.247892 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.247870 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gwv45/must-gather-47856" May 26 11:59:53.372934 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.372911 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gwv45/must-gather-47856"] May 26 11:59:53.375392 ip-10-0-140-83 kubenswrapper[2572]: W0526 11:59:53.375364 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf52a26fc_579a_4736_bd1b_061cd6001c99.slice/crio-1d2aa1016782ec822ace6df6d21f74b50e0fda1100c2b4992532d46e44e315ff WatchSource:0}: Error finding container 1d2aa1016782ec822ace6df6d21f74b50e0fda1100c2b4992532d46e44e315ff: Status 404 returned error can't find the container with id 1d2aa1016782ec822ace6df6d21f74b50e0fda1100c2b4992532d46e44e315ff May 26 11:59:53.377415 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.377394 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 11:59:53.893873 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:53.893841 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gwv45/must-gather-47856" event={"ID":"f52a26fc-579a-4736-bd1b-061cd6001c99","Type":"ContainerStarted","Data":"1d2aa1016782ec822ace6df6d21f74b50e0fda1100c2b4992532d46e44e315ff"} May 26 11:59:54.900832 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:54.900749 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gwv45/must-gather-47856" event={"ID":"f52a26fc-579a-4736-bd1b-061cd6001c99","Type":"ContainerStarted","Data":"86d5aa28c0fe18d4738f6f2e5a45688f6e82cdf21834a0c51d5b7230ef13eb2f"} May 26 11:59:54.901361 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:54.901336 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gwv45/must-gather-47856" event={"ID":"f52a26fc-579a-4736-bd1b-061cd6001c99","Type":"ContainerStarted","Data":"7983afaffc2b1ca1f9aa3bc5829b3ae026bdcd47d30eb0df267d42e69ccfd015"} May 26 11:59:54.918358 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:54.918301 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gwv45/must-gather-47856" podStartSLOduration=2.019827311 podStartE2EDuration="2.91828267s" podCreationTimestamp="2026-05-26 11:59:52 +0000 UTC" firstStartedPulling="2026-05-26 11:59:53.377599336 +0000 UTC m=+699.254597526" lastFinishedPulling="2026-05-26 11:59:54.276054679 +0000 UTC m=+700.153052885" observedRunningTime="2026-05-26 11:59:54.916631798 +0000 UTC m=+700.793630011" watchObservedRunningTime="2026-05-26 11:59:54.91828267 +0000 UTC m=+700.795280883" May 26 11:59:55.585919 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:55.585882 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kmk8t_b6086d7b-3f08-4547-a3b0-8c9f406a71fb/global-pull-secret-syncer/0.log" May 26 11:59:55.775833 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:55.775802 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ptm26_7451ccca-c3a7-442e-8d1e-892dffdb4547/konnectivity-agent/0.log" May 26 11:59:55.815590 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:55.815557 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-83.ec2.internal_036a10e2095c05efa8434b24463fd654/haproxy/0.log" May 26 11:59:59.269142 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.269103 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-2dtjx_e6d0dd2a-e1a8-4034-85ce-a9358f2b112f/kube-state-metrics/0.log" May 26 11:59:59.294144 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.294113 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-2dtjx_e6d0dd2a-e1a8-4034-85ce-a9358f2b112f/kube-rbac-proxy-main/0.log" May 26 11:59:59.322255 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.322213 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-2dtjx_e6d0dd2a-e1a8-4034-85ce-a9358f2b112f/kube-rbac-proxy-self/0.log" May 26 11:59:59.377841 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.377813 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-b2xrz_32a533fd-0e22-4d7a-b2b5-156441e211e4/monitoring-plugin/0.log" May 26 11:59:59.473956 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.473926 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l2m24_b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e/node-exporter/0.log" May 26 11:59:59.498318 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.498294 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l2m24_b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e/kube-rbac-proxy/0.log" May 26 11:59:59.523347 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.523275 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l2m24_b8ba0f2d-e4fd-4f22-a46c-862802ba1d9e/init-textfile/0.log" May 26 11:59:59.629074 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.629041 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-nxcw4_41149b18-29eb-4db9-9596-9b11f4783e3e/kube-rbac-proxy-main/0.log" May 26 11:59:59.651114 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.651083 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-nxcw4_41149b18-29eb-4db9-9596-9b11f4783e3e/kube-rbac-proxy-self/0.log" May 26 11:59:59.671340 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.671316 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-nxcw4_41149b18-29eb-4db9-9596-9b11f4783e3e/openshift-state-metrics/0.log" May 26 11:59:59.872168 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.872137 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-sw4pv_179164e5-6a71-4f81-b4b1-b002f338c995/prometheus-operator/0.log" May 26 11:59:59.896465 ip-10-0-140-83 kubenswrapper[2572]: I0526 11:59:59.896421 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-sw4pv_179164e5-6a71-4f81-b4b1-b002f338c995/kube-rbac-proxy/0.log" May 26 12:00:01.620917 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:01.620890 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/2.log" May 26 12:00:01.625479 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:01.625455 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-7r7rk_0681cbe3-f564-4ce6-bbd3-0da4a12e0f00/console-operator/3.log" May 26 12:00:01.940520 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:01.940453 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cf8468996-5t9dk_4ceefc4a-3de0-4dd6-a9e7-5301e5924043/console/0.log" May 26 12:00:01.964889 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:01.964869 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-4qwcb_3c910ff8-f0a0-45a6-95b3-300c8e96ebf0/download-server/0.log" May 26 12:00:02.325566 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.325543 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-bss7k_10a4c29d-df61-496d-8ef4-56307b4eb2ca/volume-data-source-validator/0.log" May 26 12:00:02.525595 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.525564 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl"] May 26 12:00:02.529934 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.529910 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.538138 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.538000 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl"] May 26 12:00:02.673429 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.673357 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzrs9\" (UniqueName: \"kubernetes.io/projected/8a68b8bc-13e8-4369-807d-ee7803d8031e-kube-api-access-lzrs9\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.673429 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.673398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-podres\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.673429 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.673418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-lib-modules\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.673868 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.673498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-sys\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.673868 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.673522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-proc\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.774318 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.774287 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-sys\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.774495 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.774327 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-proc\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.774495 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.774365 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzrs9\" (UniqueName: \"kubernetes.io/projected/8a68b8bc-13e8-4369-807d-ee7803d8031e-kube-api-access-lzrs9\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.774495 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.774390 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-podres\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.774495 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.774408 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-lib-modules\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.774495 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.774412 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-sys\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.774669 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.774516 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-proc\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.774669 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.774592 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-podres\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.774669 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.774608 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a68b8bc-13e8-4369-807d-ee7803d8031e-lib-modules\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.781689 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.781667 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzrs9\" (UniqueName: \"kubernetes.io/projected/8a68b8bc-13e8-4369-807d-ee7803d8031e-kube-api-access-lzrs9\") pod \"perf-node-gather-daemonset-69knl\" (UID: \"8a68b8bc-13e8-4369-807d-ee7803d8031e\") " pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.842395 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.842372 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:02.985980 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:02.985957 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl"] May 26 12:00:02.988168 ip-10-0-140-83 kubenswrapper[2572]: W0526 12:00:02.988143 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a68b8bc_13e8_4369_807d_ee7803d8031e.slice/crio-5eabb314d612ef60a48589a68ea31561358542d7f3b2a4cc89430eeef3e6434d WatchSource:0}: Error finding container 5eabb314d612ef60a48589a68ea31561358542d7f3b2a4cc89430eeef3e6434d: Status 404 returned error can't find the container with id 5eabb314d612ef60a48589a68ea31561358542d7f3b2a4cc89430eeef3e6434d May 26 12:00:03.054774 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:03.054746 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nn9d2_13ee2e51-8fcc-4333-88c2-d7aa45761280/dns/0.log" May 26 12:00:03.072583 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:03.072562 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nn9d2_13ee2e51-8fcc-4333-88c2-d7aa45761280/kube-rbac-proxy/0.log" May 26 12:00:03.136336 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:03.136311 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-njbrp_5baf7ffa-54d0-4039-8f49-0f965fb6e6b5/dns-node-resolver/0.log" May 26 12:00:03.589566 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:03.589540 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-skrzv_02f7eba3-d311-4f16-b8a6-163a864cc3b2/node-ca/0.log" May 26 12:00:03.942323 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:03.942247 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" event={"ID":"8a68b8bc-13e8-4369-807d-ee7803d8031e","Type":"ContainerStarted","Data":"bd57d346ea7d12f22266dcff90257013b60b5feb0760f9ddf2b7d0f69284058a"} May 26 12:00:03.942323 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:03.942290 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" event={"ID":"8a68b8bc-13e8-4369-807d-ee7803d8031e","Type":"ContainerStarted","Data":"5eabb314d612ef60a48589a68ea31561358542d7f3b2a4cc89430eeef3e6434d"} May 26 12:00:03.942724 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:03.942384 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:03.959876 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:03.959830 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" podStartSLOduration=1.959816198 podStartE2EDuration="1.959816198s" podCreationTimestamp="2026-05-26 12:00:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 12:00:03.95742353 +0000 UTC m=+709.834421741" watchObservedRunningTime="2026-05-26 12:00:03.959816198 +0000 UTC m=+709.836814425" May 26 12:00:04.280025 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:04.279941 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-766db55d5b-k6rg6_8d80b656-2bd7-4f7b-94e4-dc043776c9b2/router/0.log" May 26 12:00:04.597792 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:04.597769 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxhbl_b1884da9-5484-4448-aaab-e96f107c7740/serve-healthcheck-canary/0.log" May 26 12:00:04.977649 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:04.977574 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-v4hsc_642ea59b-2b49-4db7-a9be-56e807229e4b/insights-operator/1.log" May 26 12:00:04.977649 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:04.977652 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-v4hsc_642ea59b-2b49-4db7-a9be-56e807229e4b/insights-operator/0.log" May 26 12:00:04.995652 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:04.995632 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7ggd2_f2a370bd-a5e6-4633-acd7-501b2ec0dad5/kube-rbac-proxy/0.log" May 26 12:00:05.014066 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:05.014040 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7ggd2_f2a370bd-a5e6-4633-acd7-501b2ec0dad5/exporter/0.log" May 26 12:00:05.033906 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:05.033889 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7ggd2_f2a370bd-a5e6-4633-acd7-501b2ec0dad5/extractor/0.log" May 26 12:00:09.647471 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:09.647424 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-dgjbg_244c432c-21b2-4768-9e04-51f8357d58a4/migrator/0.log" May 26 12:00:09.669611 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:09.669585 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-dgjbg_244c432c-21b2-4768-9e04-51f8357d58a4/graceful-termination/0.log" May 26 12:00:09.956826 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:09.956749 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gwv45/perf-node-gather-daemonset-69knl" May 26 12:00:11.180092 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.180065 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xrclr_25a9ab16-21f2-46e0-b3a0-1014db031ffd/kube-multus-additional-cni-plugins/0.log" May 26 12:00:11.206496 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.206429 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xrclr_25a9ab16-21f2-46e0-b3a0-1014db031ffd/egress-router-binary-copy/0.log" May 26 12:00:11.232058 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.231999 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xrclr_25a9ab16-21f2-46e0-b3a0-1014db031ffd/cni-plugins/0.log" May 26 12:00:11.255480 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.255426 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xrclr_25a9ab16-21f2-46e0-b3a0-1014db031ffd/bond-cni-plugin/0.log" May 26 12:00:11.281221 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.281199 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xrclr_25a9ab16-21f2-46e0-b3a0-1014db031ffd/routeoverride-cni/0.log" May 26 12:00:11.312083 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.312058 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xrclr_25a9ab16-21f2-46e0-b3a0-1014db031ffd/whereabouts-cni-bincopy/0.log" May 26 12:00:11.340231 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.340168 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xrclr_25a9ab16-21f2-46e0-b3a0-1014db031ffd/whereabouts-cni/0.log" May 26 12:00:11.408277 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.408228 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tb2p2_189fe7cc-65cb-4875-92ed-c2c6a07097ca/kube-multus/0.log" May 26 12:00:11.500999 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.500970 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jqqpm_3827d450-0d1d-4619-8cc9-8a3c6bc59bb7/network-metrics-daemon/0.log" May 26 12:00:11.526250 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:11.526214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jqqpm_3827d450-0d1d-4619-8cc9-8a3c6bc59bb7/kube-rbac-proxy/0.log" May 26 12:00:12.353330 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:12.353304 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-controller/0.log" May 26 12:00:12.370594 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:12.370568 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/0.log" May 26 12:00:12.373682 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:12.373662 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovn-acl-logging/1.log" May 26 12:00:12.391289 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:12.391267 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/kube-rbac-proxy-node/0.log" May 26 12:00:12.410513 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:12.410491 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/kube-rbac-proxy-ovn-metrics/0.log" May 26 12:00:12.426855 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:12.426832 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/northd/0.log" May 26 12:00:12.446012 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:12.445993 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/nbdb/0.log" May 26 12:00:12.464426 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:12.464407 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/sbdb/0.log" May 26 12:00:12.560103 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:12.560079 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj85s_6e657c0a-cfea-484b-86bf-bd51311e786f/ovnkube-controller/0.log" May 26 12:00:14.049205 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:14.049129 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bhm75_5f4ce227-15d5-4f1f-991d-be70314d08d9/network-check-target-container/0.log" May 26 12:00:14.946253 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:14.946226 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8p9d8_56f12581-17ab-4baf-9ed7-b0ef39c84361/iptables-alerter/0.log" May 26 12:00:15.566298 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:15.566269 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5w2cx_9b887901-ea71-4600-8553-3308f38905af/tuned/0.log" May 26 12:00:18.492010 ip-10-0-140-83 kubenswrapper[2572]: I0526 12:00:18.491922 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-67d667c7d-pp5wd_ac81be3d-4e6d-4579-a42f-857b746ffd70/service-ca-controller/0.log"