May 21 19:19:21.495255 ip-10-0-143-158 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 19:19:21.495269 ip-10-0-143-158 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 19:19:21.495278 ip-10-0-143-158 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 19:19:21.495608 ip-10-0-143-158 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 19:19:31.744541 ip-10-0-143-158 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 19:19:31.744561 ip-10-0-143-158 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ca957bb25dc8455b9cae5a9867ba438f --
May 21 19:21:55.361500 ip-10-0-143-158 systemd[1]: Starting Kubernetes Kubelet...
May 21 19:21:55.863416 ip-10-0-143-158 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 19:21:55.863416 ip-10-0-143-158 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 19:21:55.863416 ip-10-0-143-158 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 19:21:55.863416 ip-10-0-143-158 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 19:21:55.863416 ip-10-0-143-158 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 19:21:55.867390 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.867305    2561 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 19:21:55.874072 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874049    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 19:21:55.874072 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874067    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 19:21:55.874072 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874072    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 19:21:55.874072 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874076    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 19:21:55.874072 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874079    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 19:21:55.874072 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874082    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874085    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874088    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874091    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874093    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874096    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874099    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874101    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874105    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874107    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874109    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874112    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874115    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874117    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874120    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874122    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874125    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874127    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874130    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874133    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 19:21:55.874319 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874135    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874138    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874141    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874143    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874146    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874148    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874151    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874154    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874156    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874160    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874163    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874166    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874169    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874172    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874192    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874195    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874198    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874201    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874203    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 19:21:55.874860 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874206    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874208    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874211    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874214    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874216    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874219    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874221    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874224    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874228    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874232    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874235    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874238    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874241    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874244    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874247    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874250    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874252    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874255    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874257    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 19:21:55.875439 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874260    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874262    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874265    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874267    2561 feature_gate.go:328] unrecognized feature gate: Example
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874270    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874272    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874275    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874277    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874281    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874284    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874287    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874291    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874293    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874296    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874298    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874308    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874311    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874313    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874316    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874319    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 19:21:55.875891 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874322    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874324    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874327    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874700    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874704    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874707    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874710    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874712    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874715    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874717    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874720    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874723    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874725    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874727    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874730    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874732    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874735    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874737    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874740    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874742    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 19:21:55.876386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874745    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874748    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874751    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874753    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874756    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874758    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874761    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874769    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874773    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874776    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874778    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874781    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874783    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874787    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874790    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874793    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874795    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874798    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874800    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874803    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 19:21:55.876880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874805    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874808    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874810    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874815    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874818    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874820    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874823    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874826    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874828    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874831    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874834    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874837    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874840    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874842    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874845    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874847    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874849    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874852    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874854    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 19:21:55.877411 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874856    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874864    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874867    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874870    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874872    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874875    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874877    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874880    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874882    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874885    2561 feature_gate.go:328] unrecognized feature gate: Example
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874888    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874890    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874893    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874895    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874899    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874901    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874904    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874906    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874909    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874911    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 19:21:55.877871 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874914    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874916    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874918    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874921    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874923    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874926    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874929    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874931    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874934    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.874936    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875010    2561 flags.go:64] FLAG: --address="0.0.0.0"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875017    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875029    2561 flags.go:64] FLAG: --anonymous-auth="true"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875033    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875047    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875051    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875055    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875059    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875062    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875065    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875068    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875072    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 19:21:55.878353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875075    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875078    2561 flags.go:64] FLAG: --cgroup-root=""
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875080    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875083    2561 flags.go:64] FLAG: --client-ca-file=""
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875086    2561 flags.go:64] FLAG: --cloud-config=""
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875089    2561 flags.go:64] FLAG: --cloud-provider="external"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875092    2561 flags.go:64] FLAG: --cluster-dns="[]"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875099    2561 flags.go:64] FLAG: --cluster-domain=""
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875102    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875105    2561 flags.go:64] FLAG: --config-dir=""
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875108    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875112    2561 flags.go:64] FLAG: --container-log-max-files="5"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875115    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875118    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875121    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875127    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875130    2561 flags.go:64] FLAG: --contention-profiling="false"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875133    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875136    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875139    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875141    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875145    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875148    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875151    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875153    2561 flags.go:64] FLAG: --enable-load-reader="false"
May 21 19:21:55.878880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875165    2561 flags.go:64] FLAG: --enable-server="true"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875168    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875174    2561 flags.go:64] FLAG: --event-burst="100"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875192    2561 flags.go:64] FLAG: --event-qps="50"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875195    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875199    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875202    2561 flags.go:64] FLAG: --eviction-hard=""
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875206    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875209    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875212    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875215    2561 flags.go:64] FLAG: --eviction-soft=""
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875218    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875220    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875223    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875226    2561 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875229    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875231    2561 flags.go:64] FLAG: --fail-swap-on="true"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875234    2561 flags.go:64] FLAG: --feature-gates=""
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875238    2561 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875241    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875244    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875247    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875251    2561 flags.go:64] FLAG: --healthz-port="10248"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875254    2561 flags.go:64] FLAG: --help="false"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875256    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-143-158.ec2.internal"
May 21 19:21:55.879505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875259    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875262    2561 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875265    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875268    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875272    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875274    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875277    2561 flags.go:64] FLAG: --image-service-endpoint=""
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875280    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875288    2561 flags.go:64] FLAG: --kube-api-burst="100"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875291    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875294    2561 flags.go:64] FLAG: --kube-api-qps="50"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875297    2561 flags.go:64] FLAG: --kube-reserved=""
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875301    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875304    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875307    2561 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875310    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875313    2561 flags.go:64] FLAG: --lock-file=""
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875316    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875319    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875322    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875327    2561 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875330    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875332    2561 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875335    2561 flags.go:64] FLAG: --logging-format="text"
May 21 19:21:55.880125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875338    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875341    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875343    2561 flags.go:64] FLAG: --manifest-url=""
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875346    2561 flags.go:64] FLAG: --manifest-url-header=""
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875350    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875354    2561 flags.go:64] FLAG: --max-open-files="1000000"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875358    2561 flags.go:64] FLAG: --max-pods="110"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875361    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875364    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875367    2561 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875370    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875372    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875375    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875378    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875385    2561 flags.go:64] FLAG: --node-status-max-images="50"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875388    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875391    2561 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875399    2561 flags.go:64] FLAG: --pod-cidr=""
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875402    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875408    2561 flags.go:64] FLAG: --pod-manifest-path=""
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875416    2561 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875419    2561 flags.go:64] FLAG: --pods-per-core="0"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875421    2561 flags.go:64] FLAG: --port="10250"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875424    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 19:21:55.880720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875427    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04d4b9919e474dbdf"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875430    2561 flags.go:64] FLAG: --qos-reserved=""
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875433    2561 flags.go:64] FLAG: --read-only-port="10255"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875436    2561 flags.go:64] FLAG: --register-node="true"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875439    2561 flags.go:64] FLAG: --register-schedulable="true"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875442    2561 flags.go:64] FLAG: --register-with-taints=""
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875446    2561 flags.go:64] FLAG: --registry-burst="10"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875449    2561 flags.go:64] FLAG: --registry-qps="5"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875452    2561 flags.go:64] FLAG: --reserved-cpus=""
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875454    2561 flags.go:64] FLAG: --reserved-memory=""
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875458    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875461    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875464    2561 flags.go:64] FLAG: --rotate-certificates="false"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875466    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875470    2561 flags.go:64] FLAG: --runonce="false"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875473    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875476    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875479    2561 flags.go:64] FLAG: --seccomp-default="false"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875482    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875485    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875488    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875491    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875494    2561 flags.go:64] FLAG: --storage-driver-password="root"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875497    2561 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875500    2561 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875503    2561 flags.go:64] FLAG: --storage-driver-user="root"
May 21 19:21:55.881319 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875511    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875514    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875518    2561 flags.go:64] FLAG: --system-cgroups=""
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875520    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875526    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875528    2561 flags.go:64] FLAG: --tls-cert-file=""
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875531    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875538    2561 flags.go:64] FLAG: --tls-min-version=""
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875540    2561 flags.go:64] FLAG: --tls-private-key-file=""
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875543    2561 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875546    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875549    2561 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875551    2561 flags.go:64] FLAG: --v="2"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875555    2561 flags.go:64] FLAG: --version="false"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875559    2561 flags.go:64] FLAG: --vmodule=""
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875563    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.875566    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875653    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875657    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875660    2561 feature_gate.go:328] unrecognized feature gate: Example
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875664    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875666    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875669    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875672    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 19:21:55.881930 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875674    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875677    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875679    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875683    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875685    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875688    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875691    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875693    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875696    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875705    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875710    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875713    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875715    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875718    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875720    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875723    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875725    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875728    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875731    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875733    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 19:21:55.882516 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875735    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875738    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875741    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875743    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875746    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875748    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875751    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875753    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875758    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875760    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875763    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875765    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875768    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875770    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875772    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875775    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875777    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875779    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875782    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875784    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 19:21:55.883014 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875786    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875789    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875798    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875801    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875803    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875806    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875808    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875811    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875813    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875815    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875818    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875820    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875823    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875826    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875830    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875832    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875835    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875837    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875840    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875842    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 19:21:55.883526 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875846    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875849    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875851    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875853    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875856    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875858    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875861    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875863    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875865    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875868    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875870    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875872    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875875    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875877    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875883    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875892    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875896    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875899    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 19:21:55.884016 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.875902    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.876546    2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.883269    2561 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.883286    2561 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883332    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883338    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883341    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883344    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883347    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883349    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883352    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883355    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883359    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883363    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883366    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 19:21:55.884522 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883369    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883372    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883375    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883377    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883380    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883382    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883385    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883387    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883390    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883392    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883395    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883397    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883400    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883402    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883405    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883408    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883410    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883413    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883417    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 19:21:55.884888 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883420    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883432    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883435    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883437    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883441    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883443    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883446    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883448    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883451    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883454    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883456    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883459    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883461    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883464    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883466    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883469    2561 feature_gate.go:328] unrecognized feature gate: Example
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883471    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883473    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883476    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883478    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883481    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 19:21:55.885374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883483    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883485    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883488    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883491    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883493    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883495    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883498    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883500    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883503    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883505    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883507    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883510    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883513    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883517    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883519    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883522    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883524    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883527    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883529    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883532    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 19:21:55.885918 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883535    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883537    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883540    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883542    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883545    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883547    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883550    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883552    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883554    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883557    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883560    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883562    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883565    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883567    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883570    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 19:21:55.886426 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.883575    2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883671    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883675    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883678    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883681    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883684    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883687    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883690    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883693    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883696    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883698    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883701    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883704    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883706    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883709    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883711    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883713    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883716    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883718    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883721    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 19:21:55.886792 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883723    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883725    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883728    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883730    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883732    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883735    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883737    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883740    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883742    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883745    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883747    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883749    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883752    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883754    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883756    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883760    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883764    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883767    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883770    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 19:21:55.887315 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883772    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883775    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883778    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883781    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883783    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883786    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883789    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883791    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883793    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883796    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883798    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883802    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883805    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883808    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883810    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883813    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883815    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883817    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883820    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 19:21:55.887776 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883822    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883824    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883827    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883829    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883832    2561 feature_gate.go:328] unrecognized feature gate: Example
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883834    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883837    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883839    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883841    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883844    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883847    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883849    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883851    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883854    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883856    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883859    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883862    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883864    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883866    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883869    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 19:21:55.888257 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883872    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883874    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883877    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883879    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883881    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883884    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883886    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883888    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:55.883891    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.883895    2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 19:21:55.888764 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.884758    2561 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 19:21:55.889410 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.889397    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 19:21:55.890490 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.890479    2561 server.go:1019] "Starting client certificate rotation"
May 21 19:21:55.890591 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.890575    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 19:21:55.891436 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.891425    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 19:21:55.920774 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.920752    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 19:21:55.924442 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.924424    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 19:21:55.945622 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.945605    2561 log.go:25] "Validated CRI v1 runtime API"
May 21 19:21:55.950853 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.950836    2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 19:21:55.951951 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.951935    2561 log.go:25] "Validated CRI v1 image API"
May 21 19:21:55.953492 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.953477    2561 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 19:21:55.956243 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.956225    2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8205b0ee-e049-48e1-8f4f-89f9da005bb8:/dev/nvme0n1p3 c56b1e69-b35e-4ead-9aad-9b267e2ac677:/dev/nvme0n1p4]
May 21 19:21:55.956320 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.956242    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 19:21:55.960502 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.960398    2561 manager.go:217] Machine: {Timestamp:2026-05-21 19:21:55.959893876 +0000 UTC m=+0.467299055 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113682 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23be60687229b1dc73817af6feb56a SystemUUID:ec23be60-6872-29b1-dc73-817af6feb56a BootID:ca957bb2-5dc8-455b-9cae-5a9867ba438f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:07:0c:3a:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:07:0c:3a:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:9d:df:a8:ce:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 19:21:55.960502 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.960497    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 19:21:55.960586 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.960567    2561 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 19:21:55.963728 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.963702    2561 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 19:21:55.963889 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.963730    2561 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 19:21:55.963969 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.963904    2561 topology_manager.go:138] "Creating topology manager with none policy"
May 21 19:21:55.963969 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.963917    2561 container_manager_linux.go:306] "Creating device plugin manager"
May 21 19:21:55.963969 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.963928    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 19:21:55.963969 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.963950    2561 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 19:21:55.965223 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.965209    2561 state_mem.go:36] "Initialized new in-memory state store"
May 21 19:21:55.965369 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.965357    2561 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 19:21:55.968275 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.968265    2561 kubelet.go:491] "Attempting to sync node with API server"
May 21 19:21:55.968331 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.968283    2561 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 19:21:55.968331 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.968299    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 19:21:55.968331 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.968313    2561 kubelet.go:397] "Adding apiserver pod source"
May 21 19:21:55.968331 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.968325    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 19:21:55.969541 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.969528    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 19:21:55.969674 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.969551    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 19:21:55.973103 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.973086    2561 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 19:21:55.975419 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.975405    2561 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 19:21:55.977460 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.977440    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mxzc9"
May 21 19:21:55.978114 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978101    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 19:21:55.978166 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978118    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 19:21:55.978166 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978125    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 19:21:55.978166 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978131    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 19:21:55.978166 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978139    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 19:21:55.978166 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978145    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 19:21:55.978166 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978150    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 19:21:55.978166 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978155    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 19:21:55.978166 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978161    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 19:21:55.978428 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978174    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 19:21:55.978428 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978207    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 19:21:55.978428 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978213    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 19:21:55.978428 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978239    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 19:21:55.978428 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.978245    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 19:21:55.980660 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:55.980640    2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 19:21:55.980877 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:55.980859    2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 19:21:55.981211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.981156    2561 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 19:21:55.981211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.981211    2561 server.go:1295] "Started kubelet"
May 21 19:21:55.981366 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.981318    2561 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 19:21:55.981431 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.981391    2561 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 19:21:55.981520 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.981390    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 19:21:55.982036 ip-10-0-143-158 systemd[1]: Started Kubernetes Kubelet.
May 21 19:21:55.982613 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.982596    2561 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 19:21:55.983772 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.983759    2561 server.go:317] "Adding debug handlers to kubelet server"
May 21 19:21:55.988589 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.988564    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mxzc9"
May 21 19:21:55.993047 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:55.993027    2561 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 19:21:55.994803 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.994784    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 19:21:55.995537 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.995526    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 19:21:55.995767 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.995709    2561 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 19:21:55.995767 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.995727    2561 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 19:21:55.995767 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.995762    2561 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 19:21:55.995914 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.995876    2561 reconstruct.go:97] "Volume reconstruction finished"
May 21 19:21:55.995914 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.995886    2561 reconciler.go:26] "Reconciler: start to sync state"
May 21 19:21:55.996710 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:55.996692    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:55.997311 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.997292    2561 factory.go:153] Registering CRI-O factory
May 21 19:21:55.997402 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.997314    2561 factory.go:223] Registration of the crio container factory successfully
May 21 19:21:55.997402 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.997367    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 19:21:55.997402 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.997379    2561 factory.go:55] Registering systemd factory
May 21 19:21:55.997402 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.997387    2561 factory.go:223] Registration of the systemd container factory successfully
May 21 19:21:55.997402 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.997403    2561 factory.go:103] Registering Raw factory
May 21 19:21:55.997611 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.997419    2561 manager.go:1196] Started watching for new ooms in manager
May 21 19:21:55.997826 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.997811    2561 manager.go:319] Starting recovery of all containers
May 21 19:21:55.998662 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:55.998645    2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 19:21:56.004078 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.003929    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-158.ec2.internal\" not found" node="ip-10-0-143-158.ec2.internal"
May 21 19:21:56.004078 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.004071    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-158.ec2.internal" not found
May 21 19:21:56.006856 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.006839    2561 manager.go:324] Recovery completed
May 21 19:21:56.010894 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.010879    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 19:21:56.012764 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.012750    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientMemory"
May 21 19:21:56.012837 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.012781    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasNoDiskPressure"
May 21 19:21:56.012837 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.012802    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientPID"
May 21 19:21:56.013335 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.013322    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 19:21:56.013335 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.013333    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 19:21:56.013414 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.013354    2561 state_mem.go:36] "Initialized new in-memory state store"
May 21 19:21:56.017325 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.017313    2561 policy_none.go:49] "None policy: Start"
May 21 19:21:56.017374 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.017329    2561 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 19:21:56.017374 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.017340    2561 state_mem.go:35] "Initializing new in-memory state store"
May 21 19:21:56.022947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.022933    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-158.ec2.internal" not found
May 21 19:21:56.058742 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.058728    2561 manager.go:341] "Starting Device Plugin manager"
May 21 19:21:56.058819 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.058759    2561 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 19:21:56.058819 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.058771    2561 server.go:85] "Starting device plugin registration server"
May 21 19:21:56.059004 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.058988    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 19:21:56.059087 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.059002    2561 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 19:21:56.059166 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.059144    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 19:21:56.059280 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.059261    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 19:21:56.059280 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.059270    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 19:21:56.059803 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.059789    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 19:21:56.059871 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.059822    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.078950 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.078931    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-158.ec2.internal" not found
May 21 19:21:56.107313 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.107291    2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 19:21:56.108682 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.108665    2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 19:21:56.108736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.108695    2561 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 19:21:56.108736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.108716    2561 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 19:21:56.108736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.108726    2561 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 19:21:56.108849 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.108772    2561 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 19:21:56.111155 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.111139    2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 19:21:56.159316 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.159266    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 19:21:56.160066 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.160049    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientMemory"
May 21 19:21:56.160121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.160082    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasNoDiskPressure"
May 21 19:21:56.160121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.160092    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientPID"
May 21 19:21:56.160121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.160113    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-158.ec2.internal"
May 21 19:21:56.177702 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.177684    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-158.ec2.internal"
May 21 19:21:56.177755 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.177706    2561 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-158.ec2.internal\": node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.208832 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.208805    2561 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"]
May 21 19:21:56.208927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.208864    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 19:21:56.209546 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.209533    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.210361 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.210347    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientMemory"
May 21 19:21:56.210422 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.210374    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasNoDiskPressure"
May 21 19:21:56.210422 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.210384    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientPID"
May 21 19:21:56.212640 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.212629    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 19:21:56.212786 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.212771    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.212876 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.212805    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 19:21:56.213429 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.213415    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientMemory"
May 21 19:21:56.213491 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.213433    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientMemory"
May 21 19:21:56.213491 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.213440    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasNoDiskPressure"
May 21 19:21:56.213491 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.213452    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientPID"
May 21 19:21:56.213491 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.213460    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasNoDiskPressure"
May 21 19:21:56.213491 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.213471    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientPID"
May 21 19:21:56.215579 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.215557    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.215671 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.215589    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 19:21:56.216206 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.216192    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientMemory"
May 21 19:21:56.216288 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.216217    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasNoDiskPressure"
May 21 19:21:56.216288 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.216230    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeHasSufficientPID"
May 21 19:21:56.241708 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.241690    2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-158.ec2.internal\" not found" node="ip-10-0-143-158.ec2.internal"
May 21 19:21:56.245044 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.245030    2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-158.ec2.internal\" not found" node="ip-10-0-143-158.ec2.internal"
May 21 19:21:56.297051 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.297029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/55cb852938d3e2368f6d966251b07f42-config\") pod \"kube-apiserver-proxy-ip-10-0-143-158.ec2.internal\" (UID: \"55cb852938d3e2368f6d966251b07f42\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.297134 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.297053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b768a409215e383b7f390a64a731c19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal\" (UID: \"4b768a409215e383b7f390a64a731c19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.297134 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.297073    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b768a409215e383b7f390a64a731c19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal\" (UID: \"4b768a409215e383b7f390a64a731c19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.310474 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.310455    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.397186 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.397161    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/55cb852938d3e2368f6d966251b07f42-config\") pod \"kube-apiserver-proxy-ip-10-0-143-158.ec2.internal\" (UID: \"55cb852938d3e2368f6d966251b07f42\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.397264 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.397203    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b768a409215e383b7f390a64a731c19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal\" (UID: \"4b768a409215e383b7f390a64a731c19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.397264 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.397220    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b768a409215e383b7f390a64a731c19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal\" (UID: \"4b768a409215e383b7f390a64a731c19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.397264 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.397250    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b768a409215e383b7f390a64a731c19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal\" (UID: \"4b768a409215e383b7f390a64a731c19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.397264 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.397256    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/55cb852938d3e2368f6d966251b07f42-config\") pod \"kube-apiserver-proxy-ip-10-0-143-158.ec2.internal\" (UID: \"55cb852938d3e2368f6d966251b07f42\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.397399 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.397256    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b768a409215e383b7f390a64a731c19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal\" (UID: \"4b768a409215e383b7f390a64a731c19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.411315 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.411264    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.512079 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.512059    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.544284 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.544265    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.547571 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.547556    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.612268 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.612240    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.712788 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.712705    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.813126 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.813098    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.890308 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.890286    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 19:21:56.890781 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.890417    2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 19:21:56.890781 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.890459    2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 19:21:56.913723 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.913699    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-158.ec2.internal\" not found"
May 21 19:21:56.932603 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.932583    2561 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 19:21:56.956817 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.956797    2561 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 19:21:56.969098 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.969050    2561 apiserver.go:52] "Watching apiserver"
May 21 19:21:56.976957 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.976938    2561 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 19:21:56.977263 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.977244    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-x8nv7","openshift-ovn-kubernetes/ovnkube-node-hnsn4","kube-system/konnectivity-agent-htbxc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9","openshift-cluster-node-tuning-operator/tuned-9gd6s","openshift-multus/multus-additional-cni-plugins-ttr6s","openshift-multus/multus-xvfcl","openshift-network-diagnostics/network-check-target-hbnx2","openshift-network-operator/iptables-alerter-vq5sc","openshift-image-registry/node-ca-t9srw"]
May 21 19:21:56.979551 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.979533    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:21:56.979635 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.979615    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:21:56.981675 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.981652    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:56.984480 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.984464    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-htbxc"
May 21 19:21:56.987134 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.987116    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:56.987838 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.987821    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 19:21:56.987949 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.987934    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 19:21:56.988016 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.987936    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 19:21:56.988989 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.988972    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 19:21:56.988989 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.988995    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 19:21:56.989105 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.989000    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 19:21:56.989447 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.989300    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 19:21:56.989447 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.989420    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 19:21:56.989696 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.989677    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n9qqv\""
May 21 19:21:56.989826 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.989740    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 19:21:56.990032 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.990004    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f6rl5\""
May 21 19:21:56.991037 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.990967    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 19:16:55 +0000 UTC" deadline="2028-02-19 23:46:00.210628438 +0000 UTC"
May 21 19:21:56.991124 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.991040    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15340h24m3.21959572s"
May 21 19:21:56.991220 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.991204    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:56.991474 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.991457    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 19:21:56.991686 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.991668    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 19:21:56.991755 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.991725    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d8zvk\""
May 21 19:21:56.994294 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.994276    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:56.994738 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.994724    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 19:21:56.994805 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.994742    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 19:21:56.994861 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.994848    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zgsp7\""
May 21 19:21:56.994922 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.994904    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 19:21:56.996525 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.996511    2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal"
May 21 19:21:56.997022 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.997007    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xvfcl"
May 21 19:21:56.999821 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999520    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:21:56.999821 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:56.999578    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:21:56.999821 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-slash\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:56.999821 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-run-ovn-kubernetes\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:56.999821 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-sysconfig\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:56.999821 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-systemd-units\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:56.999821 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-cni-bin\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999820    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d13e3eb-8d50-47df-aca6-36250e6879ef-tmp\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999880    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-run-multus-certs\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8502922-374c-42fa-81fc-5c84e567160d-konnectivity-ca\") pod \"konnectivity-agent-htbxc\" (UID: \"e8502922-374c-42fa-81fc-5c84e567160d\") " pod="kube-system/konnectivity-agent-htbxc"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999952    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-host\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:56.999989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-var-lib-cni-multus\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-ovnkube-config\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-os-release\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000051    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-run-k8s-cni-cncf-io\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8502922-374c-42fa-81fc-5c84e567160d-agent-certs\") pod \"konnectivity-agent-htbxc\" (UID: \"e8502922-374c-42fa-81fc-5c84e567160d\") " pod="kube-system/konnectivity-agent-htbxc"
May 21 19:21:57.000140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-run-netns\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-socket-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mwnf\" (UniqueName: \"kubernetes.io/projected/33182995-abfd-4467-9d2a-828911d31442-kube-api-access-8mwnf\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-tuned\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh6hs\" (UniqueName: \"kubernetes.io/projected/3d13e3eb-8d50-47df-aca6-36250e6879ef-kube-api-access-kh6hs\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-run-systemd\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-etc-openvswitch\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-cnibin\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000355    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-run-netns\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-multus-conf-dir\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-run-openvswitch\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-log-socket\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-registration-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-run\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-sys\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.000632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-system-cni-dir\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-node-log\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-var-lib-kubelet\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000687    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntgpk\" (UniqueName: \"kubernetes.io/projected/436f4980-65b4-4e97-977a-c528d1e457c0-kube-api-access-ntgpk\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-kubelet\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-env-overrides\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000757    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-ovn-node-metrics-cert\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-sysctl-d\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-sysctl-conf\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-system-cni-dir\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-cnibin\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-hostroot\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpkg9\" (UniqueName: \"kubernetes.io/projected/e3d90a5c-0097-4291-963e-4e74460ff759-kube-api-access-dpkg9\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-device-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000952    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-modprobe-d\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.001417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.000977    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e87343e5-2e9b-417a-bec0-31a01060f9fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/436f4980-65b4-4e97-977a-c528d1e457c0-multus-daemon-config\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-etc-kubernetes\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-etc-selinux\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001084    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e87343e5-2e9b-417a-bec0-31a01060f9fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001087    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bcz7\" (UniqueName: \"kubernetes.io/projected/e87343e5-2e9b-417a-bec0-31a01060f9fe-kube-api-access-7bcz7\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-run-ovn\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-systemd\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-var-lib-kubelet\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001242    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-cni-netd\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jm2p\" (UniqueName: \"kubernetes.io/projected/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-kube-api-access-8jm2p\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-kubernetes\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-multus-cni-dir\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-multus-socket-dir-parent\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001376    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-var-lib-cni-bin\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-sys-fs\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.001885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-lib-modules\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.002471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e87343e5-2e9b-417a-bec0-31a01060f9fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.002471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/436f4980-65b4-4e97-977a-c528d1e457c0-cni-binary-copy\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.002471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-ovnkube-script-lib\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.002471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-os-release\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.002471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.001554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-var-lib-openvswitch\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.002471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.002014    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.002471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.002334    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5l46z\""
May 21 19:21:57.004834 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.004817    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.005096 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.005072    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 19:21:57.005205 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.005160    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 19:21:57.005320 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.005306    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 19:21:57.005394 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.005310    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 19:21:57.005394 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.005338    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 19:21:57.005394 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.005351    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clgtf\""
May 21 19:21:57.005577 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.005410    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 19:21:57.005577 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.005484    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cll4b\""
May 21 19:21:57.009676 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.009661    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 19:21:57.010745 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.010730    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 19:21:57.010877 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.010802    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 19:21:57.010877 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.010859    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 19:21:57.011138 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.011119    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z4b8j\""
May 21 19:21:57.017958 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.017942    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 19:21:57.018071 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.017994    2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"
May 21 19:21:57.018367 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.018354    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal"]
May 21 19:21:57.018804 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.018788    2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 19:21:57.040973 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.040951    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 19:21:57.041086 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.041069    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal"]
May 21 19:21:57.086889 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.086870    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zhq7f"
May 21 19:21:57.097024 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.097007    2561 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 19:21:57.101843 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.101824    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.101910 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.101850    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8502922-374c-42fa-81fc-5c84e567160d-agent-certs\") pod \"konnectivity-agent-htbxc\" (UID: \"e8502922-374c-42fa-81fc-5c84e567160d\") " pod="kube-system/konnectivity-agent-htbxc"
May 21 19:21:57.101910 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.101868    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-run-netns\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.101910 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.101882    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-socket-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.101910 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.101898    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mwnf\" (UniqueName: \"kubernetes.io/projected/33182995-abfd-4467-9d2a-828911d31442-kube-api-access-8mwnf\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.102068 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.101974    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-run-netns\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.102068 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102038    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.102068 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102049    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-socket-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.102227 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102074    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-tuned\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.102227 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102102    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kh6hs\" (UniqueName: \"kubernetes.io/projected/3d13e3eb-8d50-47df-aca6-36250e6879ef-kube-api-access-kh6hs\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.102227 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102117    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-run-systemd\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.102227 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102141    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-etc-openvswitch\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.102227 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102165    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-cnibin\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.102227 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102203    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-run-netns\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102222    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-run-systemd\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102239    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-etc-openvswitch\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102246    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-run-netns\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102268    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-cnibin\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102295    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-multus-conf-dir\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0d007d9-cf16-45c8-a6f7-1194d5c660aa-host\") pod \"node-ca-t9srw\" (UID: \"e0d007d9-cf16-45c8-a6f7-1194d5c660aa\") " pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102384    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-multus-conf-dir\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102390    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-run-openvswitch\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102425    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-log-socket\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102444    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-run-openvswitch\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102451    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102430    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102479    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102505    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-registration-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102520    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102532    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-run\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.102550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102560    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-sys\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102577    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-registration-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102584    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-system-cni-dir\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102608    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-node-log\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102623    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-run\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.102609    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102652    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-sys\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102679    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-system-cni-dir\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102634    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102672    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-node-log\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.102724    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs podName:e3d90a5c-0097-4291-963e-4e74460ff759 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:57.602698204 +0000 UTC m=+2.110103399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs") pod "network-metrics-daemon-x8nv7" (UID: "e3d90a5c-0097-4291-963e-4e74460ff759") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102466    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-log-socket\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102772    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-var-lib-kubelet\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102780    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102804    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntgpk\" (UniqueName: \"kubernetes.io/projected/436f4980-65b4-4e97-977a-c528d1e457c0-kube-api-access-ntgpk\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102823    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-var-lib-kubelet\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102831    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-kubelet\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.103283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102856    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-env-overrides\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102880    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-ovn-node-metrics-cert\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102883    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-kubelet\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102900    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-sysctl-d\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102920    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-sysctl-conf\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102942    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-system-cni-dir\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102962    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-cnibin\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.102983    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-hostroot\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103002    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpkg9\" (UniqueName: \"kubernetes.io/projected/e3d90a5c-0097-4291-963e-4e74460ff759-kube-api-access-dpkg9\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103021    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-device-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103041    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-modprobe-d\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103050    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-system-cni-dir\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103061    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e87343e5-2e9b-417a-bec0-31a01060f9fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103083    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/436f4980-65b4-4e97-977a-c528d1e457c0-multus-daemon-config\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103104    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-etc-kubernetes\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47dh2\" (UniqueName: \"kubernetes.io/projected/e0d007d9-cf16-45c8-a6f7-1194d5c660aa-kube-api-access-47dh2\") pod \"node-ca-t9srw\" (UID: \"e0d007d9-cf16-45c8-a6f7-1194d5c660aa\") " pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103149    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-etc-selinux\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.104211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103164    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-sysctl-d\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103169    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e87343e5-2e9b-417a-bec0-31a01060f9fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103213    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bcz7\" (UniqueName: \"kubernetes.io/projected/e87343e5-2e9b-417a-bec0-31a01060f9fe-kube-api-access-7bcz7\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdcc47c3-9b53-479a-a215-41877f6ae0c0-host-slash\") pod \"iptables-alerter-vq5sc\" (UID: \"cdcc47c3-9b53-479a-a215-41877f6ae0c0\") " pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103264    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-run-ovn\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103287    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-systemd\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103292    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-sysctl-conf\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103326    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-var-lib-kubelet\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103338    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-env-overrides\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0d007d9-cf16-45c8-a6f7-1194d5c660aa-serviceca\") pod \"node-ca-t9srw\" (UID: \"e0d007d9-cf16-45c8-a6f7-1194d5c660aa\") " pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103380    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-cni-netd\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103401    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jm2p\" (UniqueName: \"kubernetes.io/projected/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-kube-api-access-8jm2p\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103424    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-kubernetes\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103450    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-multus-cni-dir\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103467    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-var-lib-kubelet\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103475    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-multus-socket-dir-parent\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103501    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-var-lib-cni-bin\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.104947 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph7bz\" (UniqueName: \"kubernetes.io/projected/cdcc47c3-9b53-479a-a215-41877f6ae0c0-kube-api-access-ph7bz\") pod \"iptables-alerter-vq5sc\" (UID: \"cdcc47c3-9b53-479a-a215-41877f6ae0c0\") " pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103553    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-sys-fs\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103579    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-lib-modules\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103606    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e87343e5-2e9b-417a-bec0-31a01060f9fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103607    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-systemd\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103644    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-etc-kubernetes\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103659    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-cni-netd\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103676    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/436f4980-65b4-4e97-977a-c528d1e457c0-cni-binary-copy\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103706    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-ovnkube-script-lib\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103729    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-os-release\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103752    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-var-lib-openvswitch\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103775    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-slash\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103802    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-run-ovn-kubernetes\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103826    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-sysconfig\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdcc47c3-9b53-479a-a215-41877f6ae0c0-iptables-alerter-script\") pod \"iptables-alerter-vq5sc\" (UID: \"cdcc47c3-9b53-479a-a215-41877f6ae0c0\") " pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103881    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-systemd-units\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103911    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-cni-bin\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.105710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103937    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d13e3eb-8d50-47df-aca6-36250e6879ef-tmp\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103955    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/436f4980-65b4-4e97-977a-c528d1e457c0-multus-daemon-config\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.103965    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-run-multus-certs\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104012    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-run-multus-certs\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104001    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8502922-374c-42fa-81fc-5c84e567160d-konnectivity-ca\") pod \"konnectivity-agent-htbxc\" (UID: \"e8502922-374c-42fa-81fc-5c84e567160d\") " pod="kube-system/konnectivity-agent-htbxc"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104064    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-host\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104075    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-cnibin\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104091    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-var-lib-cni-multus\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104110    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-hostroot\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104202    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-run-ovn-kubernetes\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104365    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-ovnkube-config\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104426    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-var-lib-openvswitch\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104460    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-device-dir\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104536    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-os-release\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104539    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-slash\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104566    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-run-k8s-cni-cncf-io\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104598    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-sysconfig\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.106304 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104633    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-host-cni-bin\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104673    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-host\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104705    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-run-ovn\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104738    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8502922-374c-42fa-81fc-5c84e567160d-konnectivity-ca\") pod \"konnectivity-agent-htbxc\" (UID: \"e8502922-374c-42fa-81fc-5c84e567160d\") " pod="kube-system/konnectivity-agent-htbxc"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104775    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-etc-selinux\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104806    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-os-release\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104932    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-var-lib-cni-bin\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.104978    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-kubernetes\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105048    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-ovnkube-config\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105321    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-multus-socket-dir-parent\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105351    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/436f4980-65b4-4e97-977a-c528d1e457c0-cni-binary-copy\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105367    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33182995-abfd-4467-9d2a-828911d31442-sys-fs\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105394    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e87343e5-2e9b-417a-bec0-31a01060f9fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105416    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e87343e5-2e9b-417a-bec0-31a01060f9fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105420    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-modprobe-d\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105471    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-systemd-units\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105498    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d13e3eb-8d50-47df-aca6-36250e6879ef-lib-modules\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105558    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e87343e5-2e9b-417a-bec0-31a01060f9fe-os-release\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.106833 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105627    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-var-lib-cni-multus\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.107505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105696    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-multus-cni-dir\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.107505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105987    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-ovnkube-script-lib\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.107505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105992    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e87343e5-2e9b-417a-bec0-31a01060f9fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.107505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.106104    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-ovn-node-metrics-cert\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.107505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.106348    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d13e3eb-8d50-47df-aca6-36250e6879ef-etc-tuned\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.107505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.106529    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8502922-374c-42fa-81fc-5c84e567160d-agent-certs\") pod \"konnectivity-agent-htbxc\" (UID: \"e8502922-374c-42fa-81fc-5c84e567160d\") " pod="kube-system/konnectivity-agent-htbxc"
May 21 19:21:57.107505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.105730    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/436f4980-65b4-4e97-977a-c528d1e457c0-host-run-k8s-cni-cncf-io\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.107505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.107478    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d13e3eb-8d50-47df-aca6-36250e6879ef-tmp\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.118047 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.118029    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zhq7f"
May 21 19:21:57.119830 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.119809    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mwnf\" (UniqueName: \"kubernetes.io/projected/33182995-abfd-4467-9d2a-828911d31442-kube-api-access-8mwnf\") pod \"aws-ebs-csi-driver-node-zr8v9\" (UID: \"33182995-abfd-4467-9d2a-828911d31442\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.126671 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.126654    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh6hs\" (UniqueName: \"kubernetes.io/projected/3d13e3eb-8d50-47df-aca6-36250e6879ef-kube-api-access-kh6hs\") pod \"tuned-9gd6s\" (UID: \"3d13e3eb-8d50-47df-aca6-36250e6879ef\") " pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.126969 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.126956    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bcz7\" (UniqueName: \"kubernetes.io/projected/e87343e5-2e9b-417a-bec0-31a01060f9fe-kube-api-access-7bcz7\") pod \"multus-additional-cni-plugins-ttr6s\" (UID: \"e87343e5-2e9b-417a-bec0-31a01060f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.131855 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.131834    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntgpk\" (UniqueName: \"kubernetes.io/projected/436f4980-65b4-4e97-977a-c528d1e457c0-kube-api-access-ntgpk\") pod \"multus-xvfcl\" (UID: \"436f4980-65b4-4e97-977a-c528d1e457c0\") " pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.135473 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.135452    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpkg9\" (UniqueName: \"kubernetes.io/projected/e3d90a5c-0097-4291-963e-4e74460ff759-kube-api-access-dpkg9\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:21:57.136239 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.136222    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jm2p\" (UniqueName: \"kubernetes.io/projected/c4ba0aaf-12d7-4f9c-86fc-96c9f353c002-kube-api-access-8jm2p\") pod \"ovnkube-node-hnsn4\" (UID: \"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.150156 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:57.150133    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cb852938d3e2368f6d966251b07f42.slice/crio-2638177fcd8bd4742910ea3c7c7b7398bcd4a529830493ccee55a41ba3cd2ef6 WatchSource:0}: Error finding container 2638177fcd8bd4742910ea3c7c7b7398bcd4a529830493ccee55a41ba3cd2ef6: Status 404 returned error can't find the container with id 2638177fcd8bd4742910ea3c7c7b7398bcd4a529830493ccee55a41ba3cd2ef6
May 21 19:21:57.153704 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.153689    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 19:21:57.159376 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:57.159329    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b768a409215e383b7f390a64a731c19.slice/crio-7240bfe37dd3b564c55d37109ddc3181c3a636815b2f94149f6cf5c13487f677 WatchSource:0}: Error finding container 7240bfe37dd3b564c55d37109ddc3181c3a636815b2f94149f6cf5c13487f677: Status 404 returned error can't find the container with id 7240bfe37dd3b564c55d37109ddc3181c3a636815b2f94149f6cf5c13487f677
May 21 19:21:57.205537 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.205507    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47dh2\" (UniqueName: \"kubernetes.io/projected/e0d007d9-cf16-45c8-a6f7-1194d5c660aa-kube-api-access-47dh2\") pod \"node-ca-t9srw\" (UID: \"e0d007d9-cf16-45c8-a6f7-1194d5c660aa\") " pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.205537 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.205537    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdcc47c3-9b53-479a-a215-41877f6ae0c0-host-slash\") pod \"iptables-alerter-vq5sc\" (UID: \"cdcc47c3-9b53-479a-a215-41877f6ae0c0\") " pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.205696 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.205559    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0d007d9-cf16-45c8-a6f7-1194d5c660aa-serviceca\") pod \"node-ca-t9srw\" (UID: \"e0d007d9-cf16-45c8-a6f7-1194d5c660aa\") " pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.205696 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.205587    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ph7bz\" (UniqueName: \"kubernetes.io/projected/cdcc47c3-9b53-479a-a215-41877f6ae0c0-kube-api-access-ph7bz\") pod \"iptables-alerter-vq5sc\" (UID: \"cdcc47c3-9b53-479a-a215-41877f6ae0c0\") " pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.205696 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.205619    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdcc47c3-9b53-479a-a215-41877f6ae0c0-iptables-alerter-script\") pod \"iptables-alerter-vq5sc\" (UID: \"cdcc47c3-9b53-479a-a215-41877f6ae0c0\") " pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.205696 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.205647    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:21:57.205696 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.205649    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdcc47c3-9b53-479a-a215-41877f6ae0c0-host-slash\") pod \"iptables-alerter-vq5sc\" (UID: \"cdcc47c3-9b53-479a-a215-41877f6ae0c0\") " pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.205696 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.205682    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0d007d9-cf16-45c8-a6f7-1194d5c660aa-host\") pod \"node-ca-t9srw\" (UID: \"e0d007d9-cf16-45c8-a6f7-1194d5c660aa\") " pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.206033 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.205764    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0d007d9-cf16-45c8-a6f7-1194d5c660aa-host\") pod \"node-ca-t9srw\" (UID: \"e0d007d9-cf16-45c8-a6f7-1194d5c660aa\") " pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.206079 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.206057    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdcc47c3-9b53-479a-a215-41877f6ae0c0-iptables-alerter-script\") pod \"iptables-alerter-vq5sc\" (UID: \"cdcc47c3-9b53-479a-a215-41877f6ae0c0\") " pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.206612 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.206592    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0d007d9-cf16-45c8-a6f7-1194d5c660aa-serviceca\") pod \"node-ca-t9srw\" (UID: \"e0d007d9-cf16-45c8-a6f7-1194d5c660aa\") " pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.213130 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.213112    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 19:21:57.213130 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.213131    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 19:21:57.213306 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.213143    2561 projected.go:194] Error preparing data for projected volume kube-api-access-scrt8 for pod openshift-network-diagnostics/network-check-target-hbnx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:21:57.213306 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.213224    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8 podName:2df00083-e032-4383-b58c-f03051c26794 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:57.713205351 +0000 UTC m=+2.220610531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-scrt8" (UniqueName: "kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8") pod "network-check-target-hbnx2" (UID: "2df00083-e032-4383-b58c-f03051c26794") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:21:57.215146 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.215131    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47dh2\" (UniqueName: \"kubernetes.io/projected/e0d007d9-cf16-45c8-a6f7-1194d5c660aa-kube-api-access-47dh2\") pod \"node-ca-t9srw\" (UID: \"e0d007d9-cf16-45c8-a6f7-1194d5c660aa\") " pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.215355 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.215339    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph7bz\" (UniqueName: \"kubernetes.io/projected/cdcc47c3-9b53-479a-a215-41877f6ae0c0-kube-api-access-ph7bz\") pod \"iptables-alerter-vq5sc\" (UID: \"cdcc47c3-9b53-479a-a215-41877f6ae0c0\") " pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.302631 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.302538    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:21:57.309078 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:57.309044    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ba0aaf_12d7_4f9c_86fc_96c9f353c002.slice/crio-f0ab5b5d8038f3c23b19292dc4564caa8910d35ec85d0688e1ab4986a490da8e WatchSource:0}: Error finding container f0ab5b5d8038f3c23b19292dc4564caa8910d35ec85d0688e1ab4986a490da8e: Status 404 returned error can't find the container with id f0ab5b5d8038f3c23b19292dc4564caa8910d35ec85d0688e1ab4986a490da8e
May 21 19:21:57.317808 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.317789    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-htbxc"
May 21 19:21:57.326085 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.326059    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9"
May 21 19:21:57.333335 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:57.333314    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33182995_abfd_4467_9d2a_828911d31442.slice/crio-d96466c7436a0c9c06d30a1810c5a34f81ff3a0b8784a6a3e8a0546c8e1c61ef WatchSource:0}: Error finding container d96466c7436a0c9c06d30a1810c5a34f81ff3a0b8784a6a3e8a0546c8e1c61ef: Status 404 returned error can't find the container with id d96466c7436a0c9c06d30a1810c5a34f81ff3a0b8784a6a3e8a0546c8e1c61ef
May 21 19:21:57.353908 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.353890    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9gd6s"
May 21 19:21:57.359301 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.359281    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ttr6s"
May 21 19:21:57.359530 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:57.359506    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d13e3eb_8d50_47df_aca6_36250e6879ef.slice/crio-2c4006c30f8eedfd6c39c642ee9ffa583352734f3c0725ed71d1a10f75ff9b1e WatchSource:0}: Error finding container 2c4006c30f8eedfd6c39c642ee9ffa583352734f3c0725ed71d1a10f75ff9b1e: Status 404 returned error can't find the container with id 2c4006c30f8eedfd6c39c642ee9ffa583352734f3c0725ed71d1a10f75ff9b1e
May 21 19:21:57.366828 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:57.366808    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87343e5_2e9b_417a_bec0_31a01060f9fe.slice/crio-2480a58743bfaa728f11beb12bcf5514ee1b470fb6bcfb3ebd26e91140e6980c WatchSource:0}: Error finding container 2480a58743bfaa728f11beb12bcf5514ee1b470fb6bcfb3ebd26e91140e6980c: Status 404 returned error can't find the container with id 2480a58743bfaa728f11beb12bcf5514ee1b470fb6bcfb3ebd26e91140e6980c
May 21 19:21:57.380422 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.380407    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xvfcl"
May 21 19:21:57.386236 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:57.386212    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436f4980_65b4_4e97_977a_c528d1e457c0.slice/crio-93083a99c806e1bbcd6aa42b0453aca0355654b619fc9fe4a71493c491e9968c WatchSource:0}: Error finding container 93083a99c806e1bbcd6aa42b0453aca0355654b619fc9fe4a71493c491e9968c: Status 404 returned error can't find the container with id 93083a99c806e1bbcd6aa42b0453aca0355654b619fc9fe4a71493c491e9968c
May 21 19:21:57.403062 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.403044    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vq5sc"
May 21 19:21:57.408655 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:57.408636    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdcc47c3_9b53_479a_a215_41877f6ae0c0.slice/crio-2d8302ee0f03ecf75feb686b70cb8b37e7eb48ec0748a5a55a457ce61dff0b3e WatchSource:0}: Error finding container 2d8302ee0f03ecf75feb686b70cb8b37e7eb48ec0748a5a55a457ce61dff0b3e: Status 404 returned error can't find the container with id 2d8302ee0f03ecf75feb686b70cb8b37e7eb48ec0748a5a55a457ce61dff0b3e
May 21 19:21:57.415521 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.415507    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t9srw"
May 21 19:21:57.421150 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:21:57.421122    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d007d9_cf16_45c8_a6f7_1194d5c660aa.slice/crio-1a41432c435d45722adf0cb5655d2df1ddd495352b120b16d9de973d12c35d1e WatchSource:0}: Error finding container 1a41432c435d45722adf0cb5655d2df1ddd495352b120b16d9de973d12c35d1e: Status 404 returned error can't find the container with id 1a41432c435d45722adf0cb5655d2df1ddd495352b120b16d9de973d12c35d1e
May 21 19:21:57.609135 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.609099    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:21:57.609317 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.609256    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:21:57.609379 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.609325    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs podName:e3d90a5c-0097-4291-963e-4e74460ff759 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:58.609306411 +0000 UTC m=+3.116711580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs") pod "network-metrics-daemon-x8nv7" (UID: "e3d90a5c-0097-4291-963e-4e74460ff759") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:21:57.811267 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.811235    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:21:57.811448 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.811427    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 19:21:57.811448 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.811448    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 19:21:57.811563 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.811461    2561 projected.go:194] Error preparing data for projected volume kube-api-access-scrt8 for pod openshift-network-diagnostics/network-check-target-hbnx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:21:57.811563 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:57.811517    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8 podName:2df00083-e032-4383-b58c-f03051c26794 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:58.811499002 +0000 UTC m=+3.318904188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-scrt8" (UniqueName: "kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8") pod "network-check-target-hbnx2" (UID: "2df00083-e032-4383-b58c-f03051c26794") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:21:57.914632 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.914395    2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 19:21:57.922400 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:57.922378    2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 19:21:58.118596 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.118556    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 19:16:57 +0000 UTC" deadline="2028-02-05 13:56:02.263529032 +0000 UTC"
May 21 19:21:58.118596 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.118595    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14994h34m4.144939351s"
May 21 19:21:58.145058 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.145000    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9" event={"ID":"33182995-abfd-4467-9d2a-828911d31442","Type":"ContainerStarted","Data":"d96466c7436a0c9c06d30a1810c5a34f81ff3a0b8784a6a3e8a0546c8e1c61ef"}
May 21 19:21:58.148839 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.148706    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-htbxc" event={"ID":"e8502922-374c-42fa-81fc-5c84e567160d","Type":"ContainerStarted","Data":"8cd989f615460ea9b4654c41d1676d52723a8df099dfaa4b9498d8e30c68811f"}
May 21 19:21:58.167052 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.166986    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerStarted","Data":"f0ab5b5d8038f3c23b19292dc4564caa8910d35ec85d0688e1ab4986a490da8e"}
May 21 19:21:58.177653 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.177623    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal" event={"ID":"4b768a409215e383b7f390a64a731c19","Type":"ContainerStarted","Data":"7240bfe37dd3b564c55d37109ddc3181c3a636815b2f94149f6cf5c13487f677"}
May 21 19:21:58.211545 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.211511    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vq5sc" event={"ID":"cdcc47c3-9b53-479a-a215-41877f6ae0c0","Type":"ContainerStarted","Data":"2d8302ee0f03ecf75feb686b70cb8b37e7eb48ec0748a5a55a457ce61dff0b3e"}
May 21 19:21:58.215535 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.215480    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xvfcl" event={"ID":"436f4980-65b4-4e97-977a-c528d1e457c0","Type":"ContainerStarted","Data":"93083a99c806e1bbcd6aa42b0453aca0355654b619fc9fe4a71493c491e9968c"}
May 21 19:21:58.220397 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.220285    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9gd6s" event={"ID":"3d13e3eb-8d50-47df-aca6-36250e6879ef","Type":"ContainerStarted","Data":"2c4006c30f8eedfd6c39c642ee9ffa583352734f3c0725ed71d1a10f75ff9b1e"}
May 21 19:21:58.231042 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.230977    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal" event={"ID":"55cb852938d3e2368f6d966251b07f42","Type":"ContainerStarted","Data":"2638177fcd8bd4742910ea3c7c7b7398bcd4a529830493ccee55a41ba3cd2ef6"}
May 21 19:21:58.252585 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.252526    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t9srw" event={"ID":"e0d007d9-cf16-45c8-a6f7-1194d5c660aa","Type":"ContainerStarted","Data":"1a41432c435d45722adf0cb5655d2df1ddd495352b120b16d9de973d12c35d1e"}
May 21 19:21:58.264274 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.264247    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttr6s" event={"ID":"e87343e5-2e9b-417a-bec0-31a01060f9fe","Type":"ContainerStarted","Data":"2480a58743bfaa728f11beb12bcf5514ee1b470fb6bcfb3ebd26e91140e6980c"}
May 21 19:21:58.617479 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.617441    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:21:58.617646 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:58.617611    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:21:58.617715 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:58.617674    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs podName:e3d90a5c-0097-4291-963e-4e74460ff759 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:00.617653717 +0000 UTC m=+5.125058889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs") pod "network-metrics-daemon-x8nv7" (UID: "e3d90a5c-0097-4291-963e-4e74460ff759") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:21:58.818917 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:58.818882    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:21:58.819088 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:58.819064    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 19:21:58.819088 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:58.819084    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 19:21:58.819221 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:58.819097    2561 projected.go:194] Error preparing data for projected volume kube-api-access-scrt8 for pod openshift-network-diagnostics/network-check-target-hbnx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:21:58.819221 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:58.819153    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8 podName:2df00083-e032-4383-b58c-f03051c26794 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:00.819134358 +0000 UTC m=+5.326539524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-scrt8" (UniqueName: "kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8") pod "network-check-target-hbnx2" (UID: "2df00083-e032-4383-b58c-f03051c26794") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:21:59.108983 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:59.108945    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:21:59.109487 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:59.109083    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:21:59.109562 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:59.109540    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:21:59.109691 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:21:59.109645    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:21:59.119529 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:59.119425    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 19:16:57 +0000 UTC" deadline="2027-12-03 09:47:36.25852758 +0000 UTC"
May 21 19:21:59.119529 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:21:59.119466    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13454h25m37.139066247s"
May 21 19:22:00.635773 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:00.635723    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:00.636251 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:00.635893    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:22:00.636251 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:00.635969    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs podName:e3d90a5c-0097-4291-963e-4e74460ff759 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:04.635951285 +0000 UTC m=+9.143356464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs") pod "network-metrics-daemon-x8nv7" (UID: "e3d90a5c-0097-4291-963e-4e74460ff759") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:22:00.837077 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:00.837042    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:00.837273 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:00.837256    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 19:22:00.837354 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:00.837282    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 19:22:00.837354 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:00.837298    2561 projected.go:194] Error preparing data for projected volume kube-api-access-scrt8 for pod openshift-network-diagnostics/network-check-target-hbnx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:22:00.837459 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:00.837359    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8 podName:2df00083-e032-4383-b58c-f03051c26794 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:04.837339534 +0000 UTC m=+9.344744703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-scrt8" (UniqueName: "kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8") pod "network-check-target-hbnx2" (UID: "2df00083-e032-4383-b58c-f03051c26794") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:22:01.109486 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:01.109439    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:01.109665 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:01.109607    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:01.109986 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:01.109965    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:01.110094 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:01.110071    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:02.117462 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.117432    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7rtcc"]
May 21 19:22:02.120460 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.120438    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.120589 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:02.120506    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:02.149363 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.149331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.149491 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.149384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-kubelet-config\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.149491 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.149400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-dbus\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.249744 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.249708    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-kubelet-config\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.249919 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.249758    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-dbus\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.249919 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.249822    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.249919 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.249846    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-kubelet-config\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.250082 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:02.249934    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 19:22:02.250082 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.249970    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-dbus\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.250082 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:02.249990    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret podName:b8f6e07b-b44a-4bcd-9c32-d424e692f1c2 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:02.749972598 +0000 UTC m=+7.257377767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret") pod "global-pull-secret-syncer-7rtcc" (UID: "b8f6e07b-b44a-4bcd-9c32-d424e692f1c2") : object "kube-system"/"original-pull-secret" not registered
May 21 19:22:02.753205 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:02.753149    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:02.753397 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:02.753308    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 19:22:02.753397 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:02.753369    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret podName:b8f6e07b-b44a-4bcd-9c32-d424e692f1c2 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:03.75335093 +0000 UTC m=+8.260756114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret") pod "global-pull-secret-syncer-7rtcc" (UID: "b8f6e07b-b44a-4bcd-9c32-d424e692f1c2") : object "kube-system"/"original-pull-secret" not registered
May 21 19:22:03.109305 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:03.109267    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:03.109501 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:03.109398    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:03.109766 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:03.109743    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:03.109885 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:03.109823    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:03.760949 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:03.760912    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:03.761338 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:03.761076    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 19:22:03.761338 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:03.761128    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret podName:b8f6e07b-b44a-4bcd-9c32-d424e692f1c2 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:05.761115368 +0000 UTC m=+10.268520534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret") pod "global-pull-secret-syncer-7rtcc" (UID: "b8f6e07b-b44a-4bcd-9c32-d424e692f1c2") : object "kube-system"/"original-pull-secret" not registered
May 21 19:22:04.109244 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:04.109211    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:04.109406 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:04.109346    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:04.667334 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:04.667297    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:04.667522 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:04.667434    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:22:04.667522 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:04.667496    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs podName:e3d90a5c-0097-4291-963e-4e74460ff759 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:12.667477292 +0000 UTC m=+17.174882462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs") pod "network-metrics-daemon-x8nv7" (UID: "e3d90a5c-0097-4291-963e-4e74460ff759") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:22:04.868902 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:04.868866    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:04.869383 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:04.869030    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 19:22:04.869383 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:04.869056    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 19:22:04.869383 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:04.869070    2561 projected.go:194] Error preparing data for projected volume kube-api-access-scrt8 for pod openshift-network-diagnostics/network-check-target-hbnx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:22:04.869383 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:04.869135    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8 podName:2df00083-e032-4383-b58c-f03051c26794 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:12.869116273 +0000 UTC m=+17.376521455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-scrt8" (UniqueName: "kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8") pod "network-check-target-hbnx2" (UID: "2df00083-e032-4383-b58c-f03051c26794") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:22:05.109115 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:05.109078    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:05.109338 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:05.109244    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:05.109338 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:05.109257    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:05.109459 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:05.109368    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:05.777688 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:05.777646    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:05.777909 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:05.777804    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 19:22:05.777909 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:05.777871    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret podName:b8f6e07b-b44a-4bcd-9c32-d424e692f1c2 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:09.777850417 +0000 UTC m=+14.285255603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret") pod "global-pull-secret-syncer-7rtcc" (UID: "b8f6e07b-b44a-4bcd-9c32-d424e692f1c2") : object "kube-system"/"original-pull-secret" not registered
May 21 19:22:06.110564 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:06.110531    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:06.111046 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:06.110630    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:07.109963 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:07.109928    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:07.110235 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:07.109929    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:07.110235 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:07.110065    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:07.110235 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:07.110139    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:08.109433 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:08.109405    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:08.109806 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:08.109532    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:09.109807 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:09.109771    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:09.110203 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:09.109780    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:09.110203 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:09.109915    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:09.110203 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:09.110053    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:09.809323 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:09.809272    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:09.809496 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:09.809410    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 19:22:09.809496 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:09.809484    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret podName:b8f6e07b-b44a-4bcd-9c32-d424e692f1c2 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:17.80946809 +0000 UTC m=+22.316873259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret") pod "global-pull-secret-syncer-7rtcc" (UID: "b8f6e07b-b44a-4bcd-9c32-d424e692f1c2") : object "kube-system"/"original-pull-secret" not registered
May 21 19:22:10.109538 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:10.109444    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:10.109678 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:10.109580    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:11.109238 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:11.109203    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:11.109671 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:11.109206    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:11.109671 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:11.109328    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:11.109671 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:11.109429    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:12.109756 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:12.109299    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:12.109756 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:12.109428    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:12.729519 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:12.729486    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:12.729723 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:12.729627    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:22:12.729723 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:12.729681    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs podName:e3d90a5c-0097-4291-963e-4e74460ff759 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:28.729667418 +0000 UTC m=+33.237072597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs") pod "network-metrics-daemon-x8nv7" (UID: "e3d90a5c-0097-4291-963e-4e74460ff759") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:22:12.931094 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:12.931059    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:12.931288 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:12.931259    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 19:22:12.931288 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:12.931280    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 19:22:12.931401 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:12.931295    2561 projected.go:194] Error preparing data for projected volume kube-api-access-scrt8 for pod openshift-network-diagnostics/network-check-target-hbnx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:22:12.931401 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:12.931353    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8 podName:2df00083-e032-4383-b58c-f03051c26794 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:28.93133421 +0000 UTC m=+33.438739378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-scrt8" (UniqueName: "kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8") pod "network-check-target-hbnx2" (UID: "2df00083-e032-4383-b58c-f03051c26794") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:22:13.109355 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:13.109316    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:13.109548 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:13.109320    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:13.109548 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:13.109456    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:13.109548 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:13.109529    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:14.110418 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:14.109935    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:14.110418 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:14.110052    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:15.108957 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:15.108928    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:15.109135 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:15.108929    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:15.109135 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:15.109039    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:15.109135 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:15.109108    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:16.109952 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:16.109927    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:16.110219 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:16.110003    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:17.109871 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.109679    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:17.109962 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.109740    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:17.109962 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:17.109923    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:17.110461 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:17.109982    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:17.307986 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.307757    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t9srw" event={"ID":"e0d007d9-cf16-45c8-a6f7-1194d5c660aa","Type":"ContainerStarted","Data":"04922c919ad5ce870eec047840c95c249a75a3f4e0743e87b31d76af9b75239d"}
May 21 19:22:17.309143 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.309119    2561 generic.go:358] "Generic (PLEG): container finished" podID="e87343e5-2e9b-417a-bec0-31a01060f9fe" containerID="81e6c3c4c270d67ddb93bef692f04d6a4330f25bce2c8a02396aec7af92e2d28" exitCode=0
May 21 19:22:17.309292 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.309206    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttr6s" event={"ID":"e87343e5-2e9b-417a-bec0-31a01060f9fe","Type":"ContainerDied","Data":"81e6c3c4c270d67ddb93bef692f04d6a4330f25bce2c8a02396aec7af92e2d28"}
May 21 19:22:17.310734 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.310704    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9" event={"ID":"33182995-abfd-4467-9d2a-828911d31442","Type":"ContainerStarted","Data":"c15cdf02ae00534e5a890bbc9f8a5ce58b7c15ae64f32e551d4a46c1333e9281"}
May 21 19:22:17.312148 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.312118    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-htbxc" event={"ID":"e8502922-374c-42fa-81fc-5c84e567160d","Type":"ContainerStarted","Data":"59a2841422b3ae44117f8f24529f642ae8fae395e43a5f2d5de0ec15d8dc7732"}
May 21 19:22:17.314633 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.314617    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:22:17.314973 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.314953    2561 generic.go:358] "Generic (PLEG): container finished" podID="c4ba0aaf-12d7-4f9c-86fc-96c9f353c002" containerID="ab8dc674848a2827062a3474a985c9d34b5dfee315fc16c4689b3269dae5c0f9" exitCode=1
May 21 19:22:17.315044 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.315018    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerStarted","Data":"e5c38599400729b2e34fc0568c31c329229f8820fecda7dcf77c109a5d94f265"}
May 21 19:22:17.315092 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.315042    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerStarted","Data":"518d1ab7338e84a3972fc9f03eb0441231ea00f6b6e851c40f5ecad0f8ecc198"}
May 21 19:22:17.315092 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.315053    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerStarted","Data":"9c8a204f5d947eb7369207aba56825b78c24dca22134b8a2d071814e9f266684"}
May 21 19:22:17.315092 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.315066    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerStarted","Data":"c1548d72120fa1285eb90396946638027344970517644754d179c8603f02db20"}
May 21 19:22:17.315092 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.315080    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerDied","Data":"ab8dc674848a2827062a3474a985c9d34b5dfee315fc16c4689b3269dae5c0f9"}
May 21 19:22:17.315255 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.315095    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerStarted","Data":"04b1e5492a943a6f8dee4cc46cf64eb8bebc3681419916c3b50fbca344e8b3d1"}
May 21 19:22:17.316376 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.316356    2561 generic.go:358] "Generic (PLEG): container finished" podID="4b768a409215e383b7f390a64a731c19" containerID="e34953ca4fe2ce5fc5d695a870b07d49e9e71a462f40f28c0ebd961f5c67cbf1" exitCode=0
May 21 19:22:17.316485 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.316413    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal" event={"ID":"4b768a409215e383b7f390a64a731c19","Type":"ContainerDied","Data":"e34953ca4fe2ce5fc5d695a870b07d49e9e71a462f40f28c0ebd961f5c67cbf1"}
May 21 19:22:17.317799 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.317770    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xvfcl" event={"ID":"436f4980-65b4-4e97-977a-c528d1e457c0","Type":"ContainerStarted","Data":"2f79bfc964a60e6cbb13eec08ffd8081374db049a625359f43a9149317c5ee73"}
May 21 19:22:17.319258 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.319237    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9gd6s" event={"ID":"3d13e3eb-8d50-47df-aca6-36250e6879ef","Type":"ContainerStarted","Data":"98de82c7274a82914e0114ae8467041a16e994baa549fd4dc1ccc56803ccbc71"}
May 21 19:22:17.320536 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.320519    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal" event={"ID":"55cb852938d3e2368f6d966251b07f42","Type":"ContainerStarted","Data":"7181ddb006b36da8fd692167d4b3f799515d33da7e8a7bae465aec57dbb1865a"}
May 21 19:22:17.345118 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.345065    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t9srw" podStartSLOduration=2.465968071 podStartE2EDuration="21.345050573s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:21:57.422706956 +0000 UTC m=+1.930112122" lastFinishedPulling="2026-05-21 19:22:16.301789443 +0000 UTC m=+20.809194624" observedRunningTime="2026-05-21 19:22:17.344682541 +0000 UTC m=+21.852087730" watchObservedRunningTime="2026-05-21 19:22:17.345050573 +0000 UTC m=+21.852455762"
May 21 19:22:17.421886 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.421843    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xvfcl" podStartSLOduration=2.090432205 podStartE2EDuration="21.421830218s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:21:57.387633189 +0000 UTC m=+1.895038369" lastFinishedPulling="2026-05-21 19:22:16.719031213 +0000 UTC m=+21.226436382" observedRunningTime="2026-05-21 19:22:17.386495965 +0000 UTC m=+21.893901153" watchObservedRunningTime="2026-05-21 19:22:17.421830218 +0000 UTC m=+21.929235405"
May 21 19:22:17.487928 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.487865    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-htbxc" podStartSLOduration=7.266917295 podStartE2EDuration="21.487850273s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:21:57.327238603 +0000 UTC m=+1.834643769" lastFinishedPulling="2026-05-21 19:22:11.548171574 +0000 UTC m=+16.055576747" observedRunningTime="2026-05-21 19:22:17.422157165 +0000 UTC m=+21.929562354" watchObservedRunningTime="2026-05-21 19:22:17.487850273 +0000 UTC m=+21.995255461"
May 21 19:22:17.488110 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.488010    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9gd6s" podStartSLOduration=2.542525524 podStartE2EDuration="21.48800544s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:21:57.361480591 +0000 UTC m=+1.868885762" lastFinishedPulling="2026-05-21 19:22:16.306960512 +0000 UTC m=+20.814365678" observedRunningTime="2026-05-21 19:22:17.487415551 +0000 UTC m=+21.994820740" watchObservedRunningTime="2026-05-21 19:22:17.48800544 +0000 UTC m=+21.995410627"
May 21 19:22:17.679578 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.679493    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-158.ec2.internal" podStartSLOduration=20.679476282 podStartE2EDuration="20.679476282s" podCreationTimestamp="2026-05-21 19:21:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:22:17.59153534 +0000 UTC m=+22.098940528" watchObservedRunningTime="2026-05-21 19:22:17.679476282 +0000 UTC m=+22.186881490"
May 21 19:22:17.869627 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.869600    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:17.869762 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:17.869741    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 19:22:17.869835 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:17.869814    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret podName:b8f6e07b-b44a-4bcd-9c32-d424e692f1c2 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:33.8697954 +0000 UTC m=+38.377200583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret") pod "global-pull-secret-syncer-7rtcc" (UID: "b8f6e07b-b44a-4bcd-9c32-d424e692f1c2") : object "kube-system"/"original-pull-secret" not registered
May 21 19:22:17.925280 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:17.925259    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 19:22:18.070602 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.070513    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T19:22:17.925276319Z","UUID":"8ea0b315-7778-47f2-b789-33c71dde5ebe","Handler":null,"Name":"","Endpoint":""}
May 21 19:22:18.072162 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.072146    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 19:22:18.072277 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.072168    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 19:22:18.108937 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.108913    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:18.109056 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:18.109003    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:18.323715 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.323627    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9" event={"ID":"33182995-abfd-4467-9d2a-828911d31442","Type":"ContainerStarted","Data":"e10459e63dc93d91850d1c2713daddc7ed51c7c3640b977a10f9966608d70544"}
May 21 19:22:18.325372 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.325338    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal" event={"ID":"4b768a409215e383b7f390a64a731c19","Type":"ContainerStarted","Data":"b9f15e785c84562377f3ea593e390e8e8b0be99e47e6e02b6e4fb0b851d9523b"}
May 21 19:22:18.326836 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.326809    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vq5sc" event={"ID":"cdcc47c3-9b53-479a-a215-41877f6ae0c0","Type":"ContainerStarted","Data":"6e8603b151f46a3c79fdcccb2d6aa320a5df9ac3e94e9ae4fd978d9950c29681"}
May 21 19:22:18.385531 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.385508    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-fdkxx"]
May 21 19:22:18.388450 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.388431    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.390260 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.390215    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-158.ec2.internal" podStartSLOduration=21.390163378 podStartE2EDuration="21.390163378s" podCreationTimestamp="2026-05-21 19:21:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:22:18.387994789 +0000 UTC m=+22.895399978" watchObservedRunningTime="2026-05-21 19:22:18.390163378 +0000 UTC m=+22.897568566"
May 21 19:22:18.397530 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.397508    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 19:22:18.398423 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.398406    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 19:22:18.401051 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.401027    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7n6hg\""
May 21 19:22:18.474129 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.474101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94e87198-ccf9-4a1b-a75f-07438394dd10-hosts-file\") pod \"node-resolver-fdkxx\" (UID: \"94e87198-ccf9-4a1b-a75f-07438394dd10\") " pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.474291 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.474269    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9st99\" (UniqueName: \"kubernetes.io/projected/94e87198-ccf9-4a1b-a75f-07438394dd10-kube-api-access-9st99\") pod \"node-resolver-fdkxx\" (UID: \"94e87198-ccf9-4a1b-a75f-07438394dd10\") " pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.474353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.474329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e87198-ccf9-4a1b-a75f-07438394dd10-tmp-dir\") pod \"node-resolver-fdkxx\" (UID: \"94e87198-ccf9-4a1b-a75f-07438394dd10\") " pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.506782 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.506579    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vq5sc" podStartSLOduration=3.644761239 podStartE2EDuration="22.506559194s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:21:57.410123318 +0000 UTC m=+1.917528485" lastFinishedPulling="2026-05-21 19:22:16.271921261 +0000 UTC m=+20.779326440" observedRunningTime="2026-05-21 19:22:18.504930592 +0000 UTC m=+23.012335779" watchObservedRunningTime="2026-05-21 19:22:18.506559194 +0000 UTC m=+23.013964383"
May 21 19:22:18.579384 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.575953    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94e87198-ccf9-4a1b-a75f-07438394dd10-hosts-file\") pod \"node-resolver-fdkxx\" (UID: \"94e87198-ccf9-4a1b-a75f-07438394dd10\") " pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.579384 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.576051    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9st99\" (UniqueName: \"kubernetes.io/projected/94e87198-ccf9-4a1b-a75f-07438394dd10-kube-api-access-9st99\") pod \"node-resolver-fdkxx\" (UID: \"94e87198-ccf9-4a1b-a75f-07438394dd10\") " pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.579384 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.576088    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e87198-ccf9-4a1b-a75f-07438394dd10-tmp-dir\") pod \"node-resolver-fdkxx\" (UID: \"94e87198-ccf9-4a1b-a75f-07438394dd10\") " pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.579384 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.576444    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e87198-ccf9-4a1b-a75f-07438394dd10-tmp-dir\") pod \"node-resolver-fdkxx\" (UID: \"94e87198-ccf9-4a1b-a75f-07438394dd10\") " pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.579384 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.576534    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94e87198-ccf9-4a1b-a75f-07438394dd10-hosts-file\") pod \"node-resolver-fdkxx\" (UID: \"94e87198-ccf9-4a1b-a75f-07438394dd10\") " pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.601528 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.601496    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9st99\" (UniqueName: \"kubernetes.io/projected/94e87198-ccf9-4a1b-a75f-07438394dd10-kube-api-access-9st99\") pod \"node-resolver-fdkxx\" (UID: \"94e87198-ccf9-4a1b-a75f-07438394dd10\") " pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.700365 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:18.700331    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fdkxx"
May 21 19:22:18.717037 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:22:18.717006    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e87198_ccf9_4a1b_a75f_07438394dd10.slice/crio-c39affc0b63b78e37cfe70a1bdddf42023b912eafa181a6a42f7ff753383a1f8 WatchSource:0}: Error finding container c39affc0b63b78e37cfe70a1bdddf42023b912eafa181a6a42f7ff753383a1f8: Status 404 returned error can't find the container with id c39affc0b63b78e37cfe70a1bdddf42023b912eafa181a6a42f7ff753383a1f8
May 21 19:22:19.109273 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.109239    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:19.109273 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.109266    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:19.109433 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:19.109334    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:19.109433 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:19.109401    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:19.297035 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.296962    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-htbxc"
May 21 19:22:19.297624 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.297596    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-htbxc"
May 21 19:22:19.330466 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.330433    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9" event={"ID":"33182995-abfd-4467-9d2a-828911d31442","Type":"ContainerStarted","Data":"0ac00ce692e69157590290ed9a4a98bc5ab4cde614f878021bc27e6812588082"}
May 21 19:22:19.333544 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.333525    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:22:19.333913 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.333891    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerStarted","Data":"44ebef25d690ee17673a568d0059fcb076c3c0550e15e5ceb83150a52ded362f"}
May 21 19:22:19.335137 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.335115    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fdkxx" event={"ID":"94e87198-ccf9-4a1b-a75f-07438394dd10","Type":"ContainerStarted","Data":"2fca29dc8b4d5e14b8f7e83493d7b297d07982bb72a9c4fa0914e64ac82d886e"}
May 21 19:22:19.335247 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.335143    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fdkxx" event={"ID":"94e87198-ccf9-4a1b-a75f-07438394dd10","Type":"ContainerStarted","Data":"c39affc0b63b78e37cfe70a1bdddf42023b912eafa181a6a42f7ff753383a1f8"}
May 21 19:22:19.514399 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:19.514340    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-fdkxx" podStartSLOduration=1.514324637 podStartE2EDuration="1.514324637s" podCreationTimestamp="2026-05-21 19:22:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:22:19.459272585 +0000 UTC m=+23.966677775" watchObservedRunningTime="2026-05-21 19:22:19.514324637 +0000 UTC m=+24.021729825"
May 21 19:22:20.109891 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:20.109865    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:20.110069 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:20.109982    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:20.336959 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:20.336937    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 21 19:22:20.471916 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:20.471849    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-htbxc"
May 21 19:22:20.472448 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:20.472425    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-htbxc"
May 21 19:22:20.504411 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:20.504376    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zr8v9" podStartSLOduration=3.125245661 podStartE2EDuration="24.504364223s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:21:57.334802857 +0000 UTC m=+1.842208023" lastFinishedPulling="2026-05-21 19:22:18.713921406 +0000 UTC m=+23.221326585" observedRunningTime="2026-05-21 19:22:19.519195835 +0000 UTC m=+24.026601019" watchObservedRunningTime="2026-05-21 19:22:20.504364223 +0000 UTC m=+25.011769411"
May 21 19:22:21.109521 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:21.109500    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:21.109622 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:21.109525    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:21.109622 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:21.109592    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:21.109700 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:21.109667    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:22.109764 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:22.109563    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:22.110373 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:22.109841    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:23.109045 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.109018    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:23.109151 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.109020    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:23.109151 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:23.109139    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:23.109258 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:23.109209    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:23.343848 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.343662    2561 generic.go:358] "Generic (PLEG): container finished" podID="e87343e5-2e9b-417a-bec0-31a01060f9fe" containerID="9be4f89fed33f419ff8d9086bafa9c5074de39bb82234ac07fe1c70d8b139821" exitCode=0
May 21 19:22:23.344642 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.343744    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttr6s" event={"ID":"e87343e5-2e9b-417a-bec0-31a01060f9fe","Type":"ContainerDied","Data":"9be4f89fed33f419ff8d9086bafa9c5074de39bb82234ac07fe1c70d8b139821"}
May 21 19:22:23.346902 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.346886    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:22:23.347218 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.347200    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerStarted","Data":"85014fc0bde801756df95810f852606cd5731138390d97aa17d9376f5a083b09"}
May 21 19:22:23.347493 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.347474    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:22:23.347612 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.347500    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:22:23.347667 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.347628    2561 scope.go:117] "RemoveContainer" containerID="ab8dc674848a2827062a3474a985c9d34b5dfee315fc16c4689b3269dae5c0f9"
May 21 19:22:23.363471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:23.363447    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:22:24.113768 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:24.111787    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:24.113768 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:24.111903    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:24.353989 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:24.353956    2561 generic.go:358] "Generic (PLEG): container finished" podID="e87343e5-2e9b-417a-bec0-31a01060f9fe" containerID="e5dd97324ce658f6cf4a6e5ea6bc1ed316385e0f74c42e614577bafa77c58f63" exitCode=0
May 21 19:22:24.354384 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:24.354035    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttr6s" event={"ID":"e87343e5-2e9b-417a-bec0-31a01060f9fe","Type":"ContainerDied","Data":"e5dd97324ce658f6cf4a6e5ea6bc1ed316385e0f74c42e614577bafa77c58f63"}
May 21 19:22:24.357477 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:24.357460    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:22:24.357804 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:24.357779    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" event={"ID":"c4ba0aaf-12d7-4f9c-86fc-96c9f353c002","Type":"ContainerStarted","Data":"bb9fa060174f0007ae3972ee09811c08f8e7784af73324a46fd70e706dde0dd1"}
May 21 19:22:24.358122 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:24.358102    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:22:24.373553 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:24.373499    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:22:24.435008 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:24.434966    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4" podStartSLOduration=9.401985451 podStartE2EDuration="28.434954207s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:21:57.310379283 +0000 UTC m=+1.817784448" lastFinishedPulling="2026-05-21 19:22:16.343348033 +0000 UTC m=+20.850753204" observedRunningTime="2026-05-21 19:22:24.430471833 +0000 UTC m=+28.937877019" watchObservedRunningTime="2026-05-21 19:22:24.434954207 +0000 UTC m=+28.942359394"
May 21 19:22:25.033359 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:25.033336    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x8nv7"]
May 21 19:22:25.033482 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:25.033469    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:25.033595 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:25.033573    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:25.040797 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:25.040772    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hbnx2"]
May 21 19:22:25.040910 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:25.040887    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:25.041000 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:25.040972    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:25.041489 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:25.041441    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7rtcc"]
May 21 19:22:25.041575 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:25.041529    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:25.041627 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:25.041611    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:25.361421 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:25.361389    2561 generic.go:358] "Generic (PLEG): container finished" podID="e87343e5-2e9b-417a-bec0-31a01060f9fe" containerID="06f999cd9de9c3ba8d4d038eeae09c5784ca381ede03e3d0bb2cade2ee5da13d" exitCode=0
May 21 19:22:25.361777 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:25.361469    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttr6s" event={"ID":"e87343e5-2e9b-417a-bec0-31a01060f9fe","Type":"ContainerDied","Data":"06f999cd9de9c3ba8d4d038eeae09c5784ca381ede03e3d0bb2cade2ee5da13d"}
May 21 19:22:26.111743 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:26.111718    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:26.111898 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:26.111832    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:27.109497 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:27.109423    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:27.109497 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:27.109461    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:27.109888 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:27.109527    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:27.109888 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:27.109606    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:28.108945 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:28.108908    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:28.109100 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:28.109048    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:22:28.751405 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:28.751373    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:28.751759 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:28.751489    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:22:28.751759 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:28.751537    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs podName:e3d90a5c-0097-4291-963e-4e74460ff759 nodeName:}" failed. No retries permitted until 2026-05-21 19:23:00.751522976 +0000 UTC m=+65.258928143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs") pod "network-metrics-daemon-x8nv7" (UID: "e3d90a5c-0097-4291-963e-4e74460ff759") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 19:22:28.952622 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:28.952591    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:28.952778 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:28.952754    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 19:22:28.952778 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:28.952771    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 19:22:28.952778 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:28.952780    2561 projected.go:194] Error preparing data for projected volume kube-api-access-scrt8 for pod openshift-network-diagnostics/network-check-target-hbnx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:22:28.952910 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:28.952829    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8 podName:2df00083-e032-4383-b58c-f03051c26794 nodeName:}" failed. No retries permitted until 2026-05-21 19:23:00.952813007 +0000 UTC m=+65.460218193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-scrt8" (UniqueName: "kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8") pod "network-check-target-hbnx2" (UID: "2df00083-e032-4383-b58c-f03051c26794") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 19:22:29.109659 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.109623    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:29.109840 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.109630    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:29.109840 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:29.109749    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbnx2" podUID="2df00083-e032-4383-b58c-f03051c26794"
May 21 19:22:29.109949 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:29.109843    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rtcc" podUID="b8f6e07b-b44a-4bcd-9c32-d424e692f1c2"
May 21 19:22:29.329069 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.329039    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-158.ec2.internal" event="NodeReady"
May 21 19:22:29.329270 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.329206    2561 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 19:22:29.420234 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.420138    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-796d7db4b6-vqpzz"]
May 21 19:22:29.497288 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.497243    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-64qpw"]
May 21 19:22:29.497440 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.497414    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.507788 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.507765    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mgmzm\""
May 21 19:22:29.507900 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.507788    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 19:22:29.507900 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.507788    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 19:22:29.512557 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.512533    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fn4fh"]
May 21 19:22:29.512689 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.512636    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.512770 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.512718    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 19:22:29.517599 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.517581    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 19:22:29.523375 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.523356    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 19:22:29.523482 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.523360    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 19:22:29.523482 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.523468    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gdlf\""
May 21 19:22:29.532195 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.532156    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64qpw"]
May 21 19:22:29.532195 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.532196    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-796d7db4b6-vqpzz"]
May 21 19:22:29.532352 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.532211    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fn4fh"]
May 21 19:22:29.532352 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.532279    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:29.544810 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.544794    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 19:22:29.544953 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.544934    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 19:22:29.545058 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.545000    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bcrm5\""
May 21 19:22:29.545058 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.544939    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 19:22:29.657629 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69kvk\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-kube-api-access-69kvk\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.657808 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045b3add-f444-4f08-afde-7ad09694a645-ca-trust-extracted\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.657808 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-trusted-ca\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.657808 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-bound-sa-token\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.657808 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657748    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-installation-pull-secrets\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.657808 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/520cea0e-088e-460b-930c-012ed5487f7f-config-volume\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.658001 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-image-registry-private-configuration\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.658001 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.658001 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.658001 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:29.658001 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.657986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppx7z\" (UniqueName: \"kubernetes.io/projected/520cea0e-088e-460b-930c-012ed5487f7f-kube-api-access-ppx7z\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.658276 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.658028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45fsv\" (UniqueName: \"kubernetes.io/projected/192cef57-4be2-4056-9a51-a31a91246de7-kube-api-access-45fsv\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:29.658276 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.658062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-registry-certificates\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.658276 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.658089    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/520cea0e-088e-460b-930c-012ed5487f7f-tmp-dir\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.758959 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.758890    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.758959 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.758921    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:29.758959 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.758948    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppx7z\" (UniqueName: \"kubernetes.io/projected/520cea0e-088e-460b-930c-012ed5487f7f-kube-api-access-ppx7z\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:29.759039    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:29.759041    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:29.759067    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796d7db4b6-vqpzz: secret "image-registry-tls" not found
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759067    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45fsv\" (UniqueName: \"kubernetes.io/projected/192cef57-4be2-4056-9a51-a31a91246de7-kube-api-access-45fsv\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:29.759094    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert podName:192cef57-4be2-4056-9a51-a31a91246de7 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:30.259079079 +0000 UTC m=+34.766484245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert") pod "ingress-canary-fn4fh" (UID: "192cef57-4be2-4056-9a51-a31a91246de7") : secret "canary-serving-cert" not found
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759123    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-registry-certificates\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:29.759134    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls podName:045b3add-f444-4f08-afde-7ad09694a645 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:30.259116418 +0000 UTC m=+34.766521589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls") pod "image-registry-796d7db4b6-vqpzz" (UID: "045b3add-f444-4f08-afde-7ad09694a645") : secret "image-registry-tls" not found
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759166    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/520cea0e-088e-460b-930c-012ed5487f7f-tmp-dir\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759237    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69kvk\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-kube-api-access-69kvk\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759270    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045b3add-f444-4f08-afde-7ad09694a645-ca-trust-extracted\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.759622 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759444    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-trusted-ca\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759521    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-bound-sa-token\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759792    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-installation-pull-secrets\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759610    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/520cea0e-088e-460b-930c-012ed5487f7f-tmp-dir\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759827    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/520cea0e-088e-460b-930c-012ed5487f7f-config-volume\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759726    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045b3add-f444-4f08-afde-7ad09694a645-ca-trust-extracted\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759887    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-image-registry-private-configuration\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759906    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-registry-certificates\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.759914    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:29.760008    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 19:22:29.760121 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:29.760068    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls podName:520cea0e-088e-460b-930c-012ed5487f7f nodeName:}" failed. No retries permitted until 2026-05-21 19:22:30.260054681 +0000 UTC m=+34.767459864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls") pod "dns-default-64qpw" (UID: "520cea0e-088e-460b-930c-012ed5487f7f") : secret "dns-default-metrics-tls" not found
May 21 19:22:29.760535 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.760373    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/520cea0e-088e-460b-930c-012ed5487f7f-config-volume\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:29.760640 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.760623    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-trusted-ca\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.763713 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.763690    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-installation-pull-secrets\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.763795 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.763754    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-image-registry-private-configuration\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.798680 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.798649    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-bound-sa-token\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.798807 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.798792    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45fsv\" (UniqueName: \"kubernetes.io/projected/192cef57-4be2-4056-9a51-a31a91246de7-kube-api-access-45fsv\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:29.798807 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.798802    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69kvk\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-kube-api-access-69kvk\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:29.809740 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:29.809719    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppx7z\" (UniqueName: \"kubernetes.io/projected/520cea0e-088e-460b-930c-012ed5487f7f-kube-api-access-ppx7z\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:30.109678 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:30.109646    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:22:30.116909 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:30.116885    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 19:22:30.117226 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:30.117103    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmtz4\""
May 21 19:22:30.262855 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:30.262812    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:30.263013 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:30.262865    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:30.263013 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:30.262897    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:30.263013 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:30.262974    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 19:22:30.263200 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:30.263048    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 19:22:30.263200 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:30.263058    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 19:22:30.263200 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:30.263055    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls podName:520cea0e-088e-460b-930c-012ed5487f7f nodeName:}" failed. No retries permitted until 2026-05-21 19:22:31.263037962 +0000 UTC m=+35.770443145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls") pod "dns-default-64qpw" (UID: "520cea0e-088e-460b-930c-012ed5487f7f") : secret "dns-default-metrics-tls" not found
May 21 19:22:30.263200 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:30.263068    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796d7db4b6-vqpzz: secret "image-registry-tls" not found
May 21 19:22:30.263200 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:30.263115    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert podName:192cef57-4be2-4056-9a51-a31a91246de7 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:31.263097224 +0000 UTC m=+35.770502411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert") pod "ingress-canary-fn4fh" (UID: "192cef57-4be2-4056-9a51-a31a91246de7") : secret "canary-serving-cert" not found
May 21 19:22:30.263200 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:30.263144    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls podName:045b3add-f444-4f08-afde-7ad09694a645 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:31.263130665 +0000 UTC m=+35.770535845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls") pod "image-registry-796d7db4b6-vqpzz" (UID: "045b3add-f444-4f08-afde-7ad09694a645") : secret "image-registry-tls" not found
May 21 19:22:31.109373 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:31.109339    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:22:31.109820 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:31.109340    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:31.121115 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:31.120388    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ft7h\""
May 21 19:22:31.121115 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:31.120655    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 19:22:31.121115 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:31.120849    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 19:22:31.121115 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:31.120899    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 19:22:31.271648 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:31.271609    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:31.271820 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:31.271657    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:31.271820 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:31.271687    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:31.271820 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:31.271751    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 19:22:31.271820 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:31.271803    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 19:22:31.271820 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:31.271813    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 19:22:31.271820 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:31.271821    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls podName:520cea0e-088e-460b-930c-012ed5487f7f nodeName:}" failed. No retries permitted until 2026-05-21 19:22:33.27180547 +0000 UTC m=+37.779210636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls") pod "dns-default-64qpw" (UID: "520cea0e-088e-460b-930c-012ed5487f7f") : secret "dns-default-metrics-tls" not found
May 21 19:22:31.272079 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:31.271824    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796d7db4b6-vqpzz: secret "image-registry-tls" not found
May 21 19:22:31.272079 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:31.271862    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert podName:192cef57-4be2-4056-9a51-a31a91246de7 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:33.271847401 +0000 UTC m=+37.779252571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert") pod "ingress-canary-fn4fh" (UID: "192cef57-4be2-4056-9a51-a31a91246de7") : secret "canary-serving-cert" not found
May 21 19:22:31.272079 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:31.271881    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls podName:045b3add-f444-4f08-afde-7ad09694a645 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:33.271868488 +0000 UTC m=+37.779273654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls") pod "image-registry-796d7db4b6-vqpzz" (UID: "045b3add-f444-4f08-afde-7ad09694a645") : secret "image-registry-tls" not found
May 21 19:22:33.288336 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:33.288301    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:33.288336 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:33.288346    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:33.288989 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:33.288378    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:33.288989 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:33.288461    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 19:22:33.288989 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:33.288508    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 19:22:33.288989 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:33.288525    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls podName:520cea0e-088e-460b-930c-012ed5487f7f nodeName:}" failed. No retries permitted until 2026-05-21 19:22:37.288510598 +0000 UTC m=+41.795915764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls") pod "dns-default-64qpw" (UID: "520cea0e-088e-460b-930c-012ed5487f7f") : secret "dns-default-metrics-tls" not found
May 21 19:22:33.288989 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:33.288552    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert podName:192cef57-4be2-4056-9a51-a31a91246de7 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:37.288537995 +0000 UTC m=+41.795943167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert") pod "ingress-canary-fn4fh" (UID: "192cef57-4be2-4056-9a51-a31a91246de7") : secret "canary-serving-cert" not found
May 21 19:22:33.288989 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:33.288463    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 19:22:33.288989 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:33.288569    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796d7db4b6-vqpzz: secret "image-registry-tls" not found
May 21 19:22:33.288989 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:33.288606    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls podName:045b3add-f444-4f08-afde-7ad09694a645 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:37.288596136 +0000 UTC m=+41.796001301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls") pod "image-registry-796d7db4b6-vqpzz" (UID: "045b3add-f444-4f08-afde-7ad09694a645") : secret "image-registry-tls" not found
May 21 19:22:33.377853 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:33.377823    2561 generic.go:358] "Generic (PLEG): container finished" podID="e87343e5-2e9b-417a-bec0-31a01060f9fe" containerID="2db8aad5833ceaea3d9b1563f83f11435e6d127b20818648a127ed741f9240d7" exitCode=0
May 21 19:22:33.377997 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:33.377885    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttr6s" event={"ID":"e87343e5-2e9b-417a-bec0-31a01060f9fe","Type":"ContainerDied","Data":"2db8aad5833ceaea3d9b1563f83f11435e6d127b20818648a127ed741f9240d7"}
May 21 19:22:33.894366 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:33.894334    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:33.897616 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:33.897591    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f6e07b-b44a-4bcd-9c32-d424e692f1c2-original-pull-secret\") pod \"global-pull-secret-syncer-7rtcc\" (UID: \"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2\") " pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:34.134127 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:34.134101    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rtcc"
May 21 19:22:34.290275 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:34.290084    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7rtcc"]
May 21 19:22:34.297317 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:22:34.297290    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f6e07b_b44a_4bcd_9c32_d424e692f1c2.slice/crio-2e0886d99d89744cfe21c4a2f43047590e77e0b45c0fee90a63985e989449f7c WatchSource:0}: Error finding container 2e0886d99d89744cfe21c4a2f43047590e77e0b45c0fee90a63985e989449f7c: Status 404 returned error can't find the container with id 2e0886d99d89744cfe21c4a2f43047590e77e0b45c0fee90a63985e989449f7c
May 21 19:22:34.380770 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:34.380737    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7rtcc" event={"ID":"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2","Type":"ContainerStarted","Data":"2e0886d99d89744cfe21c4a2f43047590e77e0b45c0fee90a63985e989449f7c"}
May 21 19:22:34.383317 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:34.383294    2561 generic.go:358] "Generic (PLEG): container finished" podID="e87343e5-2e9b-417a-bec0-31a01060f9fe" containerID="c9f53af179493db4955a233ebed739343af1dead926dc24da197dcf1c7c4a3ca" exitCode=0
May 21 19:22:34.383396 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:34.383349    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttr6s" event={"ID":"e87343e5-2e9b-417a-bec0-31a01060f9fe","Type":"ContainerDied","Data":"c9f53af179493db4955a233ebed739343af1dead926dc24da197dcf1c7c4a3ca"}
May 21 19:22:35.388576 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:35.388536    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttr6s" event={"ID":"e87343e5-2e9b-417a-bec0-31a01060f9fe","Type":"ContainerStarted","Data":"e6b62b086a289796687309c922e6d3718a0838954c56116d3ac67e879205a8cf"}
May 21 19:22:35.476090 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:35.476023    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ttr6s" podStartSLOduration=4.308791718 podStartE2EDuration="39.476005654s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:21:57.368279117 +0000 UTC m=+1.875684283" lastFinishedPulling="2026-05-21 19:22:32.535493049 +0000 UTC m=+37.042898219" observedRunningTime="2026-05-21 19:22:35.475764972 +0000 UTC m=+39.983170157" watchObservedRunningTime="2026-05-21 19:22:35.476005654 +0000 UTC m=+39.983410843"
May 21 19:22:37.320764 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:37.320722    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:37.321290 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:37.320786    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:37.321290 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:37.320813    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:37.321290 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:37.320869    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 19:22:37.321290 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:37.320926    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 19:22:37.321290 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:37.320940    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796d7db4b6-vqpzz: secret "image-registry-tls" not found
May 21 19:22:37.321290 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:37.320943    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls podName:520cea0e-088e-460b-930c-012ed5487f7f nodeName:}" failed. No retries permitted until 2026-05-21 19:22:45.320922344 +0000 UTC m=+49.828327510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls") pod "dns-default-64qpw" (UID: "520cea0e-088e-460b-930c-012ed5487f7f") : secret "dns-default-metrics-tls" not found
May 21 19:22:37.321290 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:37.320940    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 19:22:37.321290 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:37.320975    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls podName:045b3add-f444-4f08-afde-7ad09694a645 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:45.320965007 +0000 UTC m=+49.828370195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls") pod "image-registry-796d7db4b6-vqpzz" (UID: "045b3add-f444-4f08-afde-7ad09694a645") : secret "image-registry-tls" not found
May 21 19:22:37.321290 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:37.320989    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert podName:192cef57-4be2-4056-9a51-a31a91246de7 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:45.320981636 +0000 UTC m=+49.828386803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert") pod "ingress-canary-fn4fh" (UID: "192cef57-4be2-4056-9a51-a31a91246de7") : secret "canary-serving-cert" not found
May 21 19:22:39.399769 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:39.399733    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7rtcc" event={"ID":"b8f6e07b-b44a-4bcd-9c32-d424e692f1c2","Type":"ContainerStarted","Data":"11f61d39eed79df31bb0836feb2c3e1352dba5b848fa920ee22e98fc4fcebbe7"}
May 21 19:22:45.376698 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:45.376662    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:22:45.376698 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:45.376702    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:22:45.377123 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:45.376720    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:22:45.377123 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:45.376824    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 19:22:45.377123 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:45.376826    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 19:22:45.377123 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:45.376878    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert podName:192cef57-4be2-4056-9a51-a31a91246de7 nodeName:}" failed. No retries permitted until 2026-05-21 19:23:01.376864342 +0000 UTC m=+65.884269509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert") pod "ingress-canary-fn4fh" (UID: "192cef57-4be2-4056-9a51-a31a91246de7") : secret "canary-serving-cert" not found
May 21 19:22:45.377123 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:45.376897    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls podName:520cea0e-088e-460b-930c-012ed5487f7f nodeName:}" failed. No retries permitted until 2026-05-21 19:23:01.376883543 +0000 UTC m=+65.884288729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls") pod "dns-default-64qpw" (UID: "520cea0e-088e-460b-930c-012ed5487f7f") : secret "dns-default-metrics-tls" not found
May 21 19:22:45.377123 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:45.376828    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 19:22:45.377123 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:45.376911    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796d7db4b6-vqpzz: secret "image-registry-tls" not found
May 21 19:22:45.377123 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:22:45.376934    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls podName:045b3add-f444-4f08-afde-7ad09694a645 nodeName:}" failed. No retries permitted until 2026-05-21 19:23:01.376926611 +0000 UTC m=+65.884331818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls") pod "image-registry-796d7db4b6-vqpzz" (UID: "045b3add-f444-4f08-afde-7ad09694a645") : secret "image-registry-tls" not found
May 21 19:22:56.373470 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:56.373446    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnsn4"
May 21 19:22:56.416751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:22:56.416705    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7rtcc" podStartSLOduration=50.32554493 podStartE2EDuration="54.416693048s" podCreationTimestamp="2026-05-21 19:22:02 +0000 UTC" firstStartedPulling="2026-05-21 19:22:34.299406342 +0000 UTC m=+38.806811507" lastFinishedPulling="2026-05-21 19:22:38.390554459 +0000 UTC m=+42.897959625" observedRunningTime="2026-05-21 19:22:39.427568679 +0000 UTC m=+43.934973867" watchObservedRunningTime="2026-05-21 19:22:56.416693048 +0000 UTC m=+60.924098233"
May 21 19:23:00.771813 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:00.771779    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:23:00.775241 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:00.775222    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 19:23:00.782653 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:00.782635    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 19:23:00.782729 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:00.782693    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs podName:e3d90a5c-0097-4291-963e-4e74460ff759 nodeName:}" failed. No retries permitted until 2026-05-21 19:24:04.782676272 +0000 UTC m=+129.290081438 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs") pod "network-metrics-daemon-x8nv7" (UID: "e3d90a5c-0097-4291-963e-4e74460ff759") : secret "metrics-daemon-secret" not found
May 21 19:23:00.973055 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:00.973030    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:23:00.976467 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:00.976451    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 19:23:00.987008 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:00.986990    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 19:23:00.997551 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:00.997527    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scrt8\" (UniqueName: \"kubernetes.io/projected/2df00083-e032-4383-b58c-f03051c26794-kube-api-access-scrt8\") pod \"network-check-target-hbnx2\" (UID: \"2df00083-e032-4383-b58c-f03051c26794\") " pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:23:01.131083 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:01.131055    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ft7h\""
May 21 19:23:01.138423 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:01.138403    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:23:01.278433 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:01.278398    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hbnx2"]
May 21 19:23:01.283418 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:23:01.283390    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df00083_e032_4383_b58c_f03051c26794.slice/crio-7fdb72a9a2b1324278a7639b20eb39019d67a8361bf8a98f8ac36f384ed8cfd2 WatchSource:0}: Error finding container 7fdb72a9a2b1324278a7639b20eb39019d67a8361bf8a98f8ac36f384ed8cfd2: Status 404 returned error can't find the container with id 7fdb72a9a2b1324278a7639b20eb39019d67a8361bf8a98f8ac36f384ed8cfd2
May 21 19:23:01.377032 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:01.376993    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:23:01.377211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:01.377044    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:23:01.377211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:01.377069    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:23:01.377211 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:01.377150    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 19:23:01.377211 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:01.377200    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 19:23:01.377378 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:01.377226    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls podName:520cea0e-088e-460b-930c-012ed5487f7f nodeName:}" failed. No retries permitted until 2026-05-21 19:23:33.377208743 +0000 UTC m=+97.884613911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls") pod "dns-default-64qpw" (UID: "520cea0e-088e-460b-930c-012ed5487f7f") : secret "dns-default-metrics-tls" not found
May 21 19:23:01.377378 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:01.377249    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert podName:192cef57-4be2-4056-9a51-a31a91246de7 nodeName:}" failed. No retries permitted until 2026-05-21 19:23:33.377233118 +0000 UTC m=+97.884638283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert") pod "ingress-canary-fn4fh" (UID: "192cef57-4be2-4056-9a51-a31a91246de7") : secret "canary-serving-cert" not found
May 21 19:23:01.377378 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:01.377152    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 19:23:01.377378 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:01.377272    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796d7db4b6-vqpzz: secret "image-registry-tls" not found
May 21 19:23:01.377378 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:01.377311    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls podName:045b3add-f444-4f08-afde-7ad09694a645 nodeName:}" failed. No retries permitted until 2026-05-21 19:23:33.377299612 +0000 UTC m=+97.884704801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls") pod "image-registry-796d7db4b6-vqpzz" (UID: "045b3add-f444-4f08-afde-7ad09694a645") : secret "image-registry-tls" not found
May 21 19:23:01.443085 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:01.443014    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hbnx2" event={"ID":"2df00083-e032-4383-b58c-f03051c26794","Type":"ContainerStarted","Data":"7fdb72a9a2b1324278a7639b20eb39019d67a8361bf8a98f8ac36f384ed8cfd2"}
May 21 19:23:05.451475 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:05.451358    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hbnx2" event={"ID":"2df00083-e032-4383-b58c-f03051c26794","Type":"ContainerStarted","Data":"eba392476794b29d6353c22afdde0486fd71c347afefaa52626bbd99ff0be285"}
May 21 19:23:05.451848 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:05.451522    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:23:05.473512 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:05.473394    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hbnx2" podStartSLOduration=66.249732974 podStartE2EDuration="1m9.473379241s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:23:01.285358715 +0000 UTC m=+65.792763884" lastFinishedPulling="2026-05-21 19:23:04.509004971 +0000 UTC m=+69.016410151" observedRunningTime="2026-05-21 19:23:05.472326068 +0000 UTC m=+69.979731256" watchObservedRunningTime="2026-05-21 19:23:05.473379241 +0000 UTC m=+69.980784431"
May 21 19:23:33.389150 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:33.389116    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:23:33.389587 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:33.389156    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:23:33.389587 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:33.389195    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:23:33.389587 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:33.389270    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 19:23:33.389587 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:33.389269    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 19:23:33.389587 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:33.389288    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 19:23:33.389587 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:33.389285    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796d7db4b6-vqpzz: secret "image-registry-tls" not found
May 21 19:23:33.389587 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:33.389343    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert podName:192cef57-4be2-4056-9a51-a31a91246de7 nodeName:}" failed. No retries permitted until 2026-05-21 19:24:37.389330552 +0000 UTC m=+161.896735718 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert") pod "ingress-canary-fn4fh" (UID: "192cef57-4be2-4056-9a51-a31a91246de7") : secret "canary-serving-cert" not found
May 21 19:23:33.389587 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:33.389355    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls podName:045b3add-f444-4f08-afde-7ad09694a645 nodeName:}" failed. No retries permitted until 2026-05-21 19:24:37.389349257 +0000 UTC m=+161.896754422 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls") pod "image-registry-796d7db4b6-vqpzz" (UID: "045b3add-f444-4f08-afde-7ad09694a645") : secret "image-registry-tls" not found
May 21 19:23:33.389587 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:23:33.389364    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls podName:520cea0e-088e-460b-930c-012ed5487f7f nodeName:}" failed. No retries permitted until 2026-05-21 19:24:37.389359002 +0000 UTC m=+161.896764168 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls") pod "dns-default-64qpw" (UID: "520cea0e-088e-460b-930c-012ed5487f7f") : secret "dns-default-metrics-tls" not found
May 21 19:23:36.456550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:23:36.456521    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hbnx2"
May 21 19:24:04.799054 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:04.799015    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:24:04.799526 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:04.799129    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 19:24:04.799526 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:04.799206    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs podName:e3d90a5c-0097-4291-963e-4e74460ff759 nodeName:}" failed. No retries permitted until 2026-05-21 19:26:06.79919183 +0000 UTC m=+251.306597007 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs") pod "network-metrics-daemon-x8nv7" (UID: "e3d90a5c-0097-4291-963e-4e74460ff759") : secret "metrics-daemon-secret" not found
May 21 19:24:26.781342 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.781311    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"]
May 21 19:24:26.783252 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.783237    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:26.786297 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.786272    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 21 19:24:26.786422 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.786377    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 21 19:24:26.786422 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.786383    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 21 19:24:26.786539 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.786522    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 21 19:24:26.787403 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.787386    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qwv5s\""
May 21 19:24:26.792931 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.792903    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"]
May 21 19:24:26.951526 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.951479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19e89e89-3942-4f9b-a8e1-61f2c8697791-serving-cert\") pod \"service-ca-operator-57b5b68b8-7s972\" (UID: \"19e89e89-3942-4f9b-a8e1-61f2c8697791\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:26.951675 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.951537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd8ts\" (UniqueName: \"kubernetes.io/projected/19e89e89-3942-4f9b-a8e1-61f2c8697791-kube-api-access-gd8ts\") pod \"service-ca-operator-57b5b68b8-7s972\" (UID: \"19e89e89-3942-4f9b-a8e1-61f2c8697791\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:26.951675 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:26.951605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19e89e89-3942-4f9b-a8e1-61f2c8697791-config\") pod \"service-ca-operator-57b5b68b8-7s972\" (UID: \"19e89e89-3942-4f9b-a8e1-61f2c8697791\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:27.052663 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:27.052601    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd8ts\" (UniqueName: \"kubernetes.io/projected/19e89e89-3942-4f9b-a8e1-61f2c8697791-kube-api-access-gd8ts\") pod \"service-ca-operator-57b5b68b8-7s972\" (UID: \"19e89e89-3942-4f9b-a8e1-61f2c8697791\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:27.052663 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:27.052639    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19e89e89-3942-4f9b-a8e1-61f2c8697791-config\") pod \"service-ca-operator-57b5b68b8-7s972\" (UID: \"19e89e89-3942-4f9b-a8e1-61f2c8697791\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:27.052828 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:27.052814    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19e89e89-3942-4f9b-a8e1-61f2c8697791-serving-cert\") pod \"service-ca-operator-57b5b68b8-7s972\" (UID: \"19e89e89-3942-4f9b-a8e1-61f2c8697791\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:27.053074 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:27.053056    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19e89e89-3942-4f9b-a8e1-61f2c8697791-config\") pod \"service-ca-operator-57b5b68b8-7s972\" (UID: \"19e89e89-3942-4f9b-a8e1-61f2c8697791\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:27.055049 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:27.055033    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19e89e89-3942-4f9b-a8e1-61f2c8697791-serving-cert\") pod \"service-ca-operator-57b5b68b8-7s972\" (UID: \"19e89e89-3942-4f9b-a8e1-61f2c8697791\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:27.061157 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:27.061126    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd8ts\" (UniqueName: \"kubernetes.io/projected/19e89e89-3942-4f9b-a8e1-61f2c8697791-kube-api-access-gd8ts\") pod \"service-ca-operator-57b5b68b8-7s972\" (UID: \"19e89e89-3942-4f9b-a8e1-61f2c8697791\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:27.092194 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:27.092154    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"
May 21 19:24:27.214683 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:27.214645    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972"]
May 21 19:24:27.218136 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:24:27.218111    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e89e89_3942_4f9b_a8e1_61f2c8697791.slice/crio-a07d952d4add0d88bfe6c587d57f777149f31c790ba37bcf895cd9025541204e WatchSource:0}: Error finding container a07d952d4add0d88bfe6c587d57f777149f31c790ba37bcf895cd9025541204e: Status 404 returned error can't find the container with id a07d952d4add0d88bfe6c587d57f777149f31c790ba37bcf895cd9025541204e
May 21 19:24:27.603249 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:27.603211    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972" event={"ID":"19e89e89-3942-4f9b-a8e1-61f2c8697791","Type":"ContainerStarted","Data":"a07d952d4add0d88bfe6c587d57f777149f31c790ba37bcf895cd9025541204e"}
May 21 19:24:29.608720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:29.608681    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972" event={"ID":"19e89e89-3942-4f9b-a8e1-61f2c8697791","Type":"ContainerStarted","Data":"5b1beabf69fbaf5bb75eafa45deb17e4e8bc91ac474905980de565b9b1eb61f3"}
May 21 19:24:29.625070 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:29.625022    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972" podStartSLOduration=1.433858092 podStartE2EDuration="3.625008922s" podCreationTimestamp="2026-05-21 19:24:26 +0000 UTC" firstStartedPulling="2026-05-21 19:24:27.219816718 +0000 UTC m=+151.727221885" lastFinishedPulling="2026-05-21 19:24:29.410967533 +0000 UTC m=+153.918372715" observedRunningTime="2026-05-21 19:24:29.624464286 +0000 UTC m=+154.131869475" watchObservedRunningTime="2026-05-21 19:24:29.625008922 +0000 UTC m=+154.132414109"
May 21 19:24:31.398050 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.398018    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk"]
May 21 19:24:31.399779 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.399764    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk"
May 21 19:24:31.406334 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.406312    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 21 19:24:31.407372 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.407354    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 21 19:24:31.407463 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.407395    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ztbvh\""
May 21 19:24:31.436794 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.436776    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk"]
May 21 19:24:31.482171 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.482144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvhlz\" (UniqueName: \"kubernetes.io/projected/26281d1b-f031-47c1-8dd9-2eb2efc22388-kube-api-access-jvhlz\") pod \"migrator-b985f5d89-klqmk\" (UID: \"26281d1b-f031-47c1-8dd9-2eb2efc22388\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk"
May 21 19:24:31.582921 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.582890    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvhlz\" (UniqueName: \"kubernetes.io/projected/26281d1b-f031-47c1-8dd9-2eb2efc22388-kube-api-access-jvhlz\") pod \"migrator-b985f5d89-klqmk\" (UID: \"26281d1b-f031-47c1-8dd9-2eb2efc22388\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk"
May 21 19:24:31.615316 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.615296    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvhlz\" (UniqueName: \"kubernetes.io/projected/26281d1b-f031-47c1-8dd9-2eb2efc22388-kube-api-access-jvhlz\") pod \"migrator-b985f5d89-klqmk\" (UID: \"26281d1b-f031-47c1-8dd9-2eb2efc22388\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk"
May 21 19:24:31.707850 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.707785    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk"
May 21 19:24:31.837113 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:31.837081    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk"]
May 21 19:24:31.842374 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:24:31.842349    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26281d1b_f031_47c1_8dd9_2eb2efc22388.slice/crio-7fa39bbe059df8a5c080aa0eb0179270be7e92674cfd0dfc5e188b5c220ab4c8 WatchSource:0}: Error finding container 7fa39bbe059df8a5c080aa0eb0179270be7e92674cfd0dfc5e188b5c220ab4c8: Status 404 returned error can't find the container with id 7fa39bbe059df8a5c080aa0eb0179270be7e92674cfd0dfc5e188b5c220ab4c8
May 21 19:24:32.509269 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:32.509227    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz" podUID="045b3add-f444-4f08-afde-7ad09694a645"
May 21 19:24:32.523606 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:32.523570    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-64qpw" podUID="520cea0e-088e-460b-930c-012ed5487f7f"
May 21 19:24:32.541806 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:32.541755    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fn4fh" podUID="192cef57-4be2-4056-9a51-a31a91246de7"
May 21 19:24:32.613827 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:32.613803    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:24:32.613955 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:32.613839    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:24:32.613955 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:32.613841    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk" event={"ID":"26281d1b-f031-47c1-8dd9-2eb2efc22388","Type":"ContainerStarted","Data":"7fa39bbe059df8a5c080aa0eb0179270be7e92674cfd0dfc5e188b5c220ab4c8"}
May 21 19:24:32.613955 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:32.613906    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64qpw"
May 21 19:24:33.119732 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:33.119705    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-x8nv7" podUID="e3d90a5c-0097-4291-963e-4e74460ff759"
May 21 19:24:33.617556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.617521    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk" event={"ID":"26281d1b-f031-47c1-8dd9-2eb2efc22388","Type":"ContainerStarted","Data":"ae37ec07095079509f5d545fa02d4bc521b94606ae0fac658dda07a72d861e89"}
May 21 19:24:33.617909 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.617564    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk" event={"ID":"26281d1b-f031-47c1-8dd9-2eb2efc22388","Type":"ContainerStarted","Data":"a1004037717d00929cf6c39ea1c9e9b6ceddf3c89c88f324a459f81e33d633e1"}
May 21 19:24:33.637962 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.637920    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-klqmk" podStartSLOduration=1.398766432 podStartE2EDuration="2.637906808s" podCreationTimestamp="2026-05-21 19:24:31 +0000 UTC" firstStartedPulling="2026-05-21 19:24:31.844071864 +0000 UTC m=+156.351477030" lastFinishedPulling="2026-05-21 19:24:33.08321224 +0000 UTC m=+157.590617406" observedRunningTime="2026-05-21 19:24:33.63685287 +0000 UTC m=+158.144258060" watchObservedRunningTime="2026-05-21 19:24:33.637906808 +0000 UTC m=+158.145311987"
May 21 19:24:33.655964 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.655942    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9sdjj"]
May 21 19:24:33.657645 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.657629    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.662286 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.662260    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 21 19:24:33.662373 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.662291    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 21 19:24:33.662373 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.662300    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 21 19:24:33.662373 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.662310    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 21 19:24:33.662373 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.662361    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wwxdk\""
May 21 19:24:33.671760 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.671743    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9sdjj"]
May 21 19:24:33.800279 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.800247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f9ce0782-518e-4613-ab27-6ed098848845-signing-cabundle\") pod \"service-ca-67d667c7d-9sdjj\" (UID: \"f9ce0782-518e-4613-ab27-6ed098848845\") " pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.800279 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.800277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f9ce0782-518e-4613-ab27-6ed098848845-signing-key\") pod \"service-ca-67d667c7d-9sdjj\" (UID: \"f9ce0782-518e-4613-ab27-6ed098848845\") " pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.800449 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.800295    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45w5d\" (UniqueName: \"kubernetes.io/projected/f9ce0782-518e-4613-ab27-6ed098848845-kube-api-access-45w5d\") pod \"service-ca-67d667c7d-9sdjj\" (UID: \"f9ce0782-518e-4613-ab27-6ed098848845\") " pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.901418 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.901352    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f9ce0782-518e-4613-ab27-6ed098848845-signing-cabundle\") pod \"service-ca-67d667c7d-9sdjj\" (UID: \"f9ce0782-518e-4613-ab27-6ed098848845\") " pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.901418 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.901382    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f9ce0782-518e-4613-ab27-6ed098848845-signing-key\") pod \"service-ca-67d667c7d-9sdjj\" (UID: \"f9ce0782-518e-4613-ab27-6ed098848845\") " pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.901418 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.901400    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45w5d\" (UniqueName: \"kubernetes.io/projected/f9ce0782-518e-4613-ab27-6ed098848845-kube-api-access-45w5d\") pod \"service-ca-67d667c7d-9sdjj\" (UID: \"f9ce0782-518e-4613-ab27-6ed098848845\") " pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.902085 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.902067    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f9ce0782-518e-4613-ab27-6ed098848845-signing-cabundle\") pod \"service-ca-67d667c7d-9sdjj\" (UID: \"f9ce0782-518e-4613-ab27-6ed098848845\") " pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.903762 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.903741    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f9ce0782-518e-4613-ab27-6ed098848845-signing-key\") pod \"service-ca-67d667c7d-9sdjj\" (UID: \"f9ce0782-518e-4613-ab27-6ed098848845\") " pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.910438 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.910420    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45w5d\" (UniqueName: \"kubernetes.io/projected/f9ce0782-518e-4613-ab27-6ed098848845-kube-api-access-45w5d\") pod \"service-ca-67d667c7d-9sdjj\" (UID: \"f9ce0782-518e-4613-ab27-6ed098848845\") " pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:33.966081 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:33.966060    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9sdjj"
May 21 19:24:34.085231 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:34.085201    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9sdjj"]
May 21 19:24:34.087975 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:24:34.087953    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ce0782_518e_4613_ab27_6ed098848845.slice/crio-8d9f1c44f5aea4b3ec1033994abf33846e4e615fcd296bb1afcf8d5500a4ced1 WatchSource:0}: Error finding container 8d9f1c44f5aea4b3ec1033994abf33846e4e615fcd296bb1afcf8d5500a4ced1: Status 404 returned error can't find the container with id 8d9f1c44f5aea4b3ec1033994abf33846e4e615fcd296bb1afcf8d5500a4ced1
May 21 19:24:34.601490 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:34.601459    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fdkxx_94e87198-ccf9-4a1b-a75f-07438394dd10/dns-node-resolver/0.log"
May 21 19:24:34.620864 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:34.620831    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9sdjj" event={"ID":"f9ce0782-518e-4613-ab27-6ed098848845","Type":"ContainerStarted","Data":"67c0da8327c6933c604d8db19e205fa2577a0e9dad9f23762f1b9abd2cbb20ed"}
May 21 19:24:34.621290 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:34.620871    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9sdjj" event={"ID":"f9ce0782-518e-4613-ab27-6ed098848845","Type":"ContainerStarted","Data":"8d9f1c44f5aea4b3ec1033994abf33846e4e615fcd296bb1afcf8d5500a4ced1"}
May 21 19:24:34.652985 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:34.652912    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-9sdjj" podStartSLOduration=1.652897477 podStartE2EDuration="1.652897477s" podCreationTimestamp="2026-05-21 19:24:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:24:34.652787625 +0000 UTC m=+159.160192812" watchObservedRunningTime="2026-05-21 19:24:34.652897477 +0000 UTC m=+159.160302664"
May 21 19:24:35.599605 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:35.599538    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t9srw_e0d007d9-cf16-45c8-a6f7-1194d5c660aa/node-ca/0.log"
May 21 19:24:36.598406 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:36.598368    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-klqmk_26281d1b-f031-47c1-8dd9-2eb2efc22388/migrator/0.log"
May 21 19:24:36.799410 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:36.799386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-klqmk_26281d1b-f031-47c1-8dd9-2eb2efc22388/graceful-termination/0.log"
May 21 19:24:37.428999 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:37.428954    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:24:37.428999 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:37.429000    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") pod \"image-registry-796d7db4b6-vqpzz\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") " pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:24:37.429228 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:37.429020    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:24:37.429228 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:37.429108    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 19:24:37.429228 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:37.429113    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 19:24:37.429228 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:37.429135    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-796d7db4b6-vqpzz: secret "image-registry-tls" not found
May 21 19:24:37.429228 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:37.429152    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert podName:192cef57-4be2-4056-9a51-a31a91246de7 nodeName:}" failed. No retries permitted until 2026-05-21 19:26:39.429138212 +0000 UTC m=+283.936543378 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert") pod "ingress-canary-fn4fh" (UID: "192cef57-4be2-4056-9a51-a31a91246de7") : secret "canary-serving-cert" not found
May 21 19:24:37.429228 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:37.429111    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 19:24:37.429228 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:37.429204    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls podName:045b3add-f444-4f08-afde-7ad09694a645 nodeName:}" failed. No retries permitted until 2026-05-21 19:26:39.429166414 +0000 UTC m=+283.936571581 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls") pod "image-registry-796d7db4b6-vqpzz" (UID: "045b3add-f444-4f08-afde-7ad09694a645") : secret "image-registry-tls" not found
May 21 19:24:37.429470 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:37.429245    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls podName:520cea0e-088e-460b-930c-012ed5487f7f nodeName:}" failed. No retries permitted until 2026-05-21 19:26:39.429236243 +0000 UTC m=+283.936641409 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls") pod "dns-default-64qpw" (UID: "520cea0e-088e-460b-930c-012ed5487f7f") : secret "dns-default-metrics-tls" not found
May 21 19:24:44.109059 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:44.109029    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:24:56.045900 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.045868    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-796d7db4b6-vqpzz"]
May 21 19:24:56.046254 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:24:56.046009    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz" podUID="045b3add-f444-4f08-afde-7ad09694a645"
May 21 19:24:56.067393 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.067371    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-hvjx7"]
May 21 19:24:56.069831 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.069815    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-hvjx7"
May 21 19:24:56.073796 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.073778    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 19:24:56.074017 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.074001    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-67rbd\""
May 21 19:24:56.074724 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.074706    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 19:24:56.091488 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.091464    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jl84v"]
May 21 19:24:56.094453 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.094432    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-hvjx7"]
May 21 19:24:56.094549 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.094538    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.097043 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.097019    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 19:24:56.097508 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.097490    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 19:24:56.097606 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.097573    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zspvh\""
May 21 19:24:56.097786 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.097770    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 19:24:56.097892 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.097839    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 19:24:56.124760 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.124740    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jl84v"]
May 21 19:24:56.164230 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.164209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc4ddda3-4f1b-4f5f-a146-b8898c564833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.164337 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.164247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n5v7\" (UniqueName: \"kubernetes.io/projected/3f42c3cf-0fb7-4da2-ac10-d5f3e113b904-kube-api-access-8n5v7\") pod \"downloads-57bd96b888-hvjx7\" (UID: \"3f42c3cf-0fb7-4da2-ac10-d5f3e113b904\") " pod="openshift-console/downloads-57bd96b888-hvjx7"
May 21 19:24:56.164337 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.164270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc4ddda3-4f1b-4f5f-a146-b8898c564833-crio-socket\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.164337 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.164286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2rs8\" (UniqueName: \"kubernetes.io/projected/bc4ddda3-4f1b-4f5f-a146-b8898c564833-kube-api-access-l2rs8\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.164337 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.164305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc4ddda3-4f1b-4f5f-a146-b8898c564833-data-volume\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.164465 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.164352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc4ddda3-4f1b-4f5f-a146-b8898c564833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.264870 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.264846    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc4ddda3-4f1b-4f5f-a146-b8898c564833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.264999 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.264885    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8n5v7\" (UniqueName: \"kubernetes.io/projected/3f42c3cf-0fb7-4da2-ac10-d5f3e113b904-kube-api-access-8n5v7\") pod \"downloads-57bd96b888-hvjx7\" (UID: \"3f42c3cf-0fb7-4da2-ac10-d5f3e113b904\") " pod="openshift-console/downloads-57bd96b888-hvjx7"
May 21 19:24:56.264999 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.264910    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc4ddda3-4f1b-4f5f-a146-b8898c564833-crio-socket\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.264999 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.264943    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2rs8\" (UniqueName: \"kubernetes.io/projected/bc4ddda3-4f1b-4f5f-a146-b8898c564833-kube-api-access-l2rs8\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.264999 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.264970    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc4ddda3-4f1b-4f5f-a146-b8898c564833-data-volume\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.264999 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.264996    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc4ddda3-4f1b-4f5f-a146-b8898c564833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.265152 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.265003    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc4ddda3-4f1b-4f5f-a146-b8898c564833-crio-socket\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.265359 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.265344    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc4ddda3-4f1b-4f5f-a146-b8898c564833-data-volume\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.265443 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.265427    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc4ddda3-4f1b-4f5f-a146-b8898c564833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.267464 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.267443    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc4ddda3-4f1b-4f5f-a146-b8898c564833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.287920 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.287898    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n5v7\" (UniqueName: \"kubernetes.io/projected/3f42c3cf-0fb7-4da2-ac10-d5f3e113b904-kube-api-access-8n5v7\") pod \"downloads-57bd96b888-hvjx7\" (UID: \"3f42c3cf-0fb7-4da2-ac10-d5f3e113b904\") " pod="openshift-console/downloads-57bd96b888-hvjx7"
May 21 19:24:56.288464 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.288442    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2rs8\" (UniqueName: \"kubernetes.io/projected/bc4ddda3-4f1b-4f5f-a146-b8898c564833-kube-api-access-l2rs8\") pod \"insights-runtime-extractor-jl84v\" (UID: \"bc4ddda3-4f1b-4f5f-a146-b8898c564833\") " pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.379505 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.379481    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-hvjx7"
May 21 19:24:56.403099 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.403077    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jl84v"
May 21 19:24:56.532451 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.532389    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-hvjx7"]
May 21 19:24:56.534715 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:24:56.534684    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f42c3cf_0fb7_4da2_ac10_d5f3e113b904.slice/crio-18ad41e3c6c797b5d4d4ae55ac12a2edeb2554030485c177613d17b0031bead0 WatchSource:0}: Error finding container 18ad41e3c6c797b5d4d4ae55ac12a2edeb2554030485c177613d17b0031bead0: Status 404 returned error can't find the container with id 18ad41e3c6c797b5d4d4ae55ac12a2edeb2554030485c177613d17b0031bead0
May 21 19:24:56.572819 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.572793    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jl84v"]
May 21 19:24:56.573266 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:24:56.573245    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4ddda3_4f1b_4f5f_a146_b8898c564833.slice/crio-a18b3e2e991c49d575caf832b177f17ed2dba0f7eacabf42067eaacb98ad60ae WatchSource:0}: Error finding container a18b3e2e991c49d575caf832b177f17ed2dba0f7eacabf42067eaacb98ad60ae: Status 404 returned error can't find the container with id a18b3e2e991c49d575caf832b177f17ed2dba0f7eacabf42067eaacb98ad60ae
May 21 19:24:56.672669 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.672591    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-hvjx7" event={"ID":"3f42c3cf-0fb7-4da2-ac10-d5f3e113b904","Type":"ContainerStarted","Data":"18ad41e3c6c797b5d4d4ae55ac12a2edeb2554030485c177613d17b0031bead0"}
May 21 19:24:56.673856 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.673831    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:24:56.673977 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.673828    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jl84v" event={"ID":"bc4ddda3-4f1b-4f5f-a146-b8898c564833","Type":"ContainerStarted","Data":"dfa8e96cdab235136a209cb1f99b194a34b2a02044ebe604d445228917a80baa"}
May 21 19:24:56.673977 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.673946    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jl84v" event={"ID":"bc4ddda3-4f1b-4f5f-a146-b8898c564833","Type":"ContainerStarted","Data":"a18b3e2e991c49d575caf832b177f17ed2dba0f7eacabf42067eaacb98ad60ae"}
May 21 19:24:56.677670 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.677651    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:24:56.768457 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.768438    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-trusted-ca\") pod \"045b3add-f444-4f08-afde-7ad09694a645\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") "
May 21 19:24:56.768583 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.768467    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-image-registry-private-configuration\") pod \"045b3add-f444-4f08-afde-7ad09694a645\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") "
May 21 19:24:56.768583 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.768495    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-registry-certificates\") pod \"045b3add-f444-4f08-afde-7ad09694a645\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") "
May 21 19:24:56.768583 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.768527    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045b3add-f444-4f08-afde-7ad09694a645-ca-trust-extracted\") pod \"045b3add-f444-4f08-afde-7ad09694a645\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") "
May 21 19:24:56.768583 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.768547    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-installation-pull-secrets\") pod \"045b3add-f444-4f08-afde-7ad09694a645\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") "
May 21 19:24:56.768583 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.768565    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-bound-sa-token\") pod \"045b3add-f444-4f08-afde-7ad09694a645\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") "
May 21 19:24:56.768808 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.768601    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69kvk\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-kube-api-access-69kvk\") pod \"045b3add-f444-4f08-afde-7ad09694a645\" (UID: \"045b3add-f444-4f08-afde-7ad09694a645\") "
May 21 19:24:56.768896 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.768871    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "045b3add-f444-4f08-afde-7ad09694a645" (UID: "045b3add-f444-4f08-afde-7ad09694a645"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 19:24:56.769025 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.769001    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "045b3add-f444-4f08-afde-7ad09694a645" (UID: "045b3add-f444-4f08-afde-7ad09694a645"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 19:24:56.769090 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.769000    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045b3add-f444-4f08-afde-7ad09694a645-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "045b3add-f444-4f08-afde-7ad09694a645" (UID: "045b3add-f444-4f08-afde-7ad09694a645"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 19:24:56.770956 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.770927    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "045b3add-f444-4f08-afde-7ad09694a645" (UID: "045b3add-f444-4f08-afde-7ad09694a645"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 19:24:56.771065 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.771029    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "045b3add-f444-4f08-afde-7ad09694a645" (UID: "045b3add-f444-4f08-afde-7ad09694a645"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 19:24:56.771122 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.771059    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "045b3add-f444-4f08-afde-7ad09694a645" (UID: "045b3add-f444-4f08-afde-7ad09694a645"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 19:24:56.771122 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.771080    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-kube-api-access-69kvk" (OuterVolumeSpecName: "kube-api-access-69kvk") pod "045b3add-f444-4f08-afde-7ad09694a645" (UID: "045b3add-f444-4f08-afde-7ad09694a645"). InnerVolumeSpecName "kube-api-access-69kvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 19:24:56.869193 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.869149    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69kvk\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-kube-api-access-69kvk\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:24:56.869193 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.869200    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-trusted-ca\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:24:56.869327 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.869210    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-image-registry-private-configuration\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:24:56.869327 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.869219    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045b3add-f444-4f08-afde-7ad09694a645-registry-certificates\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:24:56.869327 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.869228    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045b3add-f444-4f08-afde-7ad09694a645-ca-trust-extracted\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:24:56.869327 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.869238    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045b3add-f444-4f08-afde-7ad09694a645-installation-pull-secrets\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:24:56.869327 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:56.869247    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-bound-sa-token\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:24:57.678977 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:57.678936    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796d7db4b6-vqpzz"
May 21 19:24:57.678977 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:57.678951    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jl84v" event={"ID":"bc4ddda3-4f1b-4f5f-a146-b8898c564833","Type":"ContainerStarted","Data":"f567c2ae346667cbbd31f1dc2c5b08266fac065085ac0da17117bbe9f172fd88"}
May 21 19:24:57.758237 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:57.758204    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-796d7db4b6-vqpzz"]
May 21 19:24:57.776000 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:57.775967    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-796d7db4b6-vqpzz"]
May 21 19:24:57.877535 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:57.877493    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045b3add-f444-4f08-afde-7ad09694a645-registry-tls\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:24:58.113575 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:58.113539    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="045b3add-f444-4f08-afde-7ad09694a645" path="/var/lib/kubelet/pods/045b3add-f444-4f08-afde-7ad09694a645/volumes"
May 21 19:24:59.690741 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:59.690696    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jl84v" event={"ID":"bc4ddda3-4f1b-4f5f-a146-b8898c564833","Type":"ContainerStarted","Data":"6132f38068d2a01322f948f6e058daa3feb5a94987a1d05e016f343db72578ee"}
May 21 19:24:59.711584 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:24:59.711532    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jl84v" podStartSLOduration=1.638540142 podStartE2EDuration="3.711514677s" podCreationTimestamp="2026-05-21 19:24:56 +0000 UTC" firstStartedPulling="2026-05-21 19:24:56.626128582 +0000 UTC m=+181.133533749" lastFinishedPulling="2026-05-21 19:24:58.699103114 +0000 UTC m=+183.206508284" observedRunningTime="2026-05-21 19:24:59.71087587 +0000 UTC m=+184.218281058" watchObservedRunningTime="2026-05-21 19:24:59.711514677 +0000 UTC m=+184.218919867"
May 21 19:25:01.031982 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.031891    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ff9bb6677-4rcrv"]
May 21 19:25:01.035283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.035260    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.038880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.038856    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 19:25:01.039515 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.039479    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 19:25:01.039515 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.039492    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 19:25:01.039687 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.039529    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-px77q\""
May 21 19:25:01.039687 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.039492    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 19:25:01.039687 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.039492    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 19:25:01.047565 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.047487    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff9bb6677-4rcrv"]
May 21 19:25:01.104784 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.104752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-service-ca\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.104784 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.104790    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-console-config\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.105023 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.104816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-oauth-config\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.105023 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.104925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66ts5\" (UniqueName: \"kubernetes.io/projected/30b4072d-72f7-431f-9565-977b31e39db9-kube-api-access-66ts5\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.105023 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.104974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-oauth-serving-cert\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.105167 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.105028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-serving-cert\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.206169 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.206129    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66ts5\" (UniqueName: \"kubernetes.io/projected/30b4072d-72f7-431f-9565-977b31e39db9-kube-api-access-66ts5\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.206169 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.206170    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-oauth-serving-cert\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.206419 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.206227    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-serving-cert\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.206474 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.206432    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-service-ca\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.206528 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.206488    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-console-config\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.206576 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.206530    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-oauth-config\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.207083 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.207038    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-oauth-serving-cert\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.207316 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.207294    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-service-ca\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.207418 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.207398    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-console-config\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.209055 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.209037    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-oauth-config\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.209192 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.209162    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-serving-cert\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.215064 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.215031    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66ts5\" (UniqueName: \"kubernetes.io/projected/30b4072d-72f7-431f-9565-977b31e39db9-kube-api-access-66ts5\") pod \"console-6ff9bb6677-4rcrv\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") " pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.346539 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.346483    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:01.461728 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.461696    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"]
May 21 19:25:01.466799 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.466771    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"
May 21 19:25:01.473163 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.473113    2561 status_manager.go:895] "Failed to get status for pod" podUID="7238601e-e4d3-4c32-b184-97ec819b9080" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb" err="pods \"prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb\" is forbidden: User \"system:node:ip-10-0-143-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-158.ec2.internal' and this object"
May 21 19:25:01.473163 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:25:01.473128    2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-operator-admission-webhook-tls\" is forbidden: User \"system:node:ip-10-0-143-158.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" type="*v1.Secret"
May 21 19:25:01.473163 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:25:01.473142    2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-operator-admission-webhook-dockercfg-dlkd4\" is forbidden: User \"system:node:ip-10-0-143-158.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-143-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dlkd4\"" type="*v1.Secret"
May 21 19:25:01.507130 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.507097    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"]
May 21 19:25:01.509311 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.509285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7238601e-e4d3-4c32-b184-97ec819b9080-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb\" (UID: \"7238601e-e4d3-4c32-b184-97ec819b9080\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"
May 21 19:25:01.537056 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.537004    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff9bb6677-4rcrv"]
May 21 19:25:01.542826 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:25:01.542795    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b4072d_72f7_431f_9565_977b31e39db9.slice/crio-4b99fcba00b47ad60df2a7beb5be10945301b21303f3d07a6becd43aee8faff5 WatchSource:0}: Error finding container 4b99fcba00b47ad60df2a7beb5be10945301b21303f3d07a6becd43aee8faff5: Status 404 returned error can't find the container with id 4b99fcba00b47ad60df2a7beb5be10945301b21303f3d07a6becd43aee8faff5
May 21 19:25:01.610660 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.610582    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7238601e-e4d3-4c32-b184-97ec819b9080-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb\" (UID: \"7238601e-e4d3-4c32-b184-97ec819b9080\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"
May 21 19:25:01.696463 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:01.696421    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff9bb6677-4rcrv" event={"ID":"30b4072d-72f7-431f-9565-977b31e39db9","Type":"ContainerStarted","Data":"4b99fcba00b47ad60df2a7beb5be10945301b21303f3d07a6becd43aee8faff5"}
May 21 19:25:02.388055 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:02.388025    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 21 19:25:02.394425 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:02.394380    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7238601e-e4d3-4c32-b184-97ec819b9080-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb\" (UID: \"7238601e-e4d3-4c32-b184-97ec819b9080\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"
May 21 19:25:02.780769 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:02.780641    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dlkd4\""
May 21 19:25:02.789285 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:02.789252    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"
May 21 19:25:02.936817 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:02.936070    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"]
May 21 19:25:02.942139 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:25:02.942110    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7238601e_e4d3_4c32_b184_97ec819b9080.slice/crio-6f7f9357433b84a4c5ed28354fe5fa885519ce77b3be030ead7756a128e855a7 WatchSource:0}: Error finding container 6f7f9357433b84a4c5ed28354fe5fa885519ce77b3be030ead7756a128e855a7: Status 404 returned error can't find the container with id 6f7f9357433b84a4c5ed28354fe5fa885519ce77b3be030ead7756a128e855a7
May 21 19:25:03.702765 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:03.702714    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb" event={"ID":"7238601e-e4d3-4c32-b184-97ec819b9080","Type":"ContainerStarted","Data":"6f7f9357433b84a4c5ed28354fe5fa885519ce77b3be030ead7756a128e855a7"}
May 21 19:25:05.709930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:05.709893    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff9bb6677-4rcrv" event={"ID":"30b4072d-72f7-431f-9565-977b31e39db9","Type":"ContainerStarted","Data":"6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44"}
May 21 19:25:05.711162 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:05.711133    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb" event={"ID":"7238601e-e4d3-4c32-b184-97ec819b9080","Type":"ContainerStarted","Data":"24aac9c6f561e315d9ef36a20863ffa07854165a52225ec55448ef8f8fa0084a"}
May 21 19:25:05.711336 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:05.711319    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"
May 21 19:25:05.715794 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:05.715762    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb"
May 21 19:25:05.745822 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:05.745759    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6ff9bb6677-4rcrv" podStartSLOduration=1.211988731 podStartE2EDuration="4.745747268s" podCreationTimestamp="2026-05-21 19:25:01 +0000 UTC" firstStartedPulling="2026-05-21 19:25:01.545264463 +0000 UTC m=+186.052669629" lastFinishedPulling="2026-05-21 19:25:05.079023 +0000 UTC m=+189.586428166" observedRunningTime="2026-05-21 19:25:05.7448804 +0000 UTC m=+190.252285589" watchObservedRunningTime="2026-05-21 19:25:05.745747268 +0000 UTC m=+190.253152456"
May 21 19:25:05.761047 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:05.761007    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb" podStartSLOduration=2.629077799 podStartE2EDuration="4.760996754s" podCreationTimestamp="2026-05-21 19:25:01 +0000 UTC" firstStartedPulling="2026-05-21 19:25:02.944586519 +0000 UTC m=+187.451991701" lastFinishedPulling="2026-05-21 19:25:05.076505484 +0000 UTC m=+189.583910656" observedRunningTime="2026-05-21 19:25:05.760015259 +0000 UTC m=+190.267420440" watchObservedRunningTime="2026-05-21 19:25:05.760996754 +0000 UTC m=+190.268401942"
May 21 19:25:06.455293 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.455262    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"]
May 21 19:25:06.458802 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.458782    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.461571 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.461365    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 21 19:25:06.461571 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.461370    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 19:25:06.461571 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.461419    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 21 19:25:06.461571 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.461455    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 19:25:06.462694 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.462668    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 19:25:06.462795 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.462745    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xgtp6\""
May 21 19:25:06.470126 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.470102    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"]
May 21 19:25:06.554273 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.554237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-785cv\" (UniqueName: \"kubernetes.io/projected/eb8f02e4-c4df-44ee-a44e-11f399688451-kube-api-access-785cv\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.554446 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.554291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb8f02e4-c4df-44ee-a44e-11f399688451-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.554446 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.554422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb8f02e4-c4df-44ee-a44e-11f399688451-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.554537 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.554460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb8f02e4-c4df-44ee-a44e-11f399688451-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.655254 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.655212    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb8f02e4-c4df-44ee-a44e-11f399688451-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.655438 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.655263    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb8f02e4-c4df-44ee-a44e-11f399688451-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.655438 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.655301    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-785cv\" (UniqueName: \"kubernetes.io/projected/eb8f02e4-c4df-44ee-a44e-11f399688451-kube-api-access-785cv\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.655438 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.655334    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb8f02e4-c4df-44ee-a44e-11f399688451-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.656055 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.656028    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb8f02e4-c4df-44ee-a44e-11f399688451-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.658231 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.658209    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb8f02e4-c4df-44ee-a44e-11f399688451-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.658716 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.658692    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb8f02e4-c4df-44ee-a44e-11f399688451-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.664757 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.664734    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-785cv\" (UniqueName: \"kubernetes.io/projected/eb8f02e4-c4df-44ee-a44e-11f399688451-kube-api-access-785cv\") pod \"prometheus-operator-7779bbdd78-lb8rh\" (UID: \"eb8f02e4-c4df-44ee-a44e-11f399688451\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.769037 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.768960    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"
May 21 19:25:06.910333 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:06.910302    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh"]
May 21 19:25:06.913301 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:25:06.913268    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8f02e4_c4df_44ee_a44e_11f399688451.slice/crio-932a7f66360348df8cb97e009814b86f6782da82fe9a28e1629d6922c029cdd7 WatchSource:0}: Error finding container 932a7f66360348df8cb97e009814b86f6782da82fe9a28e1629d6922c029cdd7: Status 404 returned error can't find the container with id 932a7f66360348df8cb97e009814b86f6782da82fe9a28e1629d6922c029cdd7
May 21 19:25:07.718218 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:07.718165    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh" event={"ID":"eb8f02e4-c4df-44ee-a44e-11f399688451","Type":"ContainerStarted","Data":"932a7f66360348df8cb97e009814b86f6782da82fe9a28e1629d6922c029cdd7"}
May 21 19:25:08.431022 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.430983    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6bd744cb-2g6k2"]
May 21 19:25:08.435397 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.435374    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.445483 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.445459    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 19:25:08.446387 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.446363    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6bd744cb-2g6k2"]
May 21 19:25:08.569626 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.569595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-oauth-serving-cert\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.569788 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.569637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-oauth-config\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.569788 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.569665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-console-config\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.569788 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.569768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-serving-cert\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.569948 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.569804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-service-ca\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.569948 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.569827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cvtr\" (UniqueName: \"kubernetes.io/projected/6052247e-9001-4028-a6b1-13d941369c33-kube-api-access-5cvtr\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.569948 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.569915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-trusted-ca-bundle\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.670620 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.670583    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-oauth-serving-cert\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.670620 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.670633    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-oauth-config\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.670871 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.670659    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-console-config\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.670871 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.670774    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-serving-cert\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.670871 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.670848    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-service-ca\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.671022 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.670880    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cvtr\" (UniqueName: \"kubernetes.io/projected/6052247e-9001-4028-a6b1-13d941369c33-kube-api-access-5cvtr\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.671022 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.670942    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-trusted-ca-bundle\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.671462 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.671432    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-console-config\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.671590 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.671432    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-oauth-serving-cert\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.671805 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.671712    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-service-ca\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.671805 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.671766    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-trusted-ca-bundle\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.673965 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.673941    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-oauth-config\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.674090 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.673980    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-serving-cert\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.681010 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.680989    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cvtr\" (UniqueName: \"kubernetes.io/projected/6052247e-9001-4028-a6b1-13d941369c33-kube-api-access-5cvtr\") pod \"console-5f6bd744cb-2g6k2\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") " pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:08.746049 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:08.745955    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:11.346937 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:11.346894    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:11.347379 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:11.346947    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:11.351911 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:11.351889    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:11.737576 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:11.737495    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:14.034793 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:14.034768    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6bd744cb-2g6k2"]
May 21 19:25:14.038227 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:25:14.038199    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6052247e_9001_4028_a6b1_13d941369c33.slice/crio-077592b6cd9ca285d89b52c71a621f688c1745a89293dd529b56dd7e0d866f64 WatchSource:0}: Error finding container 077592b6cd9ca285d89b52c71a621f688c1745a89293dd529b56dd7e0d866f64: Status 404 returned error can't find the container with id 077592b6cd9ca285d89b52c71a621f688c1745a89293dd529b56dd7e0d866f64
May 21 19:25:14.745123 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:14.744806    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-hvjx7" event={"ID":"3f42c3cf-0fb7-4da2-ac10-d5f3e113b904","Type":"ContainerStarted","Data":"35f43a97b98be2f81919278ede85e8dc9d742636da9e7a9648056774bc1c7ba6"}
May 21 19:25:14.745428 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:14.745159    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-hvjx7"
May 21 19:25:14.747497 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:14.747444    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6bd744cb-2g6k2" event={"ID":"6052247e-9001-4028-a6b1-13d941369c33","Type":"ContainerStarted","Data":"4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec"}
May 21 19:25:14.747497 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:14.747481    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6bd744cb-2g6k2" event={"ID":"6052247e-9001-4028-a6b1-13d941369c33","Type":"ContainerStarted","Data":"077592b6cd9ca285d89b52c71a621f688c1745a89293dd529b56dd7e0d866f64"}
May 21 19:25:14.761137 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:14.761112    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-hvjx7"
May 21 19:25:14.765716 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:14.765665    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-hvjx7" podStartSLOduration=1.299376743 podStartE2EDuration="18.765650913s" podCreationTimestamp="2026-05-21 19:24:56 +0000 UTC" firstStartedPulling="2026-05-21 19:24:56.536671973 +0000 UTC m=+181.044077139" lastFinishedPulling="2026-05-21 19:25:14.002946141 +0000 UTC m=+198.510351309" observedRunningTime="2026-05-21 19:25:14.764538805 +0000 UTC m=+199.271944022" watchObservedRunningTime="2026-05-21 19:25:14.765650913 +0000 UTC m=+199.273056082"
May 21 19:25:14.807140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:14.805707    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f6bd744cb-2g6k2" podStartSLOduration=6.805687145 podStartE2EDuration="6.805687145s" podCreationTimestamp="2026-05-21 19:25:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:25:14.80568536 +0000 UTC m=+199.313090548" watchObservedRunningTime="2026-05-21 19:25:14.805687145 +0000 UTC m=+199.313092336"
May 21 19:25:15.752944 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:15.752898    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh" event={"ID":"eb8f02e4-c4df-44ee-a44e-11f399688451","Type":"ContainerStarted","Data":"3750139e258e812b00079c8662a5f7ec2a25d78782bed2a6b50aa3169dac59d4"}
May 21 19:25:15.753504 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:15.753470    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh" event={"ID":"eb8f02e4-c4df-44ee-a44e-11f399688451","Type":"ContainerStarted","Data":"41ce08544edce5afd9c4cd79d4caeec73c6e10cb8ee4d87365ee5d8c75e1c054"}
May 21 19:25:15.788162 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:15.788115    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lb8rh" podStartSLOduration=1.682030491 podStartE2EDuration="9.788101527s" podCreationTimestamp="2026-05-21 19:25:06 +0000 UTC" firstStartedPulling="2026-05-21 19:25:06.91604049 +0000 UTC m=+191.423445665" lastFinishedPulling="2026-05-21 19:25:15.022111534 +0000 UTC m=+199.529516701" observedRunningTime="2026-05-21 19:25:15.786646773 +0000 UTC m=+200.294051964" watchObservedRunningTime="2026-05-21 19:25:15.788101527 +0000 UTC m=+200.295506748"
May 21 19:25:18.213879 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.213841    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w84vb"]
May 21 19:25:18.241398 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.241370    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"]
May 21 19:25:18.241703 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.241673    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.256012 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.255981    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gmcqh\""
May 21 19:25:18.256126 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.256023    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 19:25:18.256408 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.256388    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 19:25:18.256615 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.256590    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 19:25:18.257235 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.257218    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"]
May 21 19:25:18.258723 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.257455    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.262240 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.262219    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 21 19:25:18.262384 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.262354    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 21 19:25:18.263071 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.262723    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-skcmw\""
May 21 19:25:18.263071 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.262908    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 21 19:25:18.277535 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.277514    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"]
May 21 19:25:18.277637 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.277542    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"]
May 21 19:25:18.277695 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.277638    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.301930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.301906    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 21 19:25:18.302566 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.302542    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 21 19:25:18.305875 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.305851    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kkv2w\""
May 21 19:25:18.356576 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38bc129c-3a39-47e1-a37a-45e5c95c013d-metrics-client-ca\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.356576 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e687a258-41c9-415f-9127-e88c1b0909ca-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.356752 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-tls\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.356752 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c948202b-38bc-425c-9928-a44261606e21-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.356752 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356679    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c948202b-38bc-425c-9928-a44261606e21-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.356752 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c948202b-38bc-425c-9928-a44261606e21-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.356752 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-textfile\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.357044 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-wtmp\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.357044 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swdfd\" (UniqueName: \"kubernetes.io/projected/c948202b-38bc-425c-9928-a44261606e21-kube-api-access-swdfd\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.357044 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c948202b-38bc-425c-9928-a44261606e21-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.357044 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e687a258-41c9-415f-9127-e88c1b0909ca-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.357044 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.356949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.357044 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.357014    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38bc129c-3a39-47e1-a37a-45e5c95c013d-sys\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.357382 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.357050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e687a258-41c9-415f-9127-e88c1b0909ca-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.357382 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.357078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38bc129c-3a39-47e1-a37a-45e5c95c013d-root\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.357382 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.357107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2z8l\" (UniqueName: \"kubernetes.io/projected/e687a258-41c9-415f-9127-e88c1b0909ca-kube-api-access-w2z8l\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.357382 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.357143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c948202b-38bc-425c-9928-a44261606e21-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.357382 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.357194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-accelerators-collector-config\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.357382 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.357222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l5wz\" (UniqueName: \"kubernetes.io/projected/38bc129c-3a39-47e1-a37a-45e5c95c013d-kube-api-access-2l5wz\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458039 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458007    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38bc129c-3a39-47e1-a37a-45e5c95c013d-metrics-client-ca\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458230 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458049    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e687a258-41c9-415f-9127-e88c1b0909ca-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.458230 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458078    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-tls\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458230 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458117    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c948202b-38bc-425c-9928-a44261606e21-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.458230 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458143    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c948202b-38bc-425c-9928-a44261606e21-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.458230 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458171    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c948202b-38bc-425c-9928-a44261606e21-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.458230 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458225    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-textfile\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458259    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-wtmp\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458288    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swdfd\" (UniqueName: \"kubernetes.io/projected/c948202b-38bc-425c-9928-a44261606e21-kube-api-access-swdfd\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.458556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458320    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c948202b-38bc-425c-9928-a44261606e21-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.458556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458372    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e687a258-41c9-415f-9127-e88c1b0909ca-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.458556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458415    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458453    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38bc129c-3a39-47e1-a37a-45e5c95c013d-sys\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458479    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e687a258-41c9-415f-9127-e88c1b0909ca-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.458556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458530    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38bc129c-3a39-47e1-a37a-45e5c95c013d-root\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458561    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2z8l\" (UniqueName: \"kubernetes.io/projected/e687a258-41c9-415f-9127-e88c1b0909ca-kube-api-access-w2z8l\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.458927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458596    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c948202b-38bc-425c-9928-a44261606e21-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.458927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458628    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-accelerators-collector-config\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458673    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2l5wz\" (UniqueName: \"kubernetes.io/projected/38bc129c-3a39-47e1-a37a-45e5c95c013d-kube-api-access-2l5wz\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458687    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38bc129c-3a39-47e1-a37a-45e5c95c013d-metrics-client-ca\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.458927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458761    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38bc129c-3a39-47e1-a37a-45e5c95c013d-root\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.459228 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.458920    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c948202b-38bc-425c-9928-a44261606e21-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.459371 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.459346    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c948202b-38bc-425c-9928-a44261606e21-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.459439 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.459413    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38bc129c-3a39-47e1-a37a-45e5c95c013d-sys\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.459557 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.459536    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-wtmp\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.459803 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.459780    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-textfile\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.459890 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.459818    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c948202b-38bc-425c-9928-a44261606e21-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.459890 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.459834    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-accelerators-collector-config\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.460168 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.459356    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e687a258-41c9-415f-9127-e88c1b0909ca-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.462383 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.462360    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c948202b-38bc-425c-9928-a44261606e21-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.462953 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.462858    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e687a258-41c9-415f-9127-e88c1b0909ca-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.462953 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.462898    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c948202b-38bc-425c-9928-a44261606e21-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.463106 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.463054    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e687a258-41c9-415f-9127-e88c1b0909ca-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.463256 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.463162    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-tls\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.464167 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.464118    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38bc129c-3a39-47e1-a37a-45e5c95c013d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.485887 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.485861    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l5wz\" (UniqueName: \"kubernetes.io/projected/38bc129c-3a39-47e1-a37a-45e5c95c013d-kube-api-access-2l5wz\") pod \"node-exporter-w84vb\" (UID: \"38bc129c-3a39-47e1-a37a-45e5c95c013d\") " pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.487726 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.487675    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2z8l\" (UniqueName: \"kubernetes.io/projected/e687a258-41c9-415f-9127-e88c1b0909ca-kube-api-access-w2z8l\") pod \"openshift-state-metrics-9c959559f-fmv4g\" (UID: \"e687a258-41c9-415f-9127-e88c1b0909ca\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.488886 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.488862    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swdfd\" (UniqueName: \"kubernetes.io/projected/c948202b-38bc-425c-9928-a44261606e21-kube-api-access-swdfd\") pod \"kube-state-metrics-54fd6bc5c4-wwnqq\" (UID: \"c948202b-38bc-425c-9928-a44261606e21\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.554553 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.554519    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w84vb"
May 21 19:25:18.563764 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:25:18.563731    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38bc129c_3a39_47e1_a37a_45e5c95c013d.slice/crio-9864227af40deeca3b281f874448f5030b914eba8c69a58abac2acba7f0285fd WatchSource:0}: Error finding container 9864227af40deeca3b281f874448f5030b914eba8c69a58abac2acba7f0285fd: Status 404 returned error can't find the container with id 9864227af40deeca3b281f874448f5030b914eba8c69a58abac2acba7f0285fd
May 21 19:25:18.570307 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.570285    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"
May 21 19:25:18.589552 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.589520    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"
May 21 19:25:18.746753 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.746454    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:18.746753 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.746498    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:18.752371 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.752345    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:18.762381 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.762235    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w84vb" event={"ID":"38bc129c-3a39-47e1-a37a-45e5c95c013d","Type":"ContainerStarted","Data":"9864227af40deeca3b281f874448f5030b914eba8c69a58abac2acba7f0285fd"}
May 21 19:25:18.767295 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.767248    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:18.808232 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.808205    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g"]
May 21 19:25:18.841637 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.841469    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq"]
May 21 19:25:18.842829 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:25:18.842794    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc948202b_38bc_425c_9928_a44261606e21.slice/crio-0a4b6123f7e18a714b4b8065248b690bab626620c1726087060a7f51efe846de WatchSource:0}: Error finding container 0a4b6123f7e18a714b4b8065248b690bab626620c1726087060a7f51efe846de: Status 404 returned error can't find the container with id 0a4b6123f7e18a714b4b8065248b690bab626620c1726087060a7f51efe846de
May 21 19:25:18.999790 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:18.999753    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff9bb6677-4rcrv"]
May 21 19:25:19.773016 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:19.772980    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq" event={"ID":"c948202b-38bc-425c-9928-a44261606e21","Type":"ContainerStarted","Data":"0a4b6123f7e18a714b4b8065248b690bab626620c1726087060a7f51efe846de"}
May 21 19:25:19.777907 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:19.777879    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g" event={"ID":"e687a258-41c9-415f-9127-e88c1b0909ca","Type":"ContainerStarted","Data":"3735110d0ed51b9cbc677f862afa56fda63e5476086574959aa6864dda991753"}
May 21 19:25:19.778044 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:19.777911    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g" event={"ID":"e687a258-41c9-415f-9127-e88c1b0909ca","Type":"ContainerStarted","Data":"2bedcc98ac3fa507bc9599b5ca214e7b17572f323deee0b602988388d9e97d9f"}
May 21 19:25:19.778044 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:19.777925    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g" event={"ID":"e687a258-41c9-415f-9127-e88c1b0909ca","Type":"ContainerStarted","Data":"48d8a3d364aad3f97a08cfc0b77b7308d1e1d6dfe37545ba6c1c5c6a09f8e90e"}
May 21 19:25:21.786247 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:21.786073    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g" event={"ID":"e687a258-41c9-415f-9127-e88c1b0909ca","Type":"ContainerStarted","Data":"4d4fa7ffc37d9249b974ac8368f30bf6b552d6128decd30aaeaa9c50ec4259d6"}
May 21 19:25:21.789342 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:21.788251    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq" event={"ID":"c948202b-38bc-425c-9928-a44261606e21","Type":"ContainerStarted","Data":"3bc68bab155bf222b22099bc1b19e4709f9d841935e221dd4394b1487e23e3ec"}
May 21 19:25:21.789515 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:21.789469    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w84vb" event={"ID":"38bc129c-3a39-47e1-a37a-45e5c95c013d","Type":"ContainerStarted","Data":"cd1bd9f25ee5c283ecfdb204c525dd73051c7997f9c633feb6ef170021fbaf3f"}
May 21 19:25:21.845557 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:21.845062    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fmv4g" podStartSLOduration=1.398299433 podStartE2EDuration="3.845043463s" podCreationTimestamp="2026-05-21 19:25:18 +0000 UTC" firstStartedPulling="2026-05-21 19:25:19.107351416 +0000 UTC m=+203.614756589" lastFinishedPulling="2026-05-21 19:25:21.554095452 +0000 UTC m=+206.061500619" observedRunningTime="2026-05-21 19:25:21.844842435 +0000 UTC m=+206.352247694" watchObservedRunningTime="2026-05-21 19:25:21.845043463 +0000 UTC m=+206.352448652"
May 21 19:25:22.667994 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.667953    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"]
May 21 19:25:22.687865 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.687820    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"]
May 21 19:25:22.688025 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.687969    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"
May 21 19:25:22.690847 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.690821    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-dcnvr\""
May 21 19:25:22.691002 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.690824    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 21 19:25:22.796104 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.796035    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq" event={"ID":"c948202b-38bc-425c-9928-a44261606e21","Type":"ContainerStarted","Data":"42e04178eaaa676b024bfccc062b3d2c2250af45243e04a5719cf176209bad9c"}
May 21 19:25:22.796104 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.796081    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq" event={"ID":"c948202b-38bc-425c-9928-a44261606e21","Type":"ContainerStarted","Data":"dcf35cb8844c76dc7607cc9c1916485a0b9fe18a43b68d249620c282f94072d7"}
May 21 19:25:22.797526 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.797487    2561 generic.go:358] "Generic (PLEG): container finished" podID="38bc129c-3a39-47e1-a37a-45e5c95c013d" containerID="cd1bd9f25ee5c283ecfdb204c525dd73051c7997f9c633feb6ef170021fbaf3f" exitCode=0
May 21 19:25:22.797671 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.797570    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w84vb" event={"ID":"38bc129c-3a39-47e1-a37a-45e5c95c013d","Type":"ContainerDied","Data":"cd1bd9f25ee5c283ecfdb204c525dd73051c7997f9c633feb6ef170021fbaf3f"}
May 21 19:25:22.802978 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.802958    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3691c35-3322-434a-aeb0-3db0826cc523-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vqx5v\" (UID: \"e3691c35-3322-434a-aeb0-3db0826cc523\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"
May 21 19:25:22.823079 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.823054    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d9bbbbf5d-56htx"]
May 21 19:25:22.825517 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.825476    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wwnqq" podStartSLOduration=2.119032593 podStartE2EDuration="4.825464846s" podCreationTimestamp="2026-05-21 19:25:18 +0000 UTC" firstStartedPulling="2026-05-21 19:25:18.844831543 +0000 UTC m=+203.352236722" lastFinishedPulling="2026-05-21 19:25:21.551263805 +0000 UTC m=+206.058668975" observedRunningTime="2026-05-21 19:25:22.824988504 +0000 UTC m=+207.332393687" watchObservedRunningTime="2026-05-21 19:25:22.825464846 +0000 UTC m=+207.332870034"
May 21 19:25:22.843839 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.843813    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d9bbbbf5d-56htx"]
May 21 19:25:22.843986 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.843907    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:22.847239 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.847218    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 21 19:25:22.847552 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.847533    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-buauqr2rdvukb\""
May 21 19:25:22.847876 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.847860    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 21 19:25:22.848263 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.848223    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 21 19:25:22.848528 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.848248    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8ghdf\""
May 21 19:25:22.848638 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.848355    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 19:25:22.904293 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:22.904257    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3691c35-3322-434a-aeb0-3db0826cc523-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vqx5v\" (UID: \"e3691c35-3322-434a-aeb0-3db0826cc523\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"
May 21 19:25:22.904415 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:25:22.904378    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 21 19:25:22.904478 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:25:22.904434    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3691c35-3322-434a-aeb0-3db0826cc523-monitoring-plugin-cert podName:e3691c35-3322-434a-aeb0-3db0826cc523 nodeName:}" failed. No retries permitted until 2026-05-21 19:25:23.40441456 +0000 UTC m=+207.911819726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e3691c35-3322-434a-aeb0-3db0826cc523-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-vqx5v" (UID: "e3691c35-3322-434a-aeb0-3db0826cc523") : secret "monitoring-plugin-cert" not found
May 21 19:25:23.005858 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.005835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d578145-8ede-4626-b884-9ffd8d9e1b84-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.005965 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.005869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcd9t\" (UniqueName: \"kubernetes.io/projected/1d578145-8ede-4626-b884-9ffd8d9e1b84-kube-api-access-wcd9t\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.005965 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.005898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1d578145-8ede-4626-b884-9ffd8d9e1b84-metrics-server-audit-profiles\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.005965 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.005939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1d578145-8ede-4626-b884-9ffd8d9e1b84-audit-log\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.005965 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.005962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1d578145-8ede-4626-b884-9ffd8d9e1b84-secret-metrics-server-tls\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.006128 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.005987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1d578145-8ede-4626-b884-9ffd8d9e1b84-secret-metrics-server-client-certs\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.006128 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.006058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d578145-8ede-4626-b884-9ffd8d9e1b84-client-ca-bundle\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.106507 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.106466    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d578145-8ede-4626-b884-9ffd8d9e1b84-client-ca-bundle\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.106692 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.106552    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d578145-8ede-4626-b884-9ffd8d9e1b84-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.106692 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.106584    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcd9t\" (UniqueName: \"kubernetes.io/projected/1d578145-8ede-4626-b884-9ffd8d9e1b84-kube-api-access-wcd9t\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.106692 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.106616    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1d578145-8ede-4626-b884-9ffd8d9e1b84-metrics-server-audit-profiles\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.106692 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.106649    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1d578145-8ede-4626-b884-9ffd8d9e1b84-audit-log\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.106692 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.106687    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1d578145-8ede-4626-b884-9ffd8d9e1b84-secret-metrics-server-tls\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.106920 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.106735    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1d578145-8ede-4626-b884-9ffd8d9e1b84-secret-metrics-server-client-certs\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.107067 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.107048    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1d578145-8ede-4626-b884-9ffd8d9e1b84-audit-log\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.107474 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.107445    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d578145-8ede-4626-b884-9ffd8d9e1b84-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.107820 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.107802    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1d578145-8ede-4626-b884-9ffd8d9e1b84-metrics-server-audit-profiles\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.109255 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.109228    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d578145-8ede-4626-b884-9ffd8d9e1b84-client-ca-bundle\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.109520 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.109499    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1d578145-8ede-4626-b884-9ffd8d9e1b84-secret-metrics-server-tls\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.109674 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.109655    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1d578145-8ede-4626-b884-9ffd8d9e1b84-secret-metrics-server-client-certs\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.115721 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.115703    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcd9t\" (UniqueName: \"kubernetes.io/projected/1d578145-8ede-4626-b884-9ffd8d9e1b84-kube-api-access-wcd9t\") pod \"metrics-server-d9bbbbf5d-56htx\" (UID: \"1d578145-8ede-4626-b884-9ffd8d9e1b84\") " pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.184271 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.184199    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:23.314443 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.314391    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d9bbbbf5d-56htx"]
May 21 19:25:23.316880 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:25:23.316851    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d578145_8ede_4626_b884_9ffd8d9e1b84.slice/crio-1eda2d2cdf61b9a63b65ddaf2bcf9028bb6a021cf998a589a016532ec1f20301 WatchSource:0}: Error finding container 1eda2d2cdf61b9a63b65ddaf2bcf9028bb6a021cf998a589a016532ec1f20301: Status 404 returned error can't find the container with id 1eda2d2cdf61b9a63b65ddaf2bcf9028bb6a021cf998a589a016532ec1f20301
May 21 19:25:23.410138 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.410112    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3691c35-3322-434a-aeb0-3db0826cc523-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vqx5v\" (UID: \"e3691c35-3322-434a-aeb0-3db0826cc523\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"
May 21 19:25:23.412378 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.412360    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3691c35-3322-434a-aeb0-3db0826cc523-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vqx5v\" (UID: \"e3691c35-3322-434a-aeb0-3db0826cc523\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"
May 21 19:25:23.601916 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.601887    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"
May 21 19:25:23.732952 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.732913    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"]
May 21 19:25:23.735615 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:25:23.735585    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3691c35_3322_434a_aeb0_3db0826cc523.slice/crio-c16a6ed6387cebf0d1d5321585346aea5e233c4dc1e57eda08c50a79cceed2c1 WatchSource:0}: Error finding container c16a6ed6387cebf0d1d5321585346aea5e233c4dc1e57eda08c50a79cceed2c1: Status 404 returned error can't find the container with id c16a6ed6387cebf0d1d5321585346aea5e233c4dc1e57eda08c50a79cceed2c1
May 21 19:25:23.801210 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.801163    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v" event={"ID":"e3691c35-3322-434a-aeb0-3db0826cc523","Type":"ContainerStarted","Data":"c16a6ed6387cebf0d1d5321585346aea5e233c4dc1e57eda08c50a79cceed2c1"}
May 21 19:25:23.803015 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.802984    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w84vb" event={"ID":"38bc129c-3a39-47e1-a37a-45e5c95c013d","Type":"ContainerStarted","Data":"7bc99ecfb45f7ee46ef8b78bdeb4beb01afbeeb1dc571e1f6f25571b7b005465"}
May 21 19:25:23.803015 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.803011    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w84vb" event={"ID":"38bc129c-3a39-47e1-a37a-45e5c95c013d","Type":"ContainerStarted","Data":"a9ca617de90a6e07979a1b8b5f5af822537703b8c80e08a45f06cdace9aecfea"}
May 21 19:25:23.804056 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.804023    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx" event={"ID":"1d578145-8ede-4626-b884-9ffd8d9e1b84","Type":"ContainerStarted","Data":"1eda2d2cdf61b9a63b65ddaf2bcf9028bb6a021cf998a589a016532ec1f20301"}
May 21 19:25:23.826550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:23.826505    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w84vb" podStartSLOduration=2.840947798 podStartE2EDuration="5.826492515s" podCreationTimestamp="2026-05-21 19:25:18 +0000 UTC" firstStartedPulling="2026-05-21 19:25:18.565720701 +0000 UTC m=+203.073125873" lastFinishedPulling="2026-05-21 19:25:21.55126541 +0000 UTC m=+206.058670590" observedRunningTime="2026-05-21 19:25:23.824889033 +0000 UTC m=+208.332294221" watchObservedRunningTime="2026-05-21 19:25:23.826492515 +0000 UTC m=+208.333897703"
May 21 19:25:24.494000 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.493958    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 19:25:24.510279 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.510243    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.516570 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.516538    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 19:25:24.516876 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.516849    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 19:25:24.516876 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.516860    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 19:25:24.517214 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.517170    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 19:25:24.517288 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.517272    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 19:25:24.517558 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.517485    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 19:25:24.517558 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.517508    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 19:25:24.517823 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.517802    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6nb4l\""
May 21 19:25:24.518279 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.518209    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 19:25:24.519523 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.518409    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 19:25:24.524205 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.519956    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 19:25:24.529603 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.529360    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 19:25:24.530262 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530103    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7kmrqukql8amu\""
May 21 19:25:24.530262 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.530262 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.530582 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.530653 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7e1d86e-5ffb-4349-91fc-4c71b609050a-config-out\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.530706 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.530820 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntcc\" (UniqueName: \"kubernetes.io/projected/c7e1d86e-5ffb-4349-91fc-4c71b609050a-kube-api-access-rntcc\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.530904 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530884    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.530970 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530926    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531040 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.530976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-web-config\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531272 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531441 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7e1d86e-5ffb-4349-91fc-4c71b609050a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531541 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531541 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531494    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 19:25:24.531653 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531653 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531653 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c7e1d86e-5ffb-4349-91fc-4c71b609050a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531801 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-config\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531801 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.531927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.531889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.533791 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.533768    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 19:25:24.632558 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.632519    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-config\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.632695 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.632574    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.632787    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.632854    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.632882    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.632907    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.632925    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7e1d86e-5ffb-4349-91fc-4c71b609050a-config-out\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.632948    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.632973    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rntcc\" (UniqueName: \"kubernetes.io/projected/c7e1d86e-5ffb-4349-91fc-4c71b609050a-kube-api-access-rntcc\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633003    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633019    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633047    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-web-config\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633071    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633102    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7e1d86e-5ffb-4349-91fc-4c71b609050a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633134    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633160    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633220    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633246    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c7e1d86e-5ffb-4349-91fc-4c71b609050a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.633751 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.633555    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c7e1d86e-5ffb-4349-91fc-4c71b609050a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.634867 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.634129    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.635353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.635032    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.635353 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.635327    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.638157 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.638049    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.638157 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.638114    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c7e1d86e-5ffb-4349-91fc-4c71b609050a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.639126 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.639058    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.641338 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.641295    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7e1d86e-5ffb-4349-91fc-4c71b609050a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.641631 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.641607    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.642237 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.642213    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.642720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.642697    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.643199 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.643159    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-config\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.643452 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.643269    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.643452 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.643369    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7e1d86e-5ffb-4349-91fc-4c71b609050a-config-out\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.644248 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.644201    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-web-config\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.644447 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.644408    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.644540 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.644522    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c7e1d86e-5ffb-4349-91fc-4c71b609050a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.644927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.644888    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntcc\" (UniqueName: \"kubernetes.io/projected/c7e1d86e-5ffb-4349-91fc-4c71b609050a-kube-api-access-rntcc\") pod \"prometheus-k8s-0\" (UID: \"c7e1d86e-5ffb-4349-91fc-4c71b609050a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:24.835383 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:24.835280    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:26.166010 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:26.165978    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 19:25:26.169545 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:25:26.169518    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e1d86e_5ffb_4349_91fc_4c71b609050a.slice/crio-975ef1ebe2080c8940e011df7a19bf4989f9405890196693ae85e698e9b7ab54 WatchSource:0}: Error finding container 975ef1ebe2080c8940e011df7a19bf4989f9405890196693ae85e698e9b7ab54: Status 404 returned error can't find the container with id 975ef1ebe2080c8940e011df7a19bf4989f9405890196693ae85e698e9b7ab54
May 21 19:25:26.820467 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:26.820386    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v" event={"ID":"e3691c35-3322-434a-aeb0-3db0826cc523","Type":"ContainerStarted","Data":"10c0a6375f476da3fac7b1e6fdecf541395a70fb2f9e3d694166245e636917cc"}
May 21 19:25:26.820467 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:26.820443    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"
May 21 19:25:26.824593 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:26.824551    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx" event={"ID":"1d578145-8ede-4626-b884-9ffd8d9e1b84","Type":"ContainerStarted","Data":"1cd1304971fd78b3f980629f93739fbad527b246b53bdb24d041b5676583fc0f"}
May 21 19:25:26.826614 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:26.826420    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7e1d86e-5ffb-4349-91fc-4c71b609050a","Type":"ContainerStarted","Data":"975ef1ebe2080c8940e011df7a19bf4989f9405890196693ae85e698e9b7ab54"}
May 21 19:25:26.826737 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:26.826724    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v"
May 21 19:25:26.838419 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:26.838377    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vqx5v" podStartSLOduration=2.56438537 podStartE2EDuration="4.838366287s" podCreationTimestamp="2026-05-21 19:25:22 +0000 UTC" firstStartedPulling="2026-05-21 19:25:23.737825172 +0000 UTC m=+208.245230338" lastFinishedPulling="2026-05-21 19:25:26.011806089 +0000 UTC m=+210.519211255" observedRunningTime="2026-05-21 19:25:26.838083162 +0000 UTC m=+211.345488351" watchObservedRunningTime="2026-05-21 19:25:26.838366287 +0000 UTC m=+211.345771521"
May 21 19:25:26.856788 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:26.856746    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx" podStartSLOduration=2.167125495 podStartE2EDuration="4.856735173s" podCreationTimestamp="2026-05-21 19:25:22 +0000 UTC" firstStartedPulling="2026-05-21 19:25:23.318671755 +0000 UTC m=+207.826076921" lastFinishedPulling="2026-05-21 19:25:26.008281431 +0000 UTC m=+210.515686599" observedRunningTime="2026-05-21 19:25:26.855774567 +0000 UTC m=+211.363179762" watchObservedRunningTime="2026-05-21 19:25:26.856735173 +0000 UTC m=+211.364140361"
May 21 19:25:27.830677 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:27.830647    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7e1d86e-5ffb-4349-91fc-4c71b609050a","Type":"ContainerStarted","Data":"03ce399f3a8b3e74315abc2435422cc2637501b992d419bc31cea03aea83ffd5"}
May 21 19:25:28.834300 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:28.834266    2561 generic.go:358] "Generic (PLEG): container finished" podID="c7e1d86e-5ffb-4349-91fc-4c71b609050a" containerID="03ce399f3a8b3e74315abc2435422cc2637501b992d419bc31cea03aea83ffd5" exitCode=0
May 21 19:25:28.834656 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:28.834361    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7e1d86e-5ffb-4349-91fc-4c71b609050a","Type":"ContainerDied","Data":"03ce399f3a8b3e74315abc2435422cc2637501b992d419bc31cea03aea83ffd5"}
May 21 19:25:32.853007 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:32.852924    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7e1d86e-5ffb-4349-91fc-4c71b609050a","Type":"ContainerStarted","Data":"6216adb26d7e563724cc96f0fb4f156af2e713f7de5bba39c2671a5c1eab8043"}
May 21 19:25:32.853007 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:32.852967    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7e1d86e-5ffb-4349-91fc-4c71b609050a","Type":"ContainerStarted","Data":"ee08d916d2bbbe47f4c039cffa8736e4e2267d765a585ae9c66bc39eb62230f1"}
May 21 19:25:33.274408 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:33.274323    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6bd744cb-2g6k2"]
May 21 19:25:35.865117 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:35.865085    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7e1d86e-5ffb-4349-91fc-4c71b609050a","Type":"ContainerStarted","Data":"517a44113826d39822552905ba95d4f982c0c8a9b7811c0cc4be45f11974631c"}
May 21 19:25:35.865117 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:35.865119    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7e1d86e-5ffb-4349-91fc-4c71b609050a","Type":"ContainerStarted","Data":"9c0abc73410d0fe1acd7ab2c8cbde46d3f7180df701544d622c209c107587fbd"}
May 21 19:25:35.865616 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:35.865130    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7e1d86e-5ffb-4349-91fc-4c71b609050a","Type":"ContainerStarted","Data":"9bb271f73e603f4836be6fbefcaa25fd2c28265601abb816d9798535771bce93"}
May 21 19:25:35.865616 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:35.865139    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7e1d86e-5ffb-4349-91fc-4c71b609050a","Type":"ContainerStarted","Data":"1dc05ee03051013bbbfd06eaebddecd254fd74cabfdb6ad7d1b90d10342c9d03"}
May 21 19:25:35.897229 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:35.897159    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.062294636 podStartE2EDuration="11.897143104s" podCreationTimestamp="2026-05-21 19:25:24 +0000 UTC" firstStartedPulling="2026-05-21 19:25:26.172217222 +0000 UTC m=+210.679622387" lastFinishedPulling="2026-05-21 19:25:35.007065689 +0000 UTC m=+219.514470855" observedRunningTime="2026-05-21 19:25:35.895126446 +0000 UTC m=+220.402531633" watchObservedRunningTime="2026-05-21 19:25:35.897143104 +0000 UTC m=+220.404548292"
May 21 19:25:39.836415 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:39.836383    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:25:40.881720 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:40.881689    2561 generic.go:358] "Generic (PLEG): container finished" podID="19e89e89-3942-4f9b-a8e1-61f2c8697791" containerID="5b1beabf69fbaf5bb75eafa45deb17e4e8bc91ac474905980de565b9b1eb61f3" exitCode=0
May 21 19:25:40.882038 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:40.881737    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972" event={"ID":"19e89e89-3942-4f9b-a8e1-61f2c8697791","Type":"ContainerDied","Data":"5b1beabf69fbaf5bb75eafa45deb17e4e8bc91ac474905980de565b9b1eb61f3"}
May 21 19:25:40.882038 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:40.882000    2561 scope.go:117] "RemoveContainer" containerID="5b1beabf69fbaf5bb75eafa45deb17e4e8bc91ac474905980de565b9b1eb61f3"
May 21 19:25:41.885609 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:41.885576    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-7s972" event={"ID":"19e89e89-3942-4f9b-a8e1-61f2c8697791","Type":"ContainerStarted","Data":"bf8420d3b3099d6fd36db2ebb7a32f03218a00fad5069a35d103d35d91232826"}
May 21 19:25:43.184903 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:43.184873    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:43.185317 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:43.184962    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:25:44.024942 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.024886    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6ff9bb6677-4rcrv" podUID="30b4072d-72f7-431f-9565-977b31e39db9" containerName="console" containerID="cri-o://6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44" gracePeriod=15
May 21 19:25:44.266308 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.266287    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff9bb6677-4rcrv_30b4072d-72f7-431f-9565-977b31e39db9/console/0.log"
May 21 19:25:44.266598 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.266351    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:44.311238 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311214    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-service-ca\") pod \"30b4072d-72f7-431f-9565-977b31e39db9\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") "
May 21 19:25:44.311392 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311255    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-oauth-serving-cert\") pod \"30b4072d-72f7-431f-9565-977b31e39db9\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") "
May 21 19:25:44.311392 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311283    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-serving-cert\") pod \"30b4072d-72f7-431f-9565-977b31e39db9\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") "
May 21 19:25:44.311392 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311338    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-console-config\") pod \"30b4072d-72f7-431f-9565-977b31e39db9\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") "
May 21 19:25:44.311553 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311422    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-oauth-config\") pod \"30b4072d-72f7-431f-9565-977b31e39db9\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") "
May 21 19:25:44.311553 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311460    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66ts5\" (UniqueName: \"kubernetes.io/projected/30b4072d-72f7-431f-9565-977b31e39db9-kube-api-access-66ts5\") pod \"30b4072d-72f7-431f-9565-977b31e39db9\" (UID: \"30b4072d-72f7-431f-9565-977b31e39db9\") "
May 21 19:25:44.311646 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311578    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-service-ca" (OuterVolumeSpecName: "service-ca") pod "30b4072d-72f7-431f-9565-977b31e39db9" (UID: "30b4072d-72f7-431f-9565-977b31e39db9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 19:25:44.311774 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311750    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "30b4072d-72f7-431f-9565-977b31e39db9" (UID: "30b4072d-72f7-431f-9565-977b31e39db9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 19:25:44.311895 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311826    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-console-config" (OuterVolumeSpecName: "console-config") pod "30b4072d-72f7-431f-9565-977b31e39db9" (UID: "30b4072d-72f7-431f-9565-977b31e39db9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 19:25:44.311895 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311839    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-service-ca\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:44.311895 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.311858    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-oauth-serving-cert\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:44.313762 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.313733    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "30b4072d-72f7-431f-9565-977b31e39db9" (UID: "30b4072d-72f7-431f-9565-977b31e39db9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 19:25:44.313762 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.313751    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "30b4072d-72f7-431f-9565-977b31e39db9" (UID: "30b4072d-72f7-431f-9565-977b31e39db9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 19:25:44.313886 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.313767    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b4072d-72f7-431f-9565-977b31e39db9-kube-api-access-66ts5" (OuterVolumeSpecName: "kube-api-access-66ts5") pod "30b4072d-72f7-431f-9565-977b31e39db9" (UID: "30b4072d-72f7-431f-9565-977b31e39db9"). InnerVolumeSpecName "kube-api-access-66ts5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 19:25:44.412766 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.412737    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-serving-cert\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:44.412766 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.412763    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b4072d-72f7-431f-9565-977b31e39db9-console-config\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:44.412766 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.412772    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b4072d-72f7-431f-9565-977b31e39db9-console-oauth-config\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:44.412977 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.412781    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66ts5\" (UniqueName: \"kubernetes.io/projected/30b4072d-72f7-431f-9565-977b31e39db9-kube-api-access-66ts5\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:44.893954 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.893928    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff9bb6677-4rcrv_30b4072d-72f7-431f-9565-977b31e39db9/console/0.log"
May 21 19:25:44.894144 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.893964    2561 generic.go:358] "Generic (PLEG): container finished" podID="30b4072d-72f7-431f-9565-977b31e39db9" containerID="6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44" exitCode=2
May 21 19:25:44.894144 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.893997    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff9bb6677-4rcrv" event={"ID":"30b4072d-72f7-431f-9565-977b31e39db9","Type":"ContainerDied","Data":"6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44"}
May 21 19:25:44.894144 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.894025    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff9bb6677-4rcrv"
May 21 19:25:44.894144 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.894042    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff9bb6677-4rcrv" event={"ID":"30b4072d-72f7-431f-9565-977b31e39db9","Type":"ContainerDied","Data":"4b99fcba00b47ad60df2a7beb5be10945301b21303f3d07a6becd43aee8faff5"}
May 21 19:25:44.894144 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.894064    2561 scope.go:117] "RemoveContainer" containerID="6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44"
May 21 19:25:44.902966 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.902951    2561 scope.go:117] "RemoveContainer" containerID="6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44"
May 21 19:25:44.903214 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:25:44.903171    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44\": container with ID starting with 6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44 not found: ID does not exist" containerID="6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44"
May 21 19:25:44.903313 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.903221    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44"} err="failed to get container status \"6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44\": rpc error: code = NotFound desc = could not find container \"6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44\": container with ID starting with 6999a6ab715058fd4b1e60bb3e84f2c7ee30b47262bd5903e3995d5a0b62dd44 not found: ID does not exist"
May 21 19:25:44.914974 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.914942    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff9bb6677-4rcrv"]
May 21 19:25:44.922203 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:44.922167    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ff9bb6677-4rcrv"]
May 21 19:25:46.116574 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:46.116543    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b4072d-72f7-431f-9565-977b31e39db9" path="/var/lib/kubelet/pods/30b4072d-72f7-431f-9565-977b31e39db9/volumes"
May 21 19:25:49.830032 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:49.830007    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fdkxx_94e87198-ccf9-4a1b-a75f-07438394dd10/dns-node-resolver/0.log"
May 21 19:25:58.299276 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.299234    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f6bd744cb-2g6k2" podUID="6052247e-9001-4028-a6b1-13d941369c33" containerName="console" containerID="cri-o://4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec" gracePeriod=15
May 21 19:25:58.585970 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.585950    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f6bd744cb-2g6k2_6052247e-9001-4028-a6b1-13d941369c33/console/0.log"
May 21 19:25:58.586091 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.586010    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:58.732131 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.732094    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cvtr\" (UniqueName: \"kubernetes.io/projected/6052247e-9001-4028-a6b1-13d941369c33-kube-api-access-5cvtr\") pod \"6052247e-9001-4028-a6b1-13d941369c33\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") "
May 21 19:25:58.732324 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.732209    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-oauth-config\") pod \"6052247e-9001-4028-a6b1-13d941369c33\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") "
May 21 19:25:58.732324 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.732237    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-service-ca\") pod \"6052247e-9001-4028-a6b1-13d941369c33\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") "
May 21 19:25:58.732324 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.732256    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-trusted-ca-bundle\") pod \"6052247e-9001-4028-a6b1-13d941369c33\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") "
May 21 19:25:58.732324 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.732297    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-oauth-serving-cert\") pod \"6052247e-9001-4028-a6b1-13d941369c33\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") "
May 21 19:25:58.732549 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.732491    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-console-config\") pod \"6052247e-9001-4028-a6b1-13d941369c33\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") "
May 21 19:25:58.732549 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.732526    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-serving-cert\") pod \"6052247e-9001-4028-a6b1-13d941369c33\" (UID: \"6052247e-9001-4028-a6b1-13d941369c33\") "
May 21 19:25:58.732866 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.732835    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-console-config" (OuterVolumeSpecName: "console-config") pod "6052247e-9001-4028-a6b1-13d941369c33" (UID: "6052247e-9001-4028-a6b1-13d941369c33"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 19:25:58.732995 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.732860    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-service-ca" (OuterVolumeSpecName: "service-ca") pod "6052247e-9001-4028-a6b1-13d941369c33" (UID: "6052247e-9001-4028-a6b1-13d941369c33"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 19:25:58.733163 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.733128    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6052247e-9001-4028-a6b1-13d941369c33" (UID: "6052247e-9001-4028-a6b1-13d941369c33"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 19:25:58.733458 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.733436    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6052247e-9001-4028-a6b1-13d941369c33" (UID: "6052247e-9001-4028-a6b1-13d941369c33"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 19:25:58.734513 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.734473    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6052247e-9001-4028-a6b1-13d941369c33-kube-api-access-5cvtr" (OuterVolumeSpecName: "kube-api-access-5cvtr") pod "6052247e-9001-4028-a6b1-13d941369c33" (UID: "6052247e-9001-4028-a6b1-13d941369c33"). InnerVolumeSpecName "kube-api-access-5cvtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 19:25:58.734710 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.734689    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6052247e-9001-4028-a6b1-13d941369c33" (UID: "6052247e-9001-4028-a6b1-13d941369c33"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 19:25:58.734897 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.734873    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6052247e-9001-4028-a6b1-13d941369c33" (UID: "6052247e-9001-4028-a6b1-13d941369c33"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 19:25:58.833874 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.833780    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cvtr\" (UniqueName: \"kubernetes.io/projected/6052247e-9001-4028-a6b1-13d941369c33-kube-api-access-5cvtr\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:58.833874 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.833811    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-oauth-config\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:58.833874 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.833821    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-service-ca\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:58.833874 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.833849    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-trusted-ca-bundle\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:58.833874 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.833859    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-oauth-serving-cert\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:58.833874 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.833869    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6052247e-9001-4028-a6b1-13d941369c33-console-config\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:58.833874 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.833877    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6052247e-9001-4028-a6b1-13d941369c33-console-serving-cert\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:25:58.934000 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.933972    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f6bd744cb-2g6k2_6052247e-9001-4028-a6b1-13d941369c33/console/0.log"
May 21 19:25:58.934152 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.934011    2561 generic.go:358] "Generic (PLEG): container finished" podID="6052247e-9001-4028-a6b1-13d941369c33" containerID="4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec" exitCode=2
May 21 19:25:58.934152 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.934110    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6bd744cb-2g6k2" event={"ID":"6052247e-9001-4028-a6b1-13d941369c33","Type":"ContainerDied","Data":"4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec"}
May 21 19:25:58.934152 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.934125    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6bd744cb-2g6k2"
May 21 19:25:58.934152 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.934143    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6bd744cb-2g6k2" event={"ID":"6052247e-9001-4028-a6b1-13d941369c33","Type":"ContainerDied","Data":"077592b6cd9ca285d89b52c71a621f688c1745a89293dd529b56dd7e0d866f64"}
May 21 19:25:58.934318 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.934161    2561 scope.go:117] "RemoveContainer" containerID="4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec"
May 21 19:25:58.942835 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.942804    2561 scope.go:117] "RemoveContainer" containerID="4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec"
May 21 19:25:58.943105 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:25:58.943083    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec\": container with ID starting with 4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec not found: ID does not exist" containerID="4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec"
May 21 19:25:58.943224 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.943112    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec"} err="failed to get container status \"4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec\": rpc error: code = NotFound desc = could not find container \"4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec\": container with ID starting with 4842629bcb84c1ba942c1237b255afbf434b3c7a208886b4936db0e9c477feec not found: ID does not exist"
May 21 19:25:58.965203 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.965153    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6bd744cb-2g6k2"]
May 21 19:25:58.981281 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:25:58.981251    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f6bd744cb-2g6k2"]
May 21 19:26:00.114422 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:00.114393    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6052247e-9001-4028-a6b1-13d941369c33" path="/var/lib/kubelet/pods/6052247e-9001-4028-a6b1-13d941369c33/volumes"
May 21 19:26:03.190322 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:03.190295    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:26:03.194138 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:03.194117    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d9bbbbf5d-56htx"
May 21 19:26:06.896575 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:06.896496    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:26:06.898943 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:06.898924    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d90a5c-0097-4291-963e-4e74460ff759-metrics-certs\") pod \"network-metrics-daemon-x8nv7\" (UID: \"e3d90a5c-0097-4291-963e-4e74460ff759\") " pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:26:06.912639 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:06.912620    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmtz4\""
May 21 19:26:06.919983 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:06.919964    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8nv7"
May 21 19:26:07.045040 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:07.045017    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x8nv7"]
May 21 19:26:07.046896 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:26:07.046862    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d90a5c_0097_4291_963e_4e74460ff759.slice/crio-3d5287f892138ca4261033216124418f0ec2eea2d25ea5f0e8ba3ab3f03d35af WatchSource:0}: Error finding container 3d5287f892138ca4261033216124418f0ec2eea2d25ea5f0e8ba3ab3f03d35af: Status 404 returned error can't find the container with id 3d5287f892138ca4261033216124418f0ec2eea2d25ea5f0e8ba3ab3f03d35af
May 21 19:26:07.961484 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:07.961443    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x8nv7" event={"ID":"e3d90a5c-0097-4291-963e-4e74460ff759","Type":"ContainerStarted","Data":"3d5287f892138ca4261033216124418f0ec2eea2d25ea5f0e8ba3ab3f03d35af"}
May 21 19:26:08.965461 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:08.965426    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x8nv7" event={"ID":"e3d90a5c-0097-4291-963e-4e74460ff759","Type":"ContainerStarted","Data":"d34f7677674fd267343a8dcb5435aeadccc4d98870c7574b80bbf3787a97d80e"}
May 21 19:26:08.965461 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:08.965458    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x8nv7" event={"ID":"e3d90a5c-0097-4291-963e-4e74460ff759","Type":"ContainerStarted","Data":"ea989a54d4b1ea92001e495c83db04f0fed7885f9a0ed5c1d82992d3c72b27c9"}
May 21 19:26:08.985461 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:08.985414    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x8nv7" podStartSLOduration=252.033176689 podStartE2EDuration="4m12.98539796s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:26:07.048645505 +0000 UTC m=+251.556050672" lastFinishedPulling="2026-05-21 19:26:08.000866757 +0000 UTC m=+252.508271943" observedRunningTime="2026-05-21 19:26:08.983077466 +0000 UTC m=+253.490482655" watchObservedRunningTime="2026-05-21 19:26:08.98539796 +0000 UTC m=+253.492803150"
May 21 19:26:24.836275 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:24.836244    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:26:24.857252 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:24.857228    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:26:25.022789 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:25.022759    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 19:26:35.614756 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:26:35.614713    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-64qpw" podUID="520cea0e-088e-460b-930c-012ed5487f7f"
May 21 19:26:35.614756 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:26:35.614728    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fn4fh" podUID="192cef57-4be2-4056-9a51-a31a91246de7"
May 21 19:26:36.036830 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:36.036746    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:26:36.036830 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:36.036814    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64qpw"
May 21 19:26:39.451442 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.451406    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:26:39.451442 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.451448    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:26:39.453886 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.453858    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/520cea0e-088e-460b-930c-012ed5487f7f-metrics-tls\") pod \"dns-default-64qpw\" (UID: \"520cea0e-088e-460b-930c-012ed5487f7f\") " pod="openshift-dns/dns-default-64qpw"
May 21 19:26:39.454021 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.453983    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/192cef57-4be2-4056-9a51-a31a91246de7-cert\") pod \"ingress-canary-fn4fh\" (UID: \"192cef57-4be2-4056-9a51-a31a91246de7\") " pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:26:39.639889 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.639859    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bcrm5\""
May 21 19:26:39.641067 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.641049    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gdlf\""
May 21 19:26:39.647366 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.647345    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fn4fh"
May 21 19:26:39.647433 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.647367    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64qpw"
May 21 19:26:39.788650 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.788613    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fn4fh"]
May 21 19:26:39.791937 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:26:39.791910    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192cef57_4be2_4056_9a51_a31a91246de7.slice/crio-1304a0f33c7d89eb43ed6de33dce8aa44f660ac95d41ff5cb4a41049b8054b24 WatchSource:0}: Error finding container 1304a0f33c7d89eb43ed6de33dce8aa44f660ac95d41ff5cb4a41049b8054b24: Status 404 returned error can't find the container with id 1304a0f33c7d89eb43ed6de33dce8aa44f660ac95d41ff5cb4a41049b8054b24
May 21 19:26:39.812855 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:39.812837    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64qpw"]
May 21 19:26:39.814730 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:26:39.814708    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520cea0e_088e_460b_930c_012ed5487f7f.slice/crio-66177e9dced607a84ab2718253885f128735bbe1fc0e30d385c6498bb9295379 WatchSource:0}: Error finding container 66177e9dced607a84ab2718253885f128735bbe1fc0e30d385c6498bb9295379: Status 404 returned error can't find the container with id 66177e9dced607a84ab2718253885f128735bbe1fc0e30d385c6498bb9295379
May 21 19:26:40.048889 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:40.048799    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64qpw" event={"ID":"520cea0e-088e-460b-930c-012ed5487f7f","Type":"ContainerStarted","Data":"66177e9dced607a84ab2718253885f128735bbe1fc0e30d385c6498bb9295379"}
May 21 19:26:40.052292 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:40.052264    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fn4fh" event={"ID":"192cef57-4be2-4056-9a51-a31a91246de7","Type":"ContainerStarted","Data":"1304a0f33c7d89eb43ed6de33dce8aa44f660ac95d41ff5cb4a41049b8054b24"}
May 21 19:26:42.060750 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:42.060709    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64qpw" event={"ID":"520cea0e-088e-460b-930c-012ed5487f7f","Type":"ContainerStarted","Data":"90874b2fc668f7aafe621427108cafc27d277dda1b9fa784288c8ca174685ba4"}
May 21 19:26:42.060750 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:42.060754    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64qpw" event={"ID":"520cea0e-088e-460b-930c-012ed5487f7f","Type":"ContainerStarted","Data":"4dcc4efbb0839e2eb4af9635cadc00cd045926144b2ea8e8bd1f1d0eae0edef2"}
May 21 19:26:42.061264 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:42.060792    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-64qpw"
May 21 19:26:42.062082 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:42.062051    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fn4fh" event={"ID":"192cef57-4be2-4056-9a51-a31a91246de7","Type":"ContainerStarted","Data":"d8f0c37d18c2b5e48ebbcbda3f768da8d72ca980de153b7f602fc0bd2df6b023"}
May 21 19:26:42.081951 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:42.081872    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-64qpw" podStartSLOduration=251.077101753 podStartE2EDuration="4m13.081861036s" podCreationTimestamp="2026-05-21 19:22:29 +0000 UTC" firstStartedPulling="2026-05-21 19:26:39.816376711 +0000 UTC m=+284.323781876" lastFinishedPulling="2026-05-21 19:26:41.821135993 +0000 UTC m=+286.328541159" observedRunningTime="2026-05-21 19:26:42.080494822 +0000 UTC m=+286.587900012" watchObservedRunningTime="2026-05-21 19:26:42.081861036 +0000 UTC m=+286.589266224"
May 21 19:26:42.101173 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:42.101125    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fn4fh" podStartSLOduration=251.074937949 podStartE2EDuration="4m13.101109234s" podCreationTimestamp="2026-05-21 19:22:29 +0000 UTC" firstStartedPulling="2026-05-21 19:26:39.793905264 +0000 UTC m=+284.301310430" lastFinishedPulling="2026-05-21 19:26:41.820076549 +0000 UTC m=+286.327481715" observedRunningTime="2026-05-21 19:26:42.100543202 +0000 UTC m=+286.607948384" watchObservedRunningTime="2026-05-21 19:26:42.101109234 +0000 UTC m=+286.608514422"
May 21 19:26:52.067483 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:52.067448    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-64qpw"
May 21 19:26:56.019864 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:56.019839    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:26:56.020471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:56.020447    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:26:56.022447 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:26:56.022429    2561 kubelet.go:1628] "Image garbage collection succeeded"
May 21 19:28:29.156957 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.156918    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-k8frw"]
May 21 19:28:29.157427 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.157220    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b4072d-72f7-431f-9565-977b31e39db9" containerName="console"
May 21 19:28:29.157427 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.157231    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b4072d-72f7-431f-9565-977b31e39db9" containerName="console"
May 21 19:28:29.157427 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.157250    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6052247e-9001-4028-a6b1-13d941369c33" containerName="console"
May 21 19:28:29.157427 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.157256    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6052247e-9001-4028-a6b1-13d941369c33" containerName="console"
May 21 19:28:29.157427 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.157305    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="6052247e-9001-4028-a6b1-13d941369c33" containerName="console"
May 21 19:28:29.157427 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.157318    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="30b4072d-72f7-431f-9565-977b31e39db9" containerName="console"
May 21 19:28:29.160218 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.160201    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:29.163475 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.163453    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 19:28:29.163606 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.163503    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mh2rg\""
May 21 19:28:29.164695 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.164679    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 19:28:29.194007 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.193979    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-k8frw"]
May 21 19:28:29.275966 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.275942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md4qm\" (UniqueName: \"kubernetes.io/projected/04356c71-f2ec-49a3-8d4a-d272f36458fb-kube-api-access-md4qm\") pod \"cert-manager-webhook-587ccfb98-k8frw\" (UID: \"04356c71-f2ec-49a3-8d4a-d272f36458fb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:29.276103 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.275993    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04356c71-f2ec-49a3-8d4a-d272f36458fb-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-k8frw\" (UID: \"04356c71-f2ec-49a3-8d4a-d272f36458fb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:29.377098 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.377065    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-md4qm\" (UniqueName: \"kubernetes.io/projected/04356c71-f2ec-49a3-8d4a-d272f36458fb-kube-api-access-md4qm\") pod \"cert-manager-webhook-587ccfb98-k8frw\" (UID: \"04356c71-f2ec-49a3-8d4a-d272f36458fb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:29.377283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.377119    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04356c71-f2ec-49a3-8d4a-d272f36458fb-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-k8frw\" (UID: \"04356c71-f2ec-49a3-8d4a-d272f36458fb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:29.388694 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.388665    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md4qm\" (UniqueName: \"kubernetes.io/projected/04356c71-f2ec-49a3-8d4a-d272f36458fb-kube-api-access-md4qm\") pod \"cert-manager-webhook-587ccfb98-k8frw\" (UID: \"04356c71-f2ec-49a3-8d4a-d272f36458fb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:29.391096 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.391073    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04356c71-f2ec-49a3-8d4a-d272f36458fb-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-k8frw\" (UID: \"04356c71-f2ec-49a3-8d4a-d272f36458fb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:29.483697 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.483609    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:29.619661 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.619630    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-k8frw"]
May 21 19:28:29.622813 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:28:29.622789    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04356c71_f2ec_49a3_8d4a_d272f36458fb.slice/crio-a64c016e3a84bc805978a3a53000c22b5be898f66f91365cf6a11bfd6d8834da WatchSource:0}: Error finding container a64c016e3a84bc805978a3a53000c22b5be898f66f91365cf6a11bfd6d8834da: Status 404 returned error can't find the container with id a64c016e3a84bc805978a3a53000c22b5be898f66f91365cf6a11bfd6d8834da
May 21 19:28:29.624855 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:29.624838    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 19:28:30.362300 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:30.362268    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw" event={"ID":"04356c71-f2ec-49a3-8d4a-d272f36458fb","Type":"ContainerStarted","Data":"a64c016e3a84bc805978a3a53000c22b5be898f66f91365cf6a11bfd6d8834da"}
May 21 19:28:34.375883 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:34.375853    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw" event={"ID":"04356c71-f2ec-49a3-8d4a-d272f36458fb","Type":"ContainerStarted","Data":"8b4d504f318c7b8bf4d4ea019c9a5c6e116976c3572789d8cbfc77400c7e556f"}
May 21 19:28:34.376280 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:34.376097    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:34.394063 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:34.394022    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw" podStartSLOduration=1.206340394 podStartE2EDuration="5.394009088s" podCreationTimestamp="2026-05-21 19:28:29 +0000 UTC" firstStartedPulling="2026-05-21 19:28:29.625013812 +0000 UTC m=+394.132418978" lastFinishedPulling="2026-05-21 19:28:33.812682496 +0000 UTC m=+398.320087672" observedRunningTime="2026-05-21 19:28:34.392673312 +0000 UTC m=+398.900078500" watchObservedRunningTime="2026-05-21 19:28:34.394009088 +0000 UTC m=+398.901414275"
May 21 19:28:40.044196 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.044145    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-8qqj8"]
May 21 19:28:40.047427 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.047410    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-8qqj8"
May 21 19:28:40.050670 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.050652    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fq8h8\""
May 21 19:28:40.061155 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.061133    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-8qqj8"]
May 21 19:28:40.169071 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.169048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqtzt\" (UniqueName: \"kubernetes.io/projected/86ee8ceb-580c-4817-be36-e3d0d332a8e1-kube-api-access-jqtzt\") pod \"cert-manager-79c8d999ff-8qqj8\" (UID: \"86ee8ceb-580c-4817-be36-e3d0d332a8e1\") " pod="cert-manager/cert-manager-79c8d999ff-8qqj8"
May 21 19:28:40.169226 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.169094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86ee8ceb-580c-4817-be36-e3d0d332a8e1-bound-sa-token\") pod \"cert-manager-79c8d999ff-8qqj8\" (UID: \"86ee8ceb-580c-4817-be36-e3d0d332a8e1\") " pod="cert-manager/cert-manager-79c8d999ff-8qqj8"
May 21 19:28:40.270420 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.270392    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86ee8ceb-580c-4817-be36-e3d0d332a8e1-bound-sa-token\") pod \"cert-manager-79c8d999ff-8qqj8\" (UID: \"86ee8ceb-580c-4817-be36-e3d0d332a8e1\") " pod="cert-manager/cert-manager-79c8d999ff-8qqj8"
May 21 19:28:40.270565 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.270449    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqtzt\" (UniqueName: \"kubernetes.io/projected/86ee8ceb-580c-4817-be36-e3d0d332a8e1-kube-api-access-jqtzt\") pod \"cert-manager-79c8d999ff-8qqj8\" (UID: \"86ee8ceb-580c-4817-be36-e3d0d332a8e1\") " pod="cert-manager/cert-manager-79c8d999ff-8qqj8"
May 21 19:28:40.286697 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.286671    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqtzt\" (UniqueName: \"kubernetes.io/projected/86ee8ceb-580c-4817-be36-e3d0d332a8e1-kube-api-access-jqtzt\") pod \"cert-manager-79c8d999ff-8qqj8\" (UID: \"86ee8ceb-580c-4817-be36-e3d0d332a8e1\") " pod="cert-manager/cert-manager-79c8d999ff-8qqj8"
May 21 19:28:40.287675 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.287656    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86ee8ceb-580c-4817-be36-e3d0d332a8e1-bound-sa-token\") pod \"cert-manager-79c8d999ff-8qqj8\" (UID: \"86ee8ceb-580c-4817-be36-e3d0d332a8e1\") " pod="cert-manager/cert-manager-79c8d999ff-8qqj8"
May 21 19:28:40.356668 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.356647    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-8qqj8"
May 21 19:28:40.381405 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.381383    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-k8frw"
May 21 19:28:40.491495 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:40.491469    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-8qqj8"]
May 21 19:28:40.494117 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:28:40.494086    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86ee8ceb_580c_4817_be36_e3d0d332a8e1.slice/crio-552afb7ecb00e51d75139f0fde5c2e9df1447d50d1ed10f94722f317334862e2 WatchSource:0}: Error finding container 552afb7ecb00e51d75139f0fde5c2e9df1447d50d1ed10f94722f317334862e2: Status 404 returned error can't find the container with id 552afb7ecb00e51d75139f0fde5c2e9df1447d50d1ed10f94722f317334862e2
May 21 19:28:41.399068 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:41.399037    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-8qqj8" event={"ID":"86ee8ceb-580c-4817-be36-e3d0d332a8e1","Type":"ContainerStarted","Data":"9fc87e307abe607e7c051719b9da371fb446ef22543614aecb0598021f02787a"}
May 21 19:28:41.399068 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:41.399072    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-8qqj8" event={"ID":"86ee8ceb-580c-4817-be36-e3d0d332a8e1","Type":"ContainerStarted","Data":"552afb7ecb00e51d75139f0fde5c2e9df1447d50d1ed10f94722f317334862e2"}
May 21 19:28:41.439752 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:28:41.439714    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-8qqj8" podStartSLOduration=1.439700426 podStartE2EDuration="1.439700426s" podCreationTimestamp="2026-05-21 19:28:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:28:41.438659898 +0000 UTC m=+405.946065086" watchObservedRunningTime="2026-05-21 19:28:41.439700426 +0000 UTC m=+405.947105613"
May 21 19:29:01.321830 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.321793    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"]
May 21 19:29:01.328759 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.328738    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.347402 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.347384    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 19:29:01.347499 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.347405    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 19:29:01.347697 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.347683    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 19:29:01.347791 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.347690    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 19:29:01.348232 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.348217    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n85j7\""
May 21 19:29:01.356404 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.356383    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"]
May 21 19:29:01.435569 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.435540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4494c501-92dd-4d7e-959c-c82fc3a36d8c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-vwtqb\" (UID: \"4494c501-92dd-4d7e-959c-c82fc3a36d8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.435715 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.435587    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4494c501-92dd-4d7e-959c-c82fc3a36d8c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-vwtqb\" (UID: \"4494c501-92dd-4d7e-959c-c82fc3a36d8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.435715 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.435691    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvwpn\" (UniqueName: \"kubernetes.io/projected/4494c501-92dd-4d7e-959c-c82fc3a36d8c-kube-api-access-rvwpn\") pod \"opendatahub-operator-controller-manager-5b454b5c58-vwtqb\" (UID: \"4494c501-92dd-4d7e-959c-c82fc3a36d8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.536442 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.536415    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvwpn\" (UniqueName: \"kubernetes.io/projected/4494c501-92dd-4d7e-959c-c82fc3a36d8c-kube-api-access-rvwpn\") pod \"opendatahub-operator-controller-manager-5b454b5c58-vwtqb\" (UID: \"4494c501-92dd-4d7e-959c-c82fc3a36d8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.536577 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.536449    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4494c501-92dd-4d7e-959c-c82fc3a36d8c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-vwtqb\" (UID: \"4494c501-92dd-4d7e-959c-c82fc3a36d8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.536577 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.536480    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4494c501-92dd-4d7e-959c-c82fc3a36d8c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-vwtqb\" (UID: \"4494c501-92dd-4d7e-959c-c82fc3a36d8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.539086 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.539057    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4494c501-92dd-4d7e-959c-c82fc3a36d8c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-vwtqb\" (UID: \"4494c501-92dd-4d7e-959c-c82fc3a36d8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.539204 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.539120    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4494c501-92dd-4d7e-959c-c82fc3a36d8c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-vwtqb\" (UID: \"4494c501-92dd-4d7e-959c-c82fc3a36d8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.563923 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.563897    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvwpn\" (UniqueName: \"kubernetes.io/projected/4494c501-92dd-4d7e-959c-c82fc3a36d8c-kube-api-access-rvwpn\") pod \"opendatahub-operator-controller-manager-5b454b5c58-vwtqb\" (UID: \"4494c501-92dd-4d7e-959c-c82fc3a36d8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.638378 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.638321    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:01.778877 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:01.778851    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"]
May 21 19:29:01.781125 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:29:01.781097    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4494c501_92dd_4d7e_959c_c82fc3a36d8c.slice/crio-52ee9286f59764879a911eea3f5e3d418cf50d1ea98a2ecdcdd755ede19b472f WatchSource:0}: Error finding container 52ee9286f59764879a911eea3f5e3d418cf50d1ea98a2ecdcdd755ede19b472f: Status 404 returned error can't find the container with id 52ee9286f59764879a911eea3f5e3d418cf50d1ea98a2ecdcdd755ede19b472f
May 21 19:29:02.460547 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:02.460491    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb" event={"ID":"4494c501-92dd-4d7e-959c-c82fc3a36d8c","Type":"ContainerStarted","Data":"52ee9286f59764879a911eea3f5e3d418cf50d1ea98a2ecdcdd755ede19b472f"}
May 21 19:29:04.469140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:04.469106    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb" event={"ID":"4494c501-92dd-4d7e-959c-c82fc3a36d8c","Type":"ContainerStarted","Data":"b272bb3190c3f7c4fe9f6a258026235bd0d03bd826adda4328605548f7f5bea2"}
May 21 19:29:04.469514 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:04.469255    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:15.283237 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.283134    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb" podStartSLOduration=11.710858549 podStartE2EDuration="14.283120606s" podCreationTimestamp="2026-05-21 19:29:01 +0000 UTC" firstStartedPulling="2026-05-21 19:29:01.782783128 +0000 UTC m=+426.290188295" lastFinishedPulling="2026-05-21 19:29:04.355045186 +0000 UTC m=+428.862450352" observedRunningTime="2026-05-21 19:29:04.500169988 +0000 UTC m=+429.007575177" watchObservedRunningTime="2026-05-21 19:29:15.283120606 +0000 UTC m=+439.790525793"
May 21 19:29:15.284549 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.284532    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"]
May 21 19:29:15.287817 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.287799    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.292429 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.292409    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 19:29:15.292429 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.292419    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 19:29:15.292610 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.292440    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 19:29:15.293627 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.293541    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 19:29:15.293738 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.293687    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 19:29:15.293738 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.293687    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wpt96\""
May 21 19:29:15.303692 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.303672    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"]
May 21 19:29:15.348501 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.348476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fb4848f-d36e-49da-b93d-70e976d8cb22-metrics-cert\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.348619 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.348507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qvvq\" (UniqueName: \"kubernetes.io/projected/4fb4848f-d36e-49da-b93d-70e976d8cb22-kube-api-access-5qvvq\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.348619 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.348561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb4848f-d36e-49da-b93d-70e976d8cb22-cert\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.348619 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.348586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4fb4848f-d36e-49da-b93d-70e976d8cb22-manager-config\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.449657 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.449625    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb4848f-d36e-49da-b93d-70e976d8cb22-cert\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.449815 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.449673    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4fb4848f-d36e-49da-b93d-70e976d8cb22-manager-config\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.449815 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.449731    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fb4848f-d36e-49da-b93d-70e976d8cb22-metrics-cert\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.449815 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.449755    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qvvq\" (UniqueName: \"kubernetes.io/projected/4fb4848f-d36e-49da-b93d-70e976d8cb22-kube-api-access-5qvvq\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.450420 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.450361    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4fb4848f-d36e-49da-b93d-70e976d8cb22-manager-config\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.452422 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.452397    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb4848f-d36e-49da-b93d-70e976d8cb22-cert\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.452498 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.452401    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fb4848f-d36e-49da-b93d-70e976d8cb22-metrics-cert\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.458860 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.458836    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qvvq\" (UniqueName: \"kubernetes.io/projected/4fb4848f-d36e-49da-b93d-70e976d8cb22-kube-api-access-5qvvq\") pod \"lws-controller-manager-88b567ddf-5bqj2\" (UID: \"4fb4848f-d36e-49da-b93d-70e976d8cb22\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.474323 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.474306    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-vwtqb"
May 21 19:29:15.597111 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.597085    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:15.736603 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:15.736578    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"]
May 21 19:29:15.739003 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:29:15.738976    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb4848f_d36e_49da_b93d_70e976d8cb22.slice/crio-39ba55bcc52ad779745c9fb61458b3a58a2ddab696d00105280c40c0f95d259b WatchSource:0}: Error finding container 39ba55bcc52ad779745c9fb61458b3a58a2ddab696d00105280c40c0f95d259b: Status 404 returned error can't find the container with id 39ba55bcc52ad779745c9fb61458b3a58a2ddab696d00105280c40c0f95d259b
May 21 19:29:16.506653 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:16.506620    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2" event={"ID":"4fb4848f-d36e-49da-b93d-70e976d8cb22","Type":"ContainerStarted","Data":"39ba55bcc52ad779745c9fb61458b3a58a2ddab696d00105280c40c0f95d259b"}
May 21 19:29:19.517560 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:19.517523    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2" event={"ID":"4fb4848f-d36e-49da-b93d-70e976d8cb22","Type":"ContainerStarted","Data":"fe8e0d3c83463ac6bffb15cd398bbf2417ee06b571150bac486c1b3463e6efe4"}
May 21 19:29:19.517914 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:19.517576    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:19.556196 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:19.556132    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2" podStartSLOduration=1.8240125470000002 podStartE2EDuration="4.556114767s" podCreationTimestamp="2026-05-21 19:29:15 +0000 UTC" firstStartedPulling="2026-05-21 19:29:15.740759569 +0000 UTC m=+440.248164738" lastFinishedPulling="2026-05-21 19:29:18.472861789 +0000 UTC m=+442.980266958" observedRunningTime="2026-05-21 19:29:19.553667206 +0000 UTC m=+444.061072405" watchObservedRunningTime="2026-05-21 19:29:19.556114767 +0000 UTC m=+444.063519957"
May 21 19:29:30.523234 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:30.523198    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-5bqj2"
May 21 19:29:56.994445 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:56.994400    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"]
May 21 19:29:57.001437 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.001418    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.004041 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.004016    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 19:29:57.004564 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.004540    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 19:29:57.004713 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.004551    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 19:29:57.004713 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.004638    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hrfj9\""
May 21 19:29:57.014972 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.014941    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"]
May 21 19:29:57.086197 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.086144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.086340 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.086219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjbtk\" (UniqueName: \"kubernetes.io/projected/31eec800-d04a-4f7f-89a5-e4ea0422226f-kube-api-access-pjbtk\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.086340 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.086243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.086340 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.086282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.086441 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.086349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31eec800-d04a-4f7f-89a5-e4ea0422226f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.086441 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.086384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.086441 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.086410    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.086530 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.086439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.086530 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.086482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.187563 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.187531    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.187736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.187577    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjbtk\" (UniqueName: \"kubernetes.io/projected/31eec800-d04a-4f7f-89a5-e4ea0422226f-kube-api-access-pjbtk\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.187736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.187595    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.187736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.187623    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.187736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.187650    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31eec800-d04a-4f7f-89a5-e4ea0422226f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.187736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.187667    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.187736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.187690    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.187736 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.187715    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.188367 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.187741    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.188367 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.188055    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.188367 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.188060    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.188367 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.188294    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.188367 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.188306    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.188576 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.188470    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31eec800-d04a-4f7f-89a5-e4ea0422226f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.190293 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.190267    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.190416 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.190398    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.199681 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.199660    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjbtk\" (UniqueName: \"kubernetes.io/projected/31eec800-d04a-4f7f-89a5-e4ea0422226f-kube-api-access-pjbtk\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.201286 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.201269    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31eec800-d04a-4f7f-89a5-e4ea0422226f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b924fs\" (UID: \"31eec800-d04a-4f7f-89a5-e4ea0422226f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.317740 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.317714    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:29:57.454425 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.454400    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"]
May 21 19:29:57.455672 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:29:57.455642    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31eec800_d04a_4f7f_89a5_e4ea0422226f.slice/crio-37599a247a2f2d3067c6a7cd9e64d741fac51f62f2fd80d442b9d59416183f2c WatchSource:0}: Error finding container 37599a247a2f2d3067c6a7cd9e64d741fac51f62f2fd80d442b9d59416183f2c: Status 404 returned error can't find the container with id 37599a247a2f2d3067c6a7cd9e64d741fac51f62f2fd80d442b9d59416183f2c
May 21 19:29:57.645284 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:29:57.645198    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs" event={"ID":"31eec800-d04a-4f7f-89a5-e4ea0422226f","Type":"ContainerStarted","Data":"37599a247a2f2d3067c6a7cd9e64d741fac51f62f2fd80d442b9d59416183f2c"}
May 21 19:30:00.120478 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:00.120442    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
May 21 19:30:00.120742 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:00.120515    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
May 21 19:30:00.120742 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:00.120543    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
May 21 19:30:00.658601 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:00.658564    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs" event={"ID":"31eec800-d04a-4f7f-89a5-e4ea0422226f","Type":"ContainerStarted","Data":"1794c7a4c8d67c98cd59884deeb69d6df2d8455e2cf0a5e360eda61e47db7828"}
May 21 19:30:00.684439 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:00.684390    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs" podStartSLOduration=2.021652137 podStartE2EDuration="4.684374663s" podCreationTimestamp="2026-05-21 19:29:56 +0000 UTC" firstStartedPulling="2026-05-21 19:29:57.457499641 +0000 UTC m=+481.964904807" lastFinishedPulling="2026-05-21 19:30:00.120222166 +0000 UTC m=+484.627627333" observedRunningTime="2026-05-21 19:30:00.682156497 +0000 UTC m=+485.189561684" watchObservedRunningTime="2026-05-21 19:30:00.684374663 +0000 UTC m=+485.191779851"
May 21 19:30:01.318107 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:01.318078    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:30:01.322525 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:01.322503    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:30:01.662161 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:01.662083    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:30:01.663095 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:01.663078    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b924fs"
May 21 19:30:19.972834 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:19.972796    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j5m2v"]
May 21 19:30:19.978995 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:19.978973    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v"
May 21 19:30:19.983291 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:19.983269    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d5nln\""
May 21 19:30:19.984054 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:19.984031    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 19:30:19.984169 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:19.984067    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 19:30:19.993718 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:19.993698    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j5m2v"]
May 21 19:30:20.082369 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.082330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szwg6\" (UniqueName: \"kubernetes.io/projected/83b042bd-dcd0-44cf-9d9b-18ccc77709ed-kube-api-access-szwg6\") pod \"kuadrant-operator-catalog-j5m2v\" (UID: \"83b042bd-dcd0-44cf-9d9b-18ccc77709ed\") " pod="kuadrant-system/kuadrant-operator-catalog-j5m2v"
May 21 19:30:20.183155 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.183122    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szwg6\" (UniqueName: \"kubernetes.io/projected/83b042bd-dcd0-44cf-9d9b-18ccc77709ed-kube-api-access-szwg6\") pod \"kuadrant-operator-catalog-j5m2v\" (UID: \"83b042bd-dcd0-44cf-9d9b-18ccc77709ed\") " pod="kuadrant-system/kuadrant-operator-catalog-j5m2v"
May 21 19:30:20.192350 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.192325    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szwg6\" (UniqueName: \"kubernetes.io/projected/83b042bd-dcd0-44cf-9d9b-18ccc77709ed-kube-api-access-szwg6\") pod \"kuadrant-operator-catalog-j5m2v\" (UID: \"83b042bd-dcd0-44cf-9d9b-18ccc77709ed\") " pod="kuadrant-system/kuadrant-operator-catalog-j5m2v"
May 21 19:30:20.288341 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.288263    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v"
May 21 19:30:20.294433 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.294407    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j5m2v"]
May 21 19:30:20.419429 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.419399    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j5m2v"]
May 21 19:30:20.424001 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:30:20.423974    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b042bd_dcd0_44cf_9d9b_18ccc77709ed.slice/crio-c9e2db9d40cf6bdd8b1efc9d90b81d608baed7c0be9baf813c2dd4f363296f84 WatchSource:0}: Error finding container c9e2db9d40cf6bdd8b1efc9d90b81d608baed7c0be9baf813c2dd4f363296f84: Status 404 returned error can't find the container with id c9e2db9d40cf6bdd8b1efc9d90b81d608baed7c0be9baf813c2dd4f363296f84
May 21 19:30:20.509594 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.509565    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n5lbq"]
May 21 19:30:20.514659 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.514644    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n5lbq"
May 21 19:30:20.521550 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.521513    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n5lbq"]
May 21 19:30:20.586734 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.586711    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdjpb\" (UniqueName: \"kubernetes.io/projected/7c5085f6-ef39-4ecd-a453-bb966fe6922c-kube-api-access-rdjpb\") pod \"kuadrant-operator-catalog-n5lbq\" (UID: \"7c5085f6-ef39-4ecd-a453-bb966fe6922c\") " pod="kuadrant-system/kuadrant-operator-catalog-n5lbq"
May 21 19:30:20.687554 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.687528    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdjpb\" (UniqueName: \"kubernetes.io/projected/7c5085f6-ef39-4ecd-a453-bb966fe6922c-kube-api-access-rdjpb\") pod \"kuadrant-operator-catalog-n5lbq\" (UID: \"7c5085f6-ef39-4ecd-a453-bb966fe6922c\") " pod="kuadrant-system/kuadrant-operator-catalog-n5lbq"
May 21 19:30:20.697411 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.697375    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdjpb\" (UniqueName: \"kubernetes.io/projected/7c5085f6-ef39-4ecd-a453-bb966fe6922c-kube-api-access-rdjpb\") pod \"kuadrant-operator-catalog-n5lbq\" (UID: \"7c5085f6-ef39-4ecd-a453-bb966fe6922c\") " pod="kuadrant-system/kuadrant-operator-catalog-n5lbq"
May 21 19:30:20.726982 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.726948    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v" event={"ID":"83b042bd-dcd0-44cf-9d9b-18ccc77709ed","Type":"ContainerStarted","Data":"c9e2db9d40cf6bdd8b1efc9d90b81d608baed7c0be9baf813c2dd4f363296f84"}
May 21 19:30:20.824449 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.824413    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n5lbq"
May 21 19:30:20.960438 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:20.960414    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n5lbq"]
May 21 19:30:20.962109 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:30:20.962090    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5085f6_ef39_4ecd_a453_bb966fe6922c.slice/crio-adbbb06aba991ba441864a9393a7b78675b3666f9aae5a556ab5822ea7b6d11c WatchSource:0}: Error finding container adbbb06aba991ba441864a9393a7b78675b3666f9aae5a556ab5822ea7b6d11c: Status 404 returned error can't find the container with id adbbb06aba991ba441864a9393a7b78675b3666f9aae5a556ab5822ea7b6d11c
May 21 19:30:21.732243 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:21.732207    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n5lbq" event={"ID":"7c5085f6-ef39-4ecd-a453-bb966fe6922c","Type":"ContainerStarted","Data":"adbbb06aba991ba441864a9393a7b78675b3666f9aae5a556ab5822ea7b6d11c"}
May 21 19:30:23.740287 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:23.740235    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v" event={"ID":"83b042bd-dcd0-44cf-9d9b-18ccc77709ed","Type":"ContainerStarted","Data":"921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437"}
May 21 19:30:23.740768 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:23.740324    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v" podUID="83b042bd-dcd0-44cf-9d9b-18ccc77709ed" containerName="registry-server" containerID="cri-o://921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437" gracePeriod=2
May 21 19:30:23.741781 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:23.741753    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n5lbq" event={"ID":"7c5085f6-ef39-4ecd-a453-bb966fe6922c","Type":"ContainerStarted","Data":"43e0508df6d9d6369a4d0c0a5f67cfabafd9966bce64ddbef937fdcba8588145"}
May 21 19:30:23.760075 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:23.759914    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v" podStartSLOduration=2.468025705 podStartE2EDuration="4.759899376s" podCreationTimestamp="2026-05-21 19:30:19 +0000 UTC" firstStartedPulling="2026-05-21 19:30:20.425337335 +0000 UTC m=+504.932742506" lastFinishedPulling="2026-05-21 19:30:22.717210996 +0000 UTC m=+507.224616177" observedRunningTime="2026-05-21 19:30:23.759206433 +0000 UTC m=+508.266611620" watchObservedRunningTime="2026-05-21 19:30:23.759899376 +0000 UTC m=+508.267304565"
May 21 19:30:23.778013 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:23.777973    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n5lbq" podStartSLOduration=2.021555619 podStartE2EDuration="3.777962789s" podCreationTimestamp="2026-05-21 19:30:20 +0000 UTC" firstStartedPulling="2026-05-21 19:30:20.963436992 +0000 UTC m=+505.470842158" lastFinishedPulling="2026-05-21 19:30:22.719844163 +0000 UTC m=+507.227249328" observedRunningTime="2026-05-21 19:30:23.777224663 +0000 UTC m=+508.284629851" watchObservedRunningTime="2026-05-21 19:30:23.777962789 +0000 UTC m=+508.285367977"
May 21 19:30:23.977462 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:23.977440    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v"
May 21 19:30:24.120659 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.120632    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szwg6\" (UniqueName: \"kubernetes.io/projected/83b042bd-dcd0-44cf-9d9b-18ccc77709ed-kube-api-access-szwg6\") pod \"83b042bd-dcd0-44cf-9d9b-18ccc77709ed\" (UID: \"83b042bd-dcd0-44cf-9d9b-18ccc77709ed\") "
May 21 19:30:24.122799 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.122776    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b042bd-dcd0-44cf-9d9b-18ccc77709ed-kube-api-access-szwg6" (OuterVolumeSpecName: "kube-api-access-szwg6") pod "83b042bd-dcd0-44cf-9d9b-18ccc77709ed" (UID: "83b042bd-dcd0-44cf-9d9b-18ccc77709ed"). InnerVolumeSpecName "kube-api-access-szwg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 19:30:24.221966 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.221931    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szwg6\" (UniqueName: \"kubernetes.io/projected/83b042bd-dcd0-44cf-9d9b-18ccc77709ed-kube-api-access-szwg6\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:30:24.745930 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.745896    2561 generic.go:358] "Generic (PLEG): container finished" podID="83b042bd-dcd0-44cf-9d9b-18ccc77709ed" containerID="921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437" exitCode=0
May 21 19:30:24.746412 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.745955    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v"
May 21 19:30:24.746412 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.745968    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v" event={"ID":"83b042bd-dcd0-44cf-9d9b-18ccc77709ed","Type":"ContainerDied","Data":"921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437"}
May 21 19:30:24.746412 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.746006    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j5m2v" event={"ID":"83b042bd-dcd0-44cf-9d9b-18ccc77709ed","Type":"ContainerDied","Data":"c9e2db9d40cf6bdd8b1efc9d90b81d608baed7c0be9baf813c2dd4f363296f84"}
May 21 19:30:24.746412 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.746024    2561 scope.go:117] "RemoveContainer" containerID="921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437"
May 21 19:30:24.755174 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.755159    2561 scope.go:117] "RemoveContainer" containerID="921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437"
May 21 19:30:24.755460 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:30:24.755445    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437\": container with ID starting with 921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437 not found: ID does not exist" containerID="921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437"
May 21 19:30:24.755513 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.755468    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437"} err="failed to get container status \"921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437\": rpc error: code = NotFound desc = could not find container \"921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437\": container with ID starting with 921e2bc4f8f1d4fcf3779ad4584a4eddf2db61fc4d564ee8a48ea6f9cf9a7437 not found: ID does not exist"
May 21 19:30:24.767798 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.767772    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j5m2v"]
May 21 19:30:24.776640 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:24.776618    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j5m2v"]
May 21 19:30:26.113838 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:26.113804    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b042bd-dcd0-44cf-9d9b-18ccc77709ed" path="/var/lib/kubelet/pods/83b042bd-dcd0-44cf-9d9b-18ccc77709ed/volumes"
May 21 19:30:30.824626 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:30.824588    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n5lbq"
May 21 19:30:30.824626 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:30.824635    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n5lbq"
May 21 19:30:30.846118 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:30.846096    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n5lbq"
May 21 19:30:31.789152 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:31.789125    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n5lbq"
May 21 19:30:51.483553 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.483519    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"]
May 21 19:30:51.484018 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.483999    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b042bd-dcd0-44cf-9d9b-18ccc77709ed" containerName="registry-server"
May 21 19:30:51.484084 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.484022    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b042bd-dcd0-44cf-9d9b-18ccc77709ed" containerName="registry-server"
May 21 19:30:51.484123 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.484115    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="83b042bd-dcd0-44cf-9d9b-18ccc77709ed" containerName="registry-server"
May 21 19:30:51.487090 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.487075    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"
May 21 19:30:51.489790 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.489773    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xcv5f\""
May 21 19:30:51.499496 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.499476    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"]
May 21 19:30:51.535212 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.535168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j2gg\" (UniqueName: \"kubernetes.io/projected/2885e4f5-ab55-4f1e-9b35-919a0b542c57-kube-api-access-9j2gg\") pod \"limitador-operator-controller-manager-85c4996f8c-hn54k\" (UID: \"2885e4f5-ab55-4f1e-9b35-919a0b542c57\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"
May 21 19:30:51.636483 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.636459    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j2gg\" (UniqueName: \"kubernetes.io/projected/2885e4f5-ab55-4f1e-9b35-919a0b542c57-kube-api-access-9j2gg\") pod \"limitador-operator-controller-manager-85c4996f8c-hn54k\" (UID: \"2885e4f5-ab55-4f1e-9b35-919a0b542c57\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"
May 21 19:30:51.653555 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.653525    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j2gg\" (UniqueName: \"kubernetes.io/projected/2885e4f5-ab55-4f1e-9b35-919a0b542c57-kube-api-access-9j2gg\") pod \"limitador-operator-controller-manager-85c4996f8c-hn54k\" (UID: \"2885e4f5-ab55-4f1e-9b35-919a0b542c57\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"
May 21 19:30:51.796272 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.796206    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"
May 21 19:30:51.958072 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:51.958047    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"]
May 21 19:30:51.960491 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:30:51.960464    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2885e4f5_ab55_4f1e_9b35_919a0b542c57.slice/crio-65906adfe6c01bd2b75c4834e74d8ccc4ba80551291d7c970dbe14a8d61656c0 WatchSource:0}: Error finding container 65906adfe6c01bd2b75c4834e74d8ccc4ba80551291d7c970dbe14a8d61656c0: Status 404 returned error can't find the container with id 65906adfe6c01bd2b75c4834e74d8ccc4ba80551291d7c970dbe14a8d61656c0
May 21 19:30:52.837756 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:52.837715    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k" event={"ID":"2885e4f5-ab55-4f1e-9b35-919a0b542c57","Type":"ContainerStarted","Data":"65906adfe6c01bd2b75c4834e74d8ccc4ba80551291d7c970dbe14a8d61656c0"}
May 21 19:30:53.842548 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:53.842465    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k" event={"ID":"2885e4f5-ab55-4f1e-9b35-919a0b542c57","Type":"ContainerStarted","Data":"645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a"}
May 21 19:30:53.842949 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:53.842601    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"
May 21 19:30:53.866918 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:53.866876    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k" podStartSLOduration=1.248812453 podStartE2EDuration="2.866862412s" podCreationTimestamp="2026-05-21 19:30:51 +0000 UTC" firstStartedPulling="2026-05-21 19:30:51.9626879 +0000 UTC m=+536.470093066" lastFinishedPulling="2026-05-21 19:30:53.580737859 +0000 UTC m=+538.088143025" observedRunningTime="2026-05-21 19:30:53.865451773 +0000 UTC m=+538.372856956" watchObservedRunningTime="2026-05-21 19:30:53.866862412 +0000 UTC m=+538.374267601"
May 21 19:30:54.955774 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:54.955741    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"]
May 21 19:30:54.965786 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:54.965756    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"
May 21 19:30:54.969023 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:54.968957    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 21 19:30:54.969224 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:54.969052    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zj7qs\""
May 21 19:30:54.973125 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:54.973104    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"]
May 21 19:30:55.066127 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:55.066093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzch7\" (UniqueName: \"kubernetes.io/projected/0c143e2f-801e-4ccf-aa2e-b3b0642e86df-kube-api-access-wzch7\") pod \"dns-operator-controller-manager-648d5c98bc-vsjp8\" (UID: \"0c143e2f-801e-4ccf-aa2e-b3b0642e86df\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"
May 21 19:30:55.166876 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:55.166845    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzch7\" (UniqueName: \"kubernetes.io/projected/0c143e2f-801e-4ccf-aa2e-b3b0642e86df-kube-api-access-wzch7\") pod \"dns-operator-controller-manager-648d5c98bc-vsjp8\" (UID: \"0c143e2f-801e-4ccf-aa2e-b3b0642e86df\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"
May 21 19:30:55.175734 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:55.175709    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzch7\" (UniqueName: \"kubernetes.io/projected/0c143e2f-801e-4ccf-aa2e-b3b0642e86df-kube-api-access-wzch7\") pod \"dns-operator-controller-manager-648d5c98bc-vsjp8\" (UID: \"0c143e2f-801e-4ccf-aa2e-b3b0642e86df\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"
May 21 19:30:55.278147 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:55.278058    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"
May 21 19:30:55.413976 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:55.413951    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"]
May 21 19:30:55.416618 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:30:55.416592    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c143e2f_801e_4ccf_aa2e_b3b0642e86df.slice/crio-daaa345a45a01a7c81172d2084c5f161c5e068c6ff557caf67828eeb85224f2a WatchSource:0}: Error finding container daaa345a45a01a7c81172d2084c5f161c5e068c6ff557caf67828eeb85224f2a: Status 404 returned error can't find the container with id daaa345a45a01a7c81172d2084c5f161c5e068c6ff557caf67828eeb85224f2a
May 21 19:30:55.850740 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:55.850706    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8" event={"ID":"0c143e2f-801e-4ccf-aa2e-b3b0642e86df","Type":"ContainerStarted","Data":"daaa345a45a01a7c81172d2084c5f161c5e068c6ff557caf67828eeb85224f2a"}
May 21 19:30:57.357261 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:57.357240    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 21 19:30:57.860121 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:57.860083    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8" event={"ID":"0c143e2f-801e-4ccf-aa2e-b3b0642e86df","Type":"ContainerStarted","Data":"6ff34526d583fbfb8210954a9086d072e9ce92c4e4162be0d01586c72ee43d23"}
May 21 19:30:57.860302 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:57.860219    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"
May 21 19:30:57.884366 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:30:57.884310    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8" podStartSLOduration=1.94837011 podStartE2EDuration="3.884293896s" podCreationTimestamp="2026-05-21 19:30:54 +0000 UTC" firstStartedPulling="2026-05-21 19:30:55.418589576 +0000 UTC m=+539.925994742" lastFinishedPulling="2026-05-21 19:30:57.354513362 +0000 UTC m=+541.861918528" observedRunningTime="2026-05-21 19:30:57.882308072 +0000 UTC m=+542.389713263" watchObservedRunningTime="2026-05-21 19:30:57.884293896 +0000 UTC m=+542.391699085"
May 21 19:31:03.832300 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:03.832257    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-mqx82"]
May 21 19:31:03.836226 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:03.836206    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-mqx82"
May 21 19:31:03.839320 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:03.839292    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-htr6s\""
May 21 19:31:03.844949 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:03.844925    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-mqx82"]
May 21 19:31:03.939317 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:03.939287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrlzx\" (UniqueName: \"kubernetes.io/projected/805f6704-90ef-4eeb-9930-baf2a2a5810b-kube-api-access-vrlzx\") pod \"authorino-operator-657f44b778-mqx82\" (UID: \"805f6704-90ef-4eeb-9930-baf2a2a5810b\") " pod="kuadrant-system/authorino-operator-657f44b778-mqx82"
May 21 19:31:04.039810 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:04.039771    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrlzx\" (UniqueName: \"kubernetes.io/projected/805f6704-90ef-4eeb-9930-baf2a2a5810b-kube-api-access-vrlzx\") pod \"authorino-operator-657f44b778-mqx82\" (UID: \"805f6704-90ef-4eeb-9930-baf2a2a5810b\") " pod="kuadrant-system/authorino-operator-657f44b778-mqx82"
May 21 19:31:04.055340 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:04.055315    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrlzx\" (UniqueName: \"kubernetes.io/projected/805f6704-90ef-4eeb-9930-baf2a2a5810b-kube-api-access-vrlzx\") pod \"authorino-operator-657f44b778-mqx82\" (UID: \"805f6704-90ef-4eeb-9930-baf2a2a5810b\") " pod="kuadrant-system/authorino-operator-657f44b778-mqx82"
May 21 19:31:04.148841 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:04.148775    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-mqx82"
May 21 19:31:04.283614 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:04.283585    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-mqx82"]
May 21 19:31:04.286212 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:31:04.286159    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805f6704_90ef_4eeb_9930_baf2a2a5810b.slice/crio-b1258135bf396059737bf227b0bc59488f9ae879dba998649d5ad921aa85f4c2 WatchSource:0}: Error finding container b1258135bf396059737bf227b0bc59488f9ae879dba998649d5ad921aa85f4c2: Status 404 returned error can't find the container with id b1258135bf396059737bf227b0bc59488f9ae879dba998649d5ad921aa85f4c2
May 21 19:31:04.848442 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:04.848412    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"
May 21 19:31:04.886590 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:04.886554    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-mqx82" event={"ID":"805f6704-90ef-4eeb-9930-baf2a2a5810b","Type":"ContainerStarted","Data":"b1258135bf396059737bf227b0bc59488f9ae879dba998649d5ad921aa85f4c2"}
May 21 19:31:06.895433 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:06.895395    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-mqx82" event={"ID":"805f6704-90ef-4eeb-9930-baf2a2a5810b","Type":"ContainerStarted","Data":"d20ab90ba37df57e7449bbc732e519b023a594964a491200914001d816c6be45"}
May 21 19:31:06.895787 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:06.895577    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-mqx82"
May 21 19:31:06.912840 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:06.912798    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-mqx82" podStartSLOduration=1.722486129 podStartE2EDuration="3.912785782s" podCreationTimestamp="2026-05-21 19:31:03 +0000 UTC" firstStartedPulling="2026-05-21 19:31:04.288203325 +0000 UTC m=+548.795608491" lastFinishedPulling="2026-05-21 19:31:06.478502964 +0000 UTC m=+550.985908144" observedRunningTime="2026-05-21 19:31:06.911839254 +0000 UTC m=+551.419244443" watchObservedRunningTime="2026-05-21 19:31:06.912785782 +0000 UTC m=+551.420190970"
May 21 19:31:08.866142 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:08.866109    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vsjp8"
May 21 19:31:17.902294 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:17.902254    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-mqx82"
May 21 19:31:18.498442 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.498410    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"]
May 21 19:31:18.501668 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.501653    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:18.507129 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.507100    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b249l\""
May 21 19:31:18.542443 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.542406    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"]
May 21 19:31:18.557393 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.557364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07ff4918-4053-4b44-a4d6-a9bc9e95a368-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxqvz\" (UID: \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:18.557393 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.557393    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4dp\" (UniqueName: \"kubernetes.io/projected/07ff4918-4053-4b44-a4d6-a9bc9e95a368-kube-api-access-vm4dp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxqvz\" (UID: \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:18.574083 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.574057    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"]
May 21 19:31:18.574313 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.574290    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k" podUID="2885e4f5-ab55-4f1e-9b35-919a0b542c57" containerName="manager" containerID="cri-o://645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a" gracePeriod=2
May 21 19:31:18.607776 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.607751    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"]
May 21 19:31:18.658770 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.658745    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07ff4918-4053-4b44-a4d6-a9bc9e95a368-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxqvz\" (UID: \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:18.658893 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.658777    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4dp\" (UniqueName: \"kubernetes.io/projected/07ff4918-4053-4b44-a4d6-a9bc9e95a368-kube-api-access-vm4dp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxqvz\" (UID: \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:18.659086 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.659067    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07ff4918-4053-4b44-a4d6-a9bc9e95a368-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxqvz\" (UID: \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:18.683869 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.683846    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4dp\" (UniqueName: \"kubernetes.io/projected/07ff4918-4053-4b44-a4d6-a9bc9e95a368-kube-api-access-vm4dp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxqvz\" (UID: \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:18.810835 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.810812    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"
May 21 19:31:18.811901 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.811886    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:18.813916 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.813884    2561 status_manager.go:895] "Failed to get status for pod" podUID="2885e4f5-ab55-4f1e-9b35-919a0b542c57" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k" err="pods \"limitador-operator-controller-manager-85c4996f8c-hn54k\" is forbidden: User \"system:node:ip-10-0-143-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-158.ec2.internal' and this object"
May 21 19:31:18.860398 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.860369    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j2gg\" (UniqueName: \"kubernetes.io/projected/2885e4f5-ab55-4f1e-9b35-919a0b542c57-kube-api-access-9j2gg\") pod \"2885e4f5-ab55-4f1e-9b35-919a0b542c57\" (UID: \"2885e4f5-ab55-4f1e-9b35-919a0b542c57\") "
May 21 19:31:18.862666 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.862637    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2885e4f5-ab55-4f1e-9b35-919a0b542c57-kube-api-access-9j2gg" (OuterVolumeSpecName: "kube-api-access-9j2gg") pod "2885e4f5-ab55-4f1e-9b35-919a0b542c57" (UID: "2885e4f5-ab55-4f1e-9b35-919a0b542c57"). InnerVolumeSpecName "kube-api-access-9j2gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 19:31:18.937690 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.937649    2561 generic.go:358] "Generic (PLEG): container finished" podID="2885e4f5-ab55-4f1e-9b35-919a0b542c57" containerID="645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a" exitCode=0
May 21 19:31:18.938050 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.937700    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k"
May 21 19:31:18.938050 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.937712    2561 scope.go:117] "RemoveContainer" containerID="645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a"
May 21 19:31:18.940271 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.940242    2561 status_manager.go:895] "Failed to get status for pod" podUID="2885e4f5-ab55-4f1e-9b35-919a0b542c57" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k" err="pods \"limitador-operator-controller-manager-85c4996f8c-hn54k\" is forbidden: User \"system:node:ip-10-0-143-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-158.ec2.internal' and this object"
May 21 19:31:18.945220 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.945193    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"]
May 21 19:31:18.946457 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.946437    2561 scope.go:117] "RemoveContainer" containerID="645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a"
May 21 19:31:18.946745 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:31:18.946728    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a\": container with ID starting with 645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a not found: ID does not exist" containerID="645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a"
May 21 19:31:18.946793 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.946754    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a"} err="failed to get container status \"645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a\": rpc error: code = NotFound desc = could not find container \"645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a\": container with ID starting with 645e8b00f68328219c580b64a62471ff1fd8df7f5fb58bfb23263b3154c7ba6a not found: ID does not exist"
May 21 19:31:18.949093 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:31:18.949069    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ff4918_4053_4b44_a4d6_a9bc9e95a368.slice/crio-679173afbeb80a89e8ca725efcbc6488add03f9060ce3e75bcfa5b6cd2955119 WatchSource:0}: Error finding container 679173afbeb80a89e8ca725efcbc6488add03f9060ce3e75bcfa5b6cd2955119: Status 404 returned error can't find the container with id 679173afbeb80a89e8ca725efcbc6488add03f9060ce3e75bcfa5b6cd2955119
May 21 19:31:18.950735 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.950708    2561 status_manager.go:895] "Failed to get status for pod" podUID="2885e4f5-ab55-4f1e-9b35-919a0b542c57" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hn54k" err="pods \"limitador-operator-controller-manager-85c4996f8c-hn54k\" is forbidden: User \"system:node:ip-10-0-143-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-158.ec2.internal' and this object"
May 21 19:31:18.961232 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:18.961214    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j2gg\" (UniqueName: \"kubernetes.io/projected/2885e4f5-ab55-4f1e-9b35-919a0b542c57-kube-api-access-9j2gg\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:31:19.943879 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:19.943792    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz" event={"ID":"07ff4918-4053-4b44-a4d6-a9bc9e95a368","Type":"ContainerStarted","Data":"679173afbeb80a89e8ca725efcbc6488add03f9060ce3e75bcfa5b6cd2955119"}
May 21 19:31:20.115081 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:20.115046    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2885e4f5-ab55-4f1e-9b35-919a0b542c57" path="/var/lib/kubelet/pods/2885e4f5-ab55-4f1e-9b35-919a0b542c57/volumes"
May 21 19:31:22.955055 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:22.955025    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz" event={"ID":"07ff4918-4053-4b44-a4d6-a9bc9e95a368","Type":"ContainerStarted","Data":"67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164"}
May 21 19:31:22.955430 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:22.955200    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:30.642771 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.642718    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz" podStartSLOduration=8.835614230000001 podStartE2EDuration="12.642703911s" podCreationTimestamp="2026-05-21 19:31:18 +0000 UTC" firstStartedPulling="2026-05-21 19:31:18.951151532 +0000 UTC m=+563.458556699" lastFinishedPulling="2026-05-21 19:31:22.758241214 +0000 UTC m=+567.265646380" observedRunningTime="2026-05-21 19:31:23.050168819 +0000 UTC m=+567.557574008" watchObservedRunningTime="2026-05-21 19:31:30.642703911 +0000 UTC m=+575.150109099"
May 21 19:31:30.644257 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.644235    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"]
May 21 19:31:30.644500 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.644476    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz" podUID="07ff4918-4053-4b44-a4d6-a9bc9e95a368" containerName="manager" containerID="cri-o://67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164" gracePeriod=10
May 21 19:31:30.646190 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.646154    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:30.888483 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.888463    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:30.967792 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.967724    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07ff4918-4053-4b44-a4d6-a9bc9e95a368-extensions-socket-volume\") pod \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\" (UID: \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\") "
May 21 19:31:30.967792 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.967785    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm4dp\" (UniqueName: \"kubernetes.io/projected/07ff4918-4053-4b44-a4d6-a9bc9e95a368-kube-api-access-vm4dp\") pod \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\" (UID: \"07ff4918-4053-4b44-a4d6-a9bc9e95a368\") "
May 21 19:31:30.968237 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.968210    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ff4918-4053-4b44-a4d6-a9bc9e95a368-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "07ff4918-4053-4b44-a4d6-a9bc9e95a368" (UID: "07ff4918-4053-4b44-a4d6-a9bc9e95a368"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 19:31:30.969895 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.969871    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07ff4918-4053-4b44-a4d6-a9bc9e95a368-kube-api-access-vm4dp" (OuterVolumeSpecName: "kube-api-access-vm4dp") pod "07ff4918-4053-4b44-a4d6-a9bc9e95a368" (UID: "07ff4918-4053-4b44-a4d6-a9bc9e95a368"). InnerVolumeSpecName "kube-api-access-vm4dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 19:31:30.981979 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.981957    2561 generic.go:358] "Generic (PLEG): container finished" podID="07ff4918-4053-4b44-a4d6-a9bc9e95a368" containerID="67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164" exitCode=0
May 21 19:31:30.982079 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.982014    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"
May 21 19:31:30.982079 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.982021    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz" event={"ID":"07ff4918-4053-4b44-a4d6-a9bc9e95a368","Type":"ContainerDied","Data":"67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164"}
May 21 19:31:30.982079 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.982056    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz" event={"ID":"07ff4918-4053-4b44-a4d6-a9bc9e95a368","Type":"ContainerDied","Data":"679173afbeb80a89e8ca725efcbc6488add03f9060ce3e75bcfa5b6cd2955119"}
May 21 19:31:30.982079 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.982075    2561 scope.go:117] "RemoveContainer" containerID="67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164"
May 21 19:31:30.985238 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.985206    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"]
May 21 19:31:30.985537 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.985524    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ff4918-4053-4b44-a4d6-a9bc9e95a368" containerName="manager"
May 21 19:31:30.985598 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.985539    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ff4918-4053-4b44-a4d6-a9bc9e95a368" containerName="manager"
May 21 19:31:30.985598 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.985551    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2885e4f5-ab55-4f1e-9b35-919a0b542c57" containerName="manager"
May 21 19:31:30.985598 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.985556    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2885e4f5-ab55-4f1e-9b35-919a0b542c57" containerName="manager"
May 21 19:31:30.985705 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.985656    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="2885e4f5-ab55-4f1e-9b35-919a0b542c57" containerName="manager"
May 21 19:31:30.985705 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.985666    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="07ff4918-4053-4b44-a4d6-a9bc9e95a368" containerName="manager"
May 21 19:31:30.988912 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.988892    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:30.991257 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.991239    2561 scope.go:117] "RemoveContainer" containerID="67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164"
May 21 19:31:30.991513 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:31:30.991494    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164\": container with ID starting with 67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164 not found: ID does not exist" containerID="67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164"
May 21 19:31:30.991593 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.991518    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164"} err="failed to get container status \"67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164\": rpc error: code = NotFound desc = could not find container \"67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164\": container with ID starting with 67457a2b792ba768b3ad6e13d95fb885e80c2b37a4984dd2abd9b9a5d53d3164 not found: ID does not exist"
May 21 19:31:30.994222 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:30.994201    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b249l\""
May 21 19:31:31.006846 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.006824    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"]
May 21 19:31:31.047557 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.047530    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"]
May 21 19:31:31.069003 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.068978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7mkl\" (UniqueName: \"kubernetes.io/projected/88ab01b0-f15d-4c97-8330-33105dbd5071-kube-api-access-g7mkl\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nbp2p\" (UID: \"88ab01b0-f15d-4c97-8330-33105dbd5071\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:31.069138 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.069032    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88ab01b0-f15d-4c97-8330-33105dbd5071-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nbp2p\" (UID: \"88ab01b0-f15d-4c97-8330-33105dbd5071\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:31.069228 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.069208    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07ff4918-4053-4b44-a4d6-a9bc9e95a368-extensions-socket-volume\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:31:31.069283 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.069236    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm4dp\" (UniqueName: \"kubernetes.io/projected/07ff4918-4053-4b44-a4d6-a9bc9e95a368-kube-api-access-vm4dp\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:31:31.086409 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.086388    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxqvz"]
May 21 19:31:31.170129 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.170108    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7mkl\" (UniqueName: \"kubernetes.io/projected/88ab01b0-f15d-4c97-8330-33105dbd5071-kube-api-access-g7mkl\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nbp2p\" (UID: \"88ab01b0-f15d-4c97-8330-33105dbd5071\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:31.170255 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.170144    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88ab01b0-f15d-4c97-8330-33105dbd5071-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nbp2p\" (UID: \"88ab01b0-f15d-4c97-8330-33105dbd5071\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:31.170481 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.170464    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88ab01b0-f15d-4c97-8330-33105dbd5071-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nbp2p\" (UID: \"88ab01b0-f15d-4c97-8330-33105dbd5071\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:31.187701 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.187672    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7mkl\" (UniqueName: \"kubernetes.io/projected/88ab01b0-f15d-4c97-8330-33105dbd5071-kube-api-access-g7mkl\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nbp2p\" (UID: \"88ab01b0-f15d-4c97-8330-33105dbd5071\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:31.300109 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.299999    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:31.435371 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.435338    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"]
May 21 19:31:31.438711 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:31:31.438683    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ab01b0_f15d_4c97_8330_33105dbd5071.slice/crio-8ce3d95f433aae843e4e79f77cbb85b7dabbc9f35bdee6e6c8552fd48299039a WatchSource:0}: Error finding container 8ce3d95f433aae843e4e79f77cbb85b7dabbc9f35bdee6e6c8552fd48299039a: Status 404 returned error can't find the container with id 8ce3d95f433aae843e4e79f77cbb85b7dabbc9f35bdee6e6c8552fd48299039a
May 21 19:31:31.987615 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.987576    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p" event={"ID":"88ab01b0-f15d-4c97-8330-33105dbd5071","Type":"ContainerStarted","Data":"41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5"}
May 21 19:31:31.988009 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.987618    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p" event={"ID":"88ab01b0-f15d-4c97-8330-33105dbd5071","Type":"ContainerStarted","Data":"8ce3d95f433aae843e4e79f77cbb85b7dabbc9f35bdee6e6c8552fd48299039a"}
May 21 19:31:31.988009 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:31.987649    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:32.020499 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:32.020458    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p" podStartSLOduration=2.020442795 podStartE2EDuration="2.020442795s" podCreationTimestamp="2026-05-21 19:31:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:31:32.019161944 +0000 UTC m=+576.526567132" watchObservedRunningTime="2026-05-21 19:31:32.020442795 +0000 UTC m=+576.527847982"
May 21 19:31:32.114300 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:32.114273    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07ff4918-4053-4b44-a4d6-a9bc9e95a368" path="/var/lib/kubelet/pods/07ff4918-4053-4b44-a4d6-a9bc9e95a368/volumes"
May 21 19:31:42.993877 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:42.993846    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:31:47.184417 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.184383    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"]
May 21 19:31:47.187925 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.187900    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.192420 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.192402    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jx7qw\""
May 21 19:31:47.203768 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.203733    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"]
May 21 19:31:47.303174 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.303143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.303363 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.303280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.303363 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.303325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.303363 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.303353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.303484 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.303452    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.303527 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.303512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.303563 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.303544    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01fb1000-41a7-4171-84ee-5b2866f2cd04-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.303598 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.303566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.303598 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.303585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz9hj\" (UniqueName: \"kubernetes.io/projected/01fb1000-41a7-4171-84ee-5b2866f2cd04-kube-api-access-gz9hj\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.404982 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.404940    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405153 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.404998    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405153 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405024    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405153 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405057    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405153 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405117    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405370 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405153    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01fb1000-41a7-4171-84ee-5b2866f2cd04-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405370 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405202    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405370 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405235    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gz9hj\" (UniqueName: \"kubernetes.io/projected/01fb1000-41a7-4171-84ee-5b2866f2cd04-kube-api-access-gz9hj\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405370 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405286    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405568 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405469    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405568 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405505    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405673 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405595    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405857 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405820    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.405963 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.405867    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01fb1000-41a7-4171-84ee-5b2866f2cd04-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.408131 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.408106    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.408295 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.408277    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.415876 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.415856    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01fb1000-41a7-4171-84ee-5b2866f2cd04-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.416021 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.415998    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz9hj\" (UniqueName: \"kubernetes.io/projected/01fb1000-41a7-4171-84ee-5b2866f2cd04-kube-api-access-gz9hj\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mbr6z\" (UID: \"01fb1000-41a7-4171-84ee-5b2866f2cd04\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.499297 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.499215    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:47.646994 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.646969    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"]
May 21 19:31:47.649525 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:31:47.649499    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fb1000_41a7_4171_84ee_5b2866f2cd04.slice/crio-0f25643d4e448165bf9c48685d43cdb7aefb52e09c45cffde24278fdbf3f17c5 WatchSource:0}: Error finding container 0f25643d4e448165bf9c48685d43cdb7aefb52e09c45cffde24278fdbf3f17c5: Status 404 returned error can't find the container with id 0f25643d4e448165bf9c48685d43cdb7aefb52e09c45cffde24278fdbf3f17c5
May 21 19:31:47.651732 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.651701    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
May 21 19:31:47.651837 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.651775    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
May 21 19:31:47.651899 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:47.651842    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
May 21 19:31:48.040685 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:48.040641    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z" event={"ID":"01fb1000-41a7-4171-84ee-5b2866f2cd04","Type":"ContainerStarted","Data":"123adf38074ae59ac0d3d535388a1ee1da7e35be571c300f37e93ad075d53750"}
May 21 19:31:48.040839 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:48.040691    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z" event={"ID":"01fb1000-41a7-4171-84ee-5b2866f2cd04","Type":"ContainerStarted","Data":"0f25643d4e448165bf9c48685d43cdb7aefb52e09c45cffde24278fdbf3f17c5"}
May 21 19:31:48.061140 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:48.061100    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z" podStartSLOduration=1.061086103 podStartE2EDuration="1.061086103s" podCreationTimestamp="2026-05-21 19:31:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:31:48.059932311 +0000 UTC m=+592.567337536" watchObservedRunningTime="2026-05-21 19:31:48.061086103 +0000 UTC m=+592.568491292"
May 21 19:31:48.499767 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:48.499734    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:48.504571 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:48.504549    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:49.044467 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:49.044438    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:49.045426 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:49.045406    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mbr6z"
May 21 19:31:56.044697 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:56.044669    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:31:56.045232 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:31:56.045213    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:32:02.014357 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.014322    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:32:02.017385 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.017365    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:32:02.020017 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.019995    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 19:32:02.020192 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.020162    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jdpwm\""
May 21 19:32:02.026745 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.026722    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:32:02.057940 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.057907    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:32:02.113406 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.113372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmh28\" (UniqueName: \"kubernetes.io/projected/ff1c900f-0c86-478b-af49-f34a94cef280-kube-api-access-kmh28\") pod \"limitador-limitador-78c99df468-2lwzv\" (UID: \"ff1c900f-0c86-478b-af49-f34a94cef280\") " pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:32:02.113582 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.113425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff1c900f-0c86-478b-af49-f34a94cef280-config-file\") pod \"limitador-limitador-78c99df468-2lwzv\" (UID: \"ff1c900f-0c86-478b-af49-f34a94cef280\") " pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:32:02.214906 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.214872    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff1c900f-0c86-478b-af49-f34a94cef280-config-file\") pod \"limitador-limitador-78c99df468-2lwzv\" (UID: \"ff1c900f-0c86-478b-af49-f34a94cef280\") " pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:32:02.215099 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.214956    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmh28\" (UniqueName: \"kubernetes.io/projected/ff1c900f-0c86-478b-af49-f34a94cef280-kube-api-access-kmh28\") pod \"limitador-limitador-78c99df468-2lwzv\" (UID: \"ff1c900f-0c86-478b-af49-f34a94cef280\") " pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:32:02.215571 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.215544    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff1c900f-0c86-478b-af49-f34a94cef280-config-file\") pod \"limitador-limitador-78c99df468-2lwzv\" (UID: \"ff1c900f-0c86-478b-af49-f34a94cef280\") " pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:32:02.224566 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.224544    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmh28\" (UniqueName: \"kubernetes.io/projected/ff1c900f-0c86-478b-af49-f34a94cef280-kube-api-access-kmh28\") pod \"limitador-limitador-78c99df468-2lwzv\" (UID: \"ff1c900f-0c86-478b-af49-f34a94cef280\") " pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:32:02.327929 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.327895    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:32:02.488453 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:02.488423    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:32:02.503214 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:32:02.503169    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff1c900f_0c86_478b_af49_f34a94cef280.slice/crio-a3d9927ecdddf3e3b53d529eda220ab16d23b7153c4de962fb873cb82dab6c38 WatchSource:0}: Error finding container a3d9927ecdddf3e3b53d529eda220ab16d23b7153c4de962fb873cb82dab6c38: Status 404 returned error can't find the container with id a3d9927ecdddf3e3b53d529eda220ab16d23b7153c4de962fb873cb82dab6c38
May 21 19:32:03.099974 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:03.099908    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv" event={"ID":"ff1c900f-0c86-478b-af49-f34a94cef280","Type":"ContainerStarted","Data":"a3d9927ecdddf3e3b53d529eda220ab16d23b7153c4de962fb873cb82dab6c38"}
May 21 19:32:05.109049 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:05.108950    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv" event={"ID":"ff1c900f-0c86-478b-af49-f34a94cef280","Type":"ContainerStarted","Data":"3d3923a6e3e99f58962472a5be13d54b38e331eaf83259900148bc252f8ede12"}
May 21 19:32:05.109463 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:05.109045    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:32:05.125341 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:05.125300    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv" podStartSLOduration=1.775326025 podStartE2EDuration="4.125282888s" podCreationTimestamp="2026-05-21 19:32:01 +0000 UTC" firstStartedPulling="2026-05-21 19:32:02.504935791 +0000 UTC m=+607.012340957" lastFinishedPulling="2026-05-21 19:32:04.854892652 +0000 UTC m=+609.362297820" observedRunningTime="2026-05-21 19:32:05.12434292 +0000 UTC m=+609.631748111" watchObservedRunningTime="2026-05-21 19:32:05.125282888 +0000 UTC m=+609.632688077"
May 21 19:32:16.113940 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:32:16.113912    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-2lwzv"
May 21 19:33:10.018246 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:33:10.018213    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:33:32.593574 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:33:32.593534    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:33:35.507010 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:33:35.506934    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:33:38.995147 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:33:38.995111    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:33:42.830889 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:33:42.830848    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:34:09.786227 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:34:09.786174    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:34:23.211043 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:34:23.211008    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:34:41.502534 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:34:41.502497    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:34:45.993016 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:34:45.992985    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:34:52.506471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:34:52.506438    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:35:03.334199 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:03.334154    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:35:10.997236 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:10.997149    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:35:21.697765 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:21.697727    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:35:30.099541 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:30.099506    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:35:40.798173 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:40.798143    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:35:49.495896 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.495863    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-965f45468-4wm8k"]
May 21 19:35:49.498883 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.498868    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-965f45468-4wm8k"
May 21 19:35:49.501289 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.501267    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hfnkq\""
May 21 19:35:49.501475 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.501458    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 19:35:49.508403 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.508377    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-965f45468-4wm8k"]
May 21 19:35:49.546102 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.546075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rmbw\" (UniqueName: \"kubernetes.io/projected/eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa-kube-api-access-8rmbw\") pod \"maas-controller-965f45468-4wm8k\" (UID: \"eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa\") " pod="opendatahub/maas-controller-965f45468-4wm8k"
May 21 19:35:49.647238 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.647208    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rmbw\" (UniqueName: \"kubernetes.io/projected/eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa-kube-api-access-8rmbw\") pod \"maas-controller-965f45468-4wm8k\" (UID: \"eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa\") " pod="opendatahub/maas-controller-965f45468-4wm8k"
May 21 19:35:49.655952 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.655927    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rmbw\" (UniqueName: \"kubernetes.io/projected/eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa-kube-api-access-8rmbw\") pod \"maas-controller-965f45468-4wm8k\" (UID: \"eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa\") " pod="opendatahub/maas-controller-965f45468-4wm8k"
May 21 19:35:49.809828 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.809804    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-965f45468-4wm8k"
May 21 19:35:49.942056 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.942024    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-965f45468-4wm8k"]
May 21 19:35:49.946386 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:35:49.946359    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb7b17b4_897a_4c94_9bb3_9f55e0f26eaa.slice/crio-313a6e3dfff3d8b4e332fb2582077c17666df3fe14be25c1a3b7727a64e91db6 WatchSource:0}: Error finding container 313a6e3dfff3d8b4e332fb2582077c17666df3fe14be25c1a3b7727a64e91db6: Status 404 returned error can't find the container with id 313a6e3dfff3d8b4e332fb2582077c17666df3fe14be25c1a3b7727a64e91db6
May 21 19:35:49.948028 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:49.948012    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 19:35:50.882937 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:50.882898    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-965f45468-4wm8k" event={"ID":"eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa","Type":"ContainerStarted","Data":"313a6e3dfff3d8b4e332fb2582077c17666df3fe14be25c1a3b7727a64e91db6"}
May 21 19:35:52.899640 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:52.899594    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-965f45468-4wm8k" event={"ID":"eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa","Type":"ContainerStarted","Data":"12bee1d41280aa079445444297dd8095b417241a7765302321b6e22e8615d924"}
May 21 19:35:52.899988 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:52.899736    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-965f45468-4wm8k"
May 21 19:35:52.919954 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:35:52.919903    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-965f45468-4wm8k" podStartSLOduration=1.5123712390000001 podStartE2EDuration="3.919890089s" podCreationTimestamp="2026-05-21 19:35:49 +0000 UTC" firstStartedPulling="2026-05-21 19:35:49.948132239 +0000 UTC m=+834.455537405" lastFinishedPulling="2026-05-21 19:35:52.355651084 +0000 UTC m=+836.863056255" observedRunningTime="2026-05-21 19:35:52.917809361 +0000 UTC m=+837.425214549" watchObservedRunningTime="2026-05-21 19:35:52.919890089 +0000 UTC m=+837.427295277"
May 21 19:36:03.909076 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:36:03.909046    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-965f45468-4wm8k"
May 21 19:36:56.073846 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:36:56.073812    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:36:56.074735 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:36:56.074712    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:36:56.699508 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:36:56.699473    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:37:12.205483 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:37:12.205448    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:37:52.486900 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:37:52.486862    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:38:07.993842 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:38:07.993761    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:38:23.500108 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:38:23.500071    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:38:39.293734 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:38:39.293693    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:39:33.687405 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:39:33.687372    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:39:43.296672 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:39:43.296592    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:40:00.285482 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:40:00.285441    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:40:08.293936 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:40:08.293898    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:40:25.987998 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:40:25.987964    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:40:33.791592 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:40:33.791545    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:41:05.885901 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:41:05.885820    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:41:14.897007 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:41:14.896974    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:41:23.699393 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:41:23.695742    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:41:30.912268 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:41:30.912236    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:41:39.390667 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:41:39.390623    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:41:56.099251 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:41:56.099225    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:41:56.101972 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:41:56.101948    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:41:57.600213 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:41:57.600147    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:42:07.906732 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:42:07.906703    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:42:55.100968 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:42:55.100920    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:43:00.784469 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:43:00.784431    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:43:07.240666 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:43:07.240628    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:43:14.782416 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:43:14.782378    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:43:24.492725 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:43:24.492690    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:43:32.195486 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:43:32.195456    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:43:41.491728 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:43:41.491697    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:43:46.586230 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:43:46.586201    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:43:50.689546 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:43:50.689509    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:43:58.991403 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:43:58.991367    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:44:08.590245 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:44:08.590135    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:44:17.295724 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:44:17.295678    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:44:25.594346 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:44:25.594313    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:44:35.193714 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:44:35.193673    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:44:42.989737 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:44:42.989702    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:44:51.690374 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:44:51.690328    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:45:00.487487 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:45:00.487455    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:45:08.690516 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:45:08.690484    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:45:17.912771 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:45:17.912737    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:46:09.346820 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.346788    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"]
May 21 19:46:09.347400 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.347016    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p" podUID="88ab01b0-f15d-4c97-8330-33105dbd5071" containerName="manager" containerID="cri-o://41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5" gracePeriod=10
May 21 19:46:09.702451 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.702428    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:46:09.825350 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.825320    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7mkl\" (UniqueName: \"kubernetes.io/projected/88ab01b0-f15d-4c97-8330-33105dbd5071-kube-api-access-g7mkl\") pod \"88ab01b0-f15d-4c97-8330-33105dbd5071\" (UID: \"88ab01b0-f15d-4c97-8330-33105dbd5071\") "
May 21 19:46:09.825507 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.825394    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88ab01b0-f15d-4c97-8330-33105dbd5071-extensions-socket-volume\") pod \"88ab01b0-f15d-4c97-8330-33105dbd5071\" (UID: \"88ab01b0-f15d-4c97-8330-33105dbd5071\") "
May 21 19:46:09.825766 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.825742    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88ab01b0-f15d-4c97-8330-33105dbd5071-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "88ab01b0-f15d-4c97-8330-33105dbd5071" (UID: "88ab01b0-f15d-4c97-8330-33105dbd5071"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 19:46:09.827372 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.827350    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88ab01b0-f15d-4c97-8330-33105dbd5071-kube-api-access-g7mkl" (OuterVolumeSpecName: "kube-api-access-g7mkl") pod "88ab01b0-f15d-4c97-8330-33105dbd5071" (UID: "88ab01b0-f15d-4c97-8330-33105dbd5071"). InnerVolumeSpecName "kube-api-access-g7mkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 19:46:09.926028 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.925961    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7mkl\" (UniqueName: \"kubernetes.io/projected/88ab01b0-f15d-4c97-8330-33105dbd5071-kube-api-access-g7mkl\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:46:09.926028 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.925986    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88ab01b0-f15d-4c97-8330-33105dbd5071-extensions-socket-volume\") on node \"ip-10-0-143-158.ec2.internal\" DevicePath \"\""
May 21 19:46:09.998565 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.998536    2561 generic.go:358] "Generic (PLEG): container finished" podID="88ab01b0-f15d-4c97-8330-33105dbd5071" containerID="41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5" exitCode=0
May 21 19:46:09.998682 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.998591    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p" event={"ID":"88ab01b0-f15d-4c97-8330-33105dbd5071","Type":"ContainerDied","Data":"41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5"}
May 21 19:46:09.998682 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.998600    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"
May 21 19:46:09.998682 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.998617    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p" event={"ID":"88ab01b0-f15d-4c97-8330-33105dbd5071","Type":"ContainerDied","Data":"8ce3d95f433aae843e4e79f77cbb85b7dabbc9f35bdee6e6c8552fd48299039a"}
May 21 19:46:09.998682 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:09.998632    2561 scope.go:117] "RemoveContainer" containerID="41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5"
May 21 19:46:10.007784 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:10.007768    2561 scope.go:117] "RemoveContainer" containerID="41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5"
May 21 19:46:10.008032 ip-10-0-143-158 kubenswrapper[2561]: E0521 19:46:10.008012    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5\": container with ID starting with 41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5 not found: ID does not exist" containerID="41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5"
May 21 19:46:10.008124 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:10.008038    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5"} err="failed to get container status \"41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5\": rpc error: code = NotFound desc = could not find container \"41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5\": container with ID starting with 41ee2873f5f9e7dfa4739a712f25003e644e22e181ea86de766484240f958fa5 not found: ID does not exist"
May 21 19:46:10.021211 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:10.021159    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"]
May 21 19:46:10.026559 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:10.026537    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nbp2p"]
May 21 19:46:10.113868 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:10.113843    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88ab01b0-f15d-4c97-8330-33105dbd5071" path="/var/lib/kubelet/pods/88ab01b0-f15d-4c97-8330-33105dbd5071/volumes"
May 21 19:46:56.123577 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:56.123548    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:46:56.127974 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:46:56.127952    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:47:15.490640 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.490557    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"]
May 21 19:47:15.491059 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.490921    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88ab01b0-f15d-4c97-8330-33105dbd5071" containerName="manager"
May 21 19:47:15.491059 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.490931    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88ab01b0-f15d-4c97-8330-33105dbd5071" containerName="manager"
May 21 19:47:15.491059 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.491000    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="88ab01b0-f15d-4c97-8330-33105dbd5071" containerName="manager"
May 21 19:47:15.496261 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.495023    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:15.499777 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.499747    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b249l\""
May 21 19:47:15.507885 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.507862    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"]
May 21 19:47:15.666483 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.666458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85c35dfd-76e2-43e8-ac40-10d8c06d5693-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sg99c\" (UID: \"85c35dfd-76e2-43e8-ac40-10d8c06d5693\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:15.666623 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.666509    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddtnj\" (UniqueName: \"kubernetes.io/projected/85c35dfd-76e2-43e8-ac40-10d8c06d5693-kube-api-access-ddtnj\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sg99c\" (UID: \"85c35dfd-76e2-43e8-ac40-10d8c06d5693\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:15.767358 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.767289    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85c35dfd-76e2-43e8-ac40-10d8c06d5693-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sg99c\" (UID: \"85c35dfd-76e2-43e8-ac40-10d8c06d5693\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:15.767480 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.767356    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddtnj\" (UniqueName: \"kubernetes.io/projected/85c35dfd-76e2-43e8-ac40-10d8c06d5693-kube-api-access-ddtnj\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sg99c\" (UID: \"85c35dfd-76e2-43e8-ac40-10d8c06d5693\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:15.767671 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.767655    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85c35dfd-76e2-43e8-ac40-10d8c06d5693-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sg99c\" (UID: \"85c35dfd-76e2-43e8-ac40-10d8c06d5693\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:15.777601 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.777568    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddtnj\" (UniqueName: \"kubernetes.io/projected/85c35dfd-76e2-43e8-ac40-10d8c06d5693-kube-api-access-ddtnj\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sg99c\" (UID: \"85c35dfd-76e2-43e8-ac40-10d8c06d5693\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:15.807958 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.807934    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:15.945826 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.945794    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"]
May 21 19:47:15.949588 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:47:15.949564    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c35dfd_76e2_43e8_ac40_10d8c06d5693.slice/crio-d6d6f85237265629d99c19c100c72bbe483e66c7c0fb80d339417590cdccc9ae WatchSource:0}: Error finding container d6d6f85237265629d99c19c100c72bbe483e66c7c0fb80d339417590cdccc9ae: Status 404 returned error can't find the container with id d6d6f85237265629d99c19c100c72bbe483e66c7c0fb80d339417590cdccc9ae
May 21 19:47:15.951764 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:15.951746    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 19:47:16.223246 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:16.223215    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c" event={"ID":"85c35dfd-76e2-43e8-ac40-10d8c06d5693","Type":"ContainerStarted","Data":"6f28934a1c8ff41f113d87f13c9f2f0e7fc4d2e181ee2f57a5db72546ab4bed3"}
May 21 19:47:16.223246 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:16.223251    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c" event={"ID":"85c35dfd-76e2-43e8-ac40-10d8c06d5693","Type":"ContainerStarted","Data":"d6d6f85237265629d99c19c100c72bbe483e66c7c0fb80d339417590cdccc9ae"}
May 21 19:47:16.223444 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:16.223347    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:16.243737 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:16.243682    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c" podStartSLOduration=1.243663125 podStartE2EDuration="1.243663125s" podCreationTimestamp="2026-05-21 19:47:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:47:16.242406489 +0000 UTC m=+1520.749811677" watchObservedRunningTime="2026-05-21 19:47:16.243663125 +0000 UTC m=+1520.751068313"
May 21 19:47:27.229022 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:27.228989    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sg99c"
May 21 19:47:34.789240 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:34.789198    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:47:39.986502 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:47:39.986463    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:48:06.586972 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:48:06.586937    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:48:13.194407 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:48:13.194364    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:48:22.212231 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:48:22.212197    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:48:33.088268 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:48:33.088225    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:48:41.794436 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:48:41.794355    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:48:52.499481 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:48:52.499439    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:49:01.100543 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:49:01.100512    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:49:11.395861 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:49:11.395818    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:49:20.289924 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:49:20.289889    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:49:31.292903 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:49:31.292864    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:49:40.590742 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:49:40.590701    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:50:13.098405 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:50:13.098314    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:50:56.097389 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:50:56.097349    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:51:04.187582 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:04.187546    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:51:14.201387 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:14.201356    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:51:23.599229 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:23.599171    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:51:32.692837 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:32.692804    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:51:43.795563 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:43.795515    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:51:52.140171 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.140138    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-548cf866cc-4b96p"]
May 21 19:51:52.143615 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.143595    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.148016 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.147992    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 19:51:52.148556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.148399    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 19:51:52.148556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.148425    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 19:51:52.148556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.148437    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 19:51:52.148556 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.148465    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-px77q\""
May 21 19:51:52.148822 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.148662    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 19:51:52.152321 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.152290    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 19:51:52.172992 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.172969    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548cf866cc-4b96p"]
May 21 19:51:52.265706 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.265636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-oauth-serving-cert\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.265706 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.265672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8qx4\" (UniqueName: \"kubernetes.io/projected/a1985c33-6915-4d48-be74-806621735add-kube-api-access-z8qx4\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.265884 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.265759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1985c33-6915-4d48-be74-806621735add-console-serving-cert\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.265884 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.265818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-service-ca\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.265884 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.265869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-trusted-ca-bundle\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.266043 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.265896    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1985c33-6915-4d48-be74-806621735add-console-oauth-config\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.266043 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.265940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-console-config\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.366471 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.366437    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-oauth-serving-cert\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.366611 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.366479    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8qx4\" (UniqueName: \"kubernetes.io/projected/a1985c33-6915-4d48-be74-806621735add-kube-api-access-z8qx4\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.366611 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.366519    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1985c33-6915-4d48-be74-806621735add-console-serving-cert\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.366611 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.366572    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-service-ca\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.366757 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.366614    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-trusted-ca-bundle\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.366757 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.366648    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1985c33-6915-4d48-be74-806621735add-console-oauth-config\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.366757 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.366683    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-console-config\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.367301 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.367275    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-oauth-serving-cert\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.367539 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.367442    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-console-config\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.367539 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.367331    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-service-ca\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.367812 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.367788    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1985c33-6915-4d48-be74-806621735add-trusted-ca-bundle\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.369444 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.369415    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1985c33-6915-4d48-be74-806621735add-console-oauth-config\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.369444 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.369440    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1985c33-6915-4d48-be74-806621735add-console-serving-cert\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.376581 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.376564    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8qx4\" (UniqueName: \"kubernetes.io/projected/a1985c33-6915-4d48-be74-806621735add-kube-api-access-z8qx4\") pod \"console-548cf866cc-4b96p\" (UID: \"a1985c33-6915-4d48-be74-806621735add\") " pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.455046 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.455021    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:51:52.590050 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.589988    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548cf866cc-4b96p"]
May 21 19:51:52.592285 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:51:52.592260    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1985c33_6915_4d48_be74_806621735add.slice/crio-7460252a9239843d92f8e14e519169f5a74235a09395044b236dd62946d88a7f WatchSource:0}: Error finding container 7460252a9239843d92f8e14e519169f5a74235a09395044b236dd62946d88a7f: Status 404 returned error can't find the container with id 7460252a9239843d92f8e14e519169f5a74235a09395044b236dd62946d88a7f
May 21 19:51:52.897486 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:52.897444    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:51:53.164097 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:53.164012    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548cf866cc-4b96p" event={"ID":"a1985c33-6915-4d48-be74-806621735add","Type":"ContainerStarted","Data":"d1d9574722d11ebe10f8159c86ea39fe7ff16f6b88284b8cd6c70c7f876ecfea"}
May 21 19:51:53.164097 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:53.164047    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548cf866cc-4b96p" event={"ID":"a1985c33-6915-4d48-be74-806621735add","Type":"ContainerStarted","Data":"7460252a9239843d92f8e14e519169f5a74235a09395044b236dd62946d88a7f"}
May 21 19:51:53.196988 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:53.196922    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-548cf866cc-4b96p" podStartSLOduration=1.196906465 podStartE2EDuration="1.196906465s" podCreationTimestamp="2026-05-21 19:51:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:51:53.195707085 +0000 UTC m=+1797.703112273" watchObservedRunningTime="2026-05-21 19:51:53.196906465 +0000 UTC m=+1797.704311654"
May 21 19:51:56.147975 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:56.147948    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:51:56.154275 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:51:56.154254    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:52:00.590518 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:00.590480    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:52:02.455411 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:02.455330    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:52:02.455765 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:02.455422    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:52:02.460095 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:02.460073    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:52:03.199379 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:03.199354    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-548cf866cc-4b96p"
May 21 19:52:08.396768 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:08.396737    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:52:17.694731 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:17.694689    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:52:26.289657 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:26.289622    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:52:36.293823 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:36.293790    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:52:54.190355 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:52:54.190313    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:53:01.702158 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:53:01.702117    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:53:11.498005 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:53:11.497971    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:53:19.392004 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:53:19.391966    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:53:37.088858 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:53:37.088827    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:53:45.188080 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:53:45.188033    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:53:54.098876 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:53:54.098839    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:54:02.093568 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:54:02.093529    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:54:11.216448 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:54:11.216408    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:54:19.795462 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:54:19.795417    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:54:29.397609 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:54:29.397571    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:54:40.491297 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:54:40.491210    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:54:50.190984 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:54:50.190946    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:55:00.790534 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:55:00.790488    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:55:08.685693 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:55:08.685656    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:55:16.292189 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:55:16.292141    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:55:25.792770 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:55:25.792731    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:55:34.297693 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:55:34.297656    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:55:50.191596 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:55:50.191561    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:55:58.393295 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:55:58.393258    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:56:07.292673 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:56:07.292596    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:56:14.398553 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:56:14.398519    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:56:40.199478 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:56:40.199443    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:56:52.594943 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:56:52.594906    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2lwzv"]
May 21 19:56:56.172692 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:56:56.172664    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:56:56.179948 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:56:56.179926    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hnsn4_c4ba0aaf-12d7-4f9c-86fc-96c9f353c002/ovn-acl-logging/0.log"
May 21 19:57:00.574343 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:00.574311    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-965f45468-4wm8k_eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa/manager/0.log"
May 21 19:57:01.039017 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:01.038936    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b454b5c58-vwtqb_4494c501-92dd-4d7e-959c-c82fc3a36d8c/manager/0.log"
May 21 19:57:02.560927 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:02.560897    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-mqx82_805f6704-90ef-4eeb-9930-baf2a2a5810b/manager/0.log"
May 21 19:57:02.674344 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:02.674314    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-vsjp8_0c143e2f-801e-4ccf-aa2e-b3b0642e86df/manager/0.log"
May 21 19:57:02.898086 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:02.898002    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n5lbq_7c5085f6-ef39-4ecd-a453-bb966fe6922c/registry-server/0.log"
May 21 19:57:03.018597 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:03.018553    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-sg99c_85c35dfd-76e2-43e8-ac40-10d8c06d5693/manager/0.log"
May 21 19:57:03.148487 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:03.148408    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-2lwzv_ff1c900f-0c86-478b-af49-f34a94cef280/limitador/0.log"
May 21 19:57:03.645962 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:03.645935    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b924fs_31eec800-d04a-4f7f-89a5-e4ea0422226f/istio-proxy/0.log"
May 21 19:57:04.120377 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:04.120343    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-mbr6z_01fb1000-41a7-4171-84ee-5b2866f2cd04/istio-proxy/0.log"
May 21 19:57:12.382242 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:12.382214    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7rtcc_b8f6e07b-b44a-4bcd-9c32-d424e692f1c2/global-pull-secret-syncer/0.log"
May 21 19:57:12.519901 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:12.519874    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-htbxc_e8502922-374c-42fa-81fc-5c84e567160d/konnectivity-agent/0.log"
May 21 19:57:12.668554 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:12.668470    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-158.ec2.internal_55cb852938d3e2368f6d966251b07f42/haproxy/0.log"
May 21 19:57:16.925232 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:16.925205    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-mqx82_805f6704-90ef-4eeb-9930-baf2a2a5810b/manager/0.log"
May 21 19:57:16.964150 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:16.964112    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-vsjp8_0c143e2f-801e-4ccf-aa2e-b3b0642e86df/manager/0.log"
May 21 19:57:17.033605 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:17.033523    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n5lbq_7c5085f6-ef39-4ecd-a453-bb966fe6922c/registry-server/0.log"
May 21 19:57:17.123436 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:17.123401    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-sg99c_85c35dfd-76e2-43e8-ac40-10d8c06d5693/manager/0.log"
May 21 19:57:17.157476 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:17.157447    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-2lwzv_ff1c900f-0c86-478b-af49-f34a94cef280/limitador/0.log"
May 21 19:57:18.816386 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:18.816361    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wwnqq_c948202b-38bc-425c-9928-a44261606e21/kube-state-metrics/0.log"
May 21 19:57:18.837898 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:18.837866    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wwnqq_c948202b-38bc-425c-9928-a44261606e21/kube-rbac-proxy-main/0.log"
May 21 19:57:18.861344 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:18.861322    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wwnqq_c948202b-38bc-425c-9928-a44261606e21/kube-rbac-proxy-self/0.log"
May 21 19:57:18.888133 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:18.888115    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d9bbbbf5d-56htx_1d578145-8ede-4626-b884-9ffd8d9e1b84/metrics-server/0.log"
May 21 19:57:18.914112 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:18.914089    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-vqx5v_e3691c35-3322-434a-aeb0-3db0826cc523/monitoring-plugin/0.log"
May 21 19:57:19.031674 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.031646    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w84vb_38bc129c-3a39-47e1-a37a-45e5c95c013d/node-exporter/0.log"
May 21 19:57:19.062007 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.061983    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w84vb_38bc129c-3a39-47e1-a37a-45e5c95c013d/kube-rbac-proxy/0.log"
May 21 19:57:19.086667 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.086644    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w84vb_38bc129c-3a39-47e1-a37a-45e5c95c013d/init-textfile/0.log"
May 21 19:57:19.210343 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.210315    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-fmv4g_e687a258-41c9-415f-9127-e88c1b0909ca/kube-rbac-proxy-main/0.log"
May 21 19:57:19.233533 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.233508    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-fmv4g_e687a258-41c9-415f-9127-e88c1b0909ca/kube-rbac-proxy-self/0.log"
May 21 19:57:19.258148 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.258094    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-fmv4g_e687a258-41c9-415f-9127-e88c1b0909ca/openshift-state-metrics/0.log"
May 21 19:57:19.294628 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.294603    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c7e1d86e-5ffb-4349-91fc-4c71b609050a/prometheus/0.log"
May 21 19:57:19.318263 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.318245    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c7e1d86e-5ffb-4349-91fc-4c71b609050a/config-reloader/0.log"
May 21 19:57:19.340566 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.340544    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c7e1d86e-5ffb-4349-91fc-4c71b609050a/thanos-sidecar/0.log"
May 21 19:57:19.366498 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.366478    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c7e1d86e-5ffb-4349-91fc-4c71b609050a/kube-rbac-proxy-web/0.log"
May 21 19:57:19.391907 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.391887    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c7e1d86e-5ffb-4349-91fc-4c71b609050a/kube-rbac-proxy/0.log"
May 21 19:57:19.414472 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.414451    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c7e1d86e-5ffb-4349-91fc-4c71b609050a/kube-rbac-proxy-thanos/0.log"
May 21 19:57:19.441880 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.441862    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c7e1d86e-5ffb-4349-91fc-4c71b609050a/init-config-reloader/0.log"
May 21 19:57:19.474206 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.474173    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-lb8rh_eb8f02e4-c4df-44ee-a44e-11f399688451/prometheus-operator/0.log"
May 21 19:57:19.494797 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.494779    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-lb8rh_eb8f02e4-c4df-44ee-a44e-11f399688451/kube-rbac-proxy/0.log"
May 21 19:57:19.525347 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:19.525298    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-vnqvb_7238601e-e4d3-4c32-b184-97ec819b9080/prometheus-operator-admission-webhook/0.log"
May 21 19:57:20.923359 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.923328    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"]
May 21 19:57:20.927171 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.927146    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"]
May 21 19:57:20.927342 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.927279    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:20.930104 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.930079    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hx9h5\"/\"kube-root-ca.crt\""
May 21 19:57:20.931244 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.931214    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hx9h5\"/\"default-dockercfg-lnhc7\""
May 21 19:57:20.931244 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.931231    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hx9h5\"/\"openshift-service-ca.crt\""
May 21 19:57:20.960714 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.960667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-proc\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:20.960813 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.960767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-lib-modules\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:20.960897 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.960875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-sys\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:20.961001 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.960972    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-podres\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:20.961103 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:20.961084    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llvff\" (UniqueName: \"kubernetes.io/projected/bc68d70c-fc44-44ce-a81b-d253aaa4478f-kube-api-access-llvff\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.061916 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.061883    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-proc\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.061916 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.061927    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-lib-modules\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.062135 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.061966    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-sys\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.062135 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.062008    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-podres\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.062135 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.062018    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-proc\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.062135 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.062048    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llvff\" (UniqueName: \"kubernetes.io/projected/bc68d70c-fc44-44ce-a81b-d253aaa4478f-kube-api-access-llvff\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.062135 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.062083    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-sys\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.062135 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.062117    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-lib-modules\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.062373 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.062152    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc68d70c-fc44-44ce-a81b-d253aaa4478f-podres\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.071459 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.071433    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llvff\" (UniqueName: \"kubernetes.io/projected/bc68d70c-fc44-44ce-a81b-d253aaa4478f-kube-api-access-llvff\") pod \"perf-node-gather-daemonset-55sj9\" (UID: \"bc68d70c-fc44-44ce-a81b-d253aaa4478f\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.239263 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.239154    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:21.369452 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.369425    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"]
May 21 19:57:21.372216 ip-10-0-143-158 kubenswrapper[2561]: W0521 19:57:21.372167    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc68d70c_fc44_44ce_a81b_d253aaa4478f.slice/crio-0886f7983efd2f101ae7ccac89f5425e7233fbb4a0465b1427406da2404bb171 WatchSource:0}: Error finding container 0886f7983efd2f101ae7ccac89f5425e7233fbb4a0465b1427406da2404bb171: Status 404 returned error can't find the container with id 0886f7983efd2f101ae7ccac89f5425e7233fbb4a0465b1427406da2404bb171
May 21 19:57:21.373838 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.373820    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 19:57:21.954628 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.954603    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-548cf866cc-4b96p_a1985c33-6915-4d48-be74-806621735add/console/0.log"
May 21 19:57:21.986693 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:21.986670    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-hvjx7_3f42c3cf-0fb7-4da2-ac10-d5f3e113b904/download-server/0.log"
May 21 19:57:22.330268 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:22.330237    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9" event={"ID":"bc68d70c-fc44-44ce-a81b-d253aaa4478f","Type":"ContainerStarted","Data":"fe6fa4172b5443ce8ec958ddc38ce27357f0c43e13dcbdb8d9b0e7ce5c7d6568"}
May 21 19:57:22.330268 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:22.330273    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9" event={"ID":"bc68d70c-fc44-44ce-a81b-d253aaa4478f","Type":"ContainerStarted","Data":"0886f7983efd2f101ae7ccac89f5425e7233fbb4a0465b1427406da2404bb171"}
May 21 19:57:22.330460 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:22.330347    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:22.352585 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:22.352543    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9" podStartSLOduration=2.35252852 podStartE2EDuration="2.35252852s" podCreationTimestamp="2026-05-21 19:57:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:57:22.349563526 +0000 UTC m=+2126.856968714" watchObservedRunningTime="2026-05-21 19:57:22.35252852 +0000 UTC m=+2126.859933708"
May 21 19:57:23.266532 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:23.266504    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64qpw_520cea0e-088e-460b-930c-012ed5487f7f/dns/0.log"
May 21 19:57:23.288894 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:23.288859    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64qpw_520cea0e-088e-460b-930c-012ed5487f7f/kube-rbac-proxy/0.log"
May 21 19:57:23.451759 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:23.451725    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fdkxx_94e87198-ccf9-4a1b-a75f-07438394dd10/dns-node-resolver/0.log"
May 21 19:57:24.073525 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:24.073496    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t9srw_e0d007d9-cf16-45c8-a6f7-1194d5c660aa/node-ca/0.log"
May 21 19:57:25.000317 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:25.000285    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b924fs_31eec800-d04a-4f7f-89a5-e4ea0422226f/istio-proxy/0.log"
May 21 19:57:25.256509 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:25.256435    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-mbr6z_01fb1000-41a7-4171-84ee-5b2866f2cd04/istio-proxy/0.log"
May 21 19:57:25.916625 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:25.916597    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fn4fh_192cef57-4be2-4056-9a51-a31a91246de7/serve-healthcheck-canary/0.log"
May 21 19:57:26.501172 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:26.501127    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jl84v_bc4ddda3-4f1b-4f5f-a146-b8898c564833/kube-rbac-proxy/0.log"
May 21 19:57:26.524781 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:26.524759    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jl84v_bc4ddda3-4f1b-4f5f-a146-b8898c564833/exporter/0.log"
May 21 19:57:26.547379 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:26.547359    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jl84v_bc4ddda3-4f1b-4f5f-a146-b8898c564833/extractor/0.log"
May 21 19:57:28.343237 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:28.343199    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-55sj9"
May 21 19:57:28.652290 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:28.652214    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-965f45468-4wm8k_eb7b17b4-897a-4c94-9bb3-9f55e0f26eaa/manager/0.log"
May 21 19:57:28.799826 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:28.799798    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b454b5c58-vwtqb_4494c501-92dd-4d7e-959c-c82fc3a36d8c/manager/0.log"
May 21 19:57:30.141865 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:30.141840    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-88b567ddf-5bqj2_4fb4848f-d36e-49da-b93d-70e976d8cb22/manager/0.log"
May 21 19:57:34.787363 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:34.787334    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-klqmk_26281d1b-f031-47c1-8dd9-2eb2efc22388/migrator/0.log"
May 21 19:57:34.810332 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:34.810303    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-klqmk_26281d1b-f031-47c1-8dd9-2eb2efc22388/graceful-termination/0.log"
May 21 19:57:36.456738 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.456663    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttr6s_e87343e5-2e9b-417a-bec0-31a01060f9fe/kube-multus-additional-cni-plugins/0.log"
May 21 19:57:36.481100 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.481072    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttr6s_e87343e5-2e9b-417a-bec0-31a01060f9fe/egress-router-binary-copy/0.log"
May 21 19:57:36.504604 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.504579    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttr6s_e87343e5-2e9b-417a-bec0-31a01060f9fe/cni-plugins/0.log"
May 21 19:57:36.525652 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.525633    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttr6s_e87343e5-2e9b-417a-bec0-31a01060f9fe/bond-cni-plugin/0.log"
May 21 19:57:36.550948 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.550928    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttr6s_e87343e5-2e9b-417a-bec0-31a01060f9fe/routeoverride-cni/0.log"
May 21 19:57:36.573041 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.573018    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttr6s_e87343e5-2e9b-417a-bec0-31a01060f9fe/whereabouts-cni-bincopy/0.log"
May 21 19:57:36.595568 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.595548    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttr6s_e87343e5-2e9b-417a-bec0-31a01060f9fe/whereabouts-cni/0.log"
May 21 19:57:36.823388 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.823364    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xvfcl_436f4980-65b4-4e97-977a-c528d1e457c0/kube-multus/0.log"
May 21 19:57:36.896440 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.896416    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x8nv7_e3d90a5c-0097-4291-963e-4e74460ff759/network-metrics-daemon/0.log"
May 21 19:57:36.919891 ip-10-0-143-158 kubenswrapper[2561]: I0521 19:57:36.919852    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x8nv7_e3d90a5c-0097-4291-963e-4e74460ff759/kube-rbac-proxy/0.log"