May 26 21:44:47.426090 ip-10-0-140-172 systemd[1]: Starting Kubernetes Kubelet...
May 26 21:44:47.797272 ip-10-0-140-172 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 21:44:47.797272 ip-10-0-140-172 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 21:44:47.797272 ip-10-0-140-172 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 21:44:47.797272 ip-10-0-140-172 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 21:44:47.797272 ip-10-0-140-172 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 21:44:47.800161 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.800068    2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 21:44:47.804885 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804865    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:44:47.804885 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804882    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:44:47.804885 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804887    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:44:47.804885 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804891    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804895    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804899    2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804903    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804907    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804910    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804914    2555 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804917    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804921    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804925    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804929    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804934    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804946    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804950    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804954    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804958    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804962    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804966    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804970    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804974    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:44:47.805134 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804979    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804983    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804987    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804991    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804995    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.804999    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805010    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805014    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805019    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805023    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805028    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805032    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805036    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805040    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805046    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805051    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805055    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805059    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805063    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805068    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:44:47.805909 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805072    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805076    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805080    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805084    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805089    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805094    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805098    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805105    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805109    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805113    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805118    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805122    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805126    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805132    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805139    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805144    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805149    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805152    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805157    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805161    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:44:47.806611 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805165    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805170    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805174    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805179    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805183    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805187    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805191    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805195    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805200    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805204    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805208    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805213    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805217    2555 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805222    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805226    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805230    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805237    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805241    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805247    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805251    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:44:47.807115 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805256    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805263    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.805268    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807173    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807185    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807203    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807206    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807210    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807214    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807216    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807221    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807225    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807228    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807231    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807234    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807236    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807239    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807242    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807245    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:44:47.807594 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807248    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807251    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807254    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807257    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807260    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807262    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807265    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807268    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807271    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807274    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807276    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807279    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807281    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807284    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807286    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807289    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807292    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807295    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807298    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:44:47.808064 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807300    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807304    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807308    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807311    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807314    2555 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807317    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807320    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807322    2555 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807325    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807327    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807330    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807332    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807335    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807338    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807340    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807343    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807345    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807348    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807350    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807353    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:44:47.808585 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807356    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807359    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807362    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807364    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807366    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807369    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807372    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807374    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807377    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807380    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807383    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807386    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807388    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807391    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807393    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807396    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807399    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807401    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807404    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807406    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:44:47.809100 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807409    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807411    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807414    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807416    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807419    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807421    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807424    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807428    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807431    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807434    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.807437    2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808161    2555 flags.go:64] FLAG: --address="0.0.0.0"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808170    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808176    2555 flags.go:64] FLAG: --anonymous-auth="true"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808181    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808185    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808189    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808193    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808198    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808201    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808204    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 21:44:47.809597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808208    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808214    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808218    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808221    2555 flags.go:64] FLAG: --cgroup-root=""
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808224    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808227    2555 flags.go:64] FLAG: --client-ca-file=""
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808230    2555 flags.go:64] FLAG: --cloud-config=""
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808233    2555 flags.go:64] FLAG: --cloud-provider="external"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808236    2555 flags.go:64] FLAG: --cluster-dns="[]"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808241    2555 flags.go:64] FLAG: --cluster-domain=""
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808244    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808247    2555 flags.go:64] FLAG: --config-dir=""
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808250    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808254    2555 flags.go:64] FLAG: --container-log-max-files="5"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808258    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808261    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808264    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808268    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808271    2555 flags.go:64] FLAG: --contention-profiling="false"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808274    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808277    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808280    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808283    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808287    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808290    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 21:44:47.810115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808293    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808296    2555 flags.go:64] FLAG: --enable-load-reader="false"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808299    2555 flags.go:64] FLAG: --enable-server="true"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808302    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808306    2555 flags.go:64] FLAG: --event-burst="100"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808309    2555 flags.go:64] FLAG: --event-qps="50"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808312    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808315    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808320    2555 flags.go:64] FLAG: --eviction-hard=""
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808324    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808327    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808330    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808334    2555 flags.go:64] FLAG: --eviction-soft=""
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808337    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808339    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808342    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808345    2555 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808348    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808351    2555 flags.go:64] FLAG: --fail-swap-on="true"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808354    2555 flags.go:64] FLAG: --feature-gates=""
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808357    2555 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808360    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808364    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808367    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808370    2555 flags.go:64] FLAG: --healthz-port="10248"
May 26 21:44:47.810705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808373    2555 flags.go:64] FLAG: --help="false"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808376    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-140-172.ec2.internal"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808379    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808382    2555 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808385    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808389    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808392    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808395    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808398    2555 flags.go:64] FLAG: --image-service-endpoint=""
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808401    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808404    2555 flags.go:64] FLAG: --kube-api-burst="100"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808407    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808410    2555 flags.go:64] FLAG: --kube-api-qps="50"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808413    2555 flags.go:64] FLAG: --kube-reserved=""
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808415    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808421    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808424    2555 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808427    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808430    2555 flags.go:64] FLAG: --lock-file=""
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808432    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808448    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808452    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808458    2555 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 21:44:47.811310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808461    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808464    2555 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808467    2555 flags.go:64] FLAG: --logging-format="text"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808470    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808474    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808476    2555 flags.go:64] FLAG: --manifest-url=""
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808479    2555 flags.go:64] FLAG: --manifest-url-header=""
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808484    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808487    2555 flags.go:64] FLAG: --max-open-files="1000000"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808491    2555 flags.go:64] FLAG: --max-pods="110"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808495    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808498    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808501    2555 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808504    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808507    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808510    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808513    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808520    2555 flags.go:64] FLAG: --node-status-max-images="50"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808523    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808526    2555 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808529    2555 flags.go:64] FLAG: --pod-cidr=""
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808532    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808538    2555 flags.go:64] FLAG: --pod-manifest-path=""
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808541    2555 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 21:44:47.811879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808546    2555 flags.go:64] FLAG: --pods-per-core="0"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808549    2555 flags.go:64] FLAG: --port="10250"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808552    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808555    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e9453220abda871e"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808558    2555 flags.go:64] FLAG: --qos-reserved=""
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808561    2555 flags.go:64] FLAG: --read-only-port="10255"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808564    2555 flags.go:64] FLAG: --register-node="true"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808567    2555 flags.go:64] FLAG: --register-schedulable="true"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808570    2555 flags.go:64] FLAG: --register-with-taints=""
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808574    2555 flags.go:64] FLAG: --registry-burst="10"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808577    2555 flags.go:64] FLAG: --registry-qps="5"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808580    2555 flags.go:64] FLAG: --reserved-cpus=""
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808582    2555 flags.go:64] FLAG: --reserved-memory=""
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808586    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808590    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808593    2555 flags.go:64] FLAG: --rotate-certificates="false"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808597    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808600    2555 flags.go:64] FLAG: --runonce="false"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808603    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808606    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808608    2555 flags.go:64] FLAG: --seccomp-default="false"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808611    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808615    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808618    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808621    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808625    2555 flags.go:64] FLAG: --storage-driver-password="root"
May 26 21:44:47.812452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808628    2555 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808631    2555 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808634    2555 flags.go:64] FLAG: --storage-driver-user="root"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808637    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808640    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808643    2555 flags.go:64] FLAG: --system-cgroups=""
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808647    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808653    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808656    2555 flags.go:64] FLAG: --tls-cert-file=""
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808658    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808663    2555 flags.go:64] FLAG: --tls-min-version=""
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808666    2555 flags.go:64] FLAG: --tls-private-key-file=""
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808669    2555 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808672    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808675    2555 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808678    2555 flags.go:64] FLAG: --v="2"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808682    2555 flags.go:64] FLAG: --version="false"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808686    2555 flags.go:64] FLAG: --vmodule=""
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808691    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.808694    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808796    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808801    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808805    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808811    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:44:47.813123 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808825    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808829    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808832    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808834    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808838    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808840    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808843    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808846    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808848    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808851    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808855    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808859    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808862    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808865    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808867    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808872    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808875    2555 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808877    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808880    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:44:47.813711 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808883    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808885    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808888    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808890    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808893    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808895    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808898    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808900    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808903    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808905    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808908    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808911    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808913    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808917    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808919    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808922    2555 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808924    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808930    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808933    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808935    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:44:47.814199 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808938    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808940    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808945    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808948    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808951    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808954    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808956    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808959    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808962    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808965    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808967    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808970    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808973    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808975    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808978    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808980    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808983    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808986    2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808988    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:44:47.814721 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808991    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808994    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.808997    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809000    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809009    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809013    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809015    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809019    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809022    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809025    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809028    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809031    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809034    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809036    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809039    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809041    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809044    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809047    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809050    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809052    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:44:47.815202 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809055    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:44:47.815675 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809059    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:44:47.815675 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809062    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:44:47.815675 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.809064    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:44:47.815675 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.809729    2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 21:44:47.815871 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.815854    2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 21:44:47.815906 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.815872    2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 21:44:47.815936 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815922    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:44:47.815936 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815927    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:44:47.815936 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815931    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:44:47.815936 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815935    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:44:47.815936 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815938    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815941    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815944    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815947    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815949    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815952    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815955    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815957    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815961    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815965    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815968    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815971    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815974    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815976    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815979    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815982    2555 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815985    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815988    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815990    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815992    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:44:47.816063 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815995    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.815998    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816000    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816003    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816005    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816008    2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816011    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816014    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816017    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816019    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816022    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816024    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816027    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816029    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816033    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816036    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816039    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816041    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816044    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816047    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:44:47.816557 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816049    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816052    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816054    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816057    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816059    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816062    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816065    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816069    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816074    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816077    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816080    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816083    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816086    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816088    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816091    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816094    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816097    2555 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816099    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816102    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:44:47.817113 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816104    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816108    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816111    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816113    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816116    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816119    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816121    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816124    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816127    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816130    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816132    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816135    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816138    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816140    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816143    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816145    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816148    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816151    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816153    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:44:47.817562 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816156    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816158    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816161    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816164    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.816169    2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816280    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816285    2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816288    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816291    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816295    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816298    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816300    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816303    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816306    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816309    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:44:47.818133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816312    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816315    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816318    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816320    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816323    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816326    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816329    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816332    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816335    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816337    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816340    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816343    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816345    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816348    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816350    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816353    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816355    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816358    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816360    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816362    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:44:47.818505 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816365    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816367    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816370    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816373    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816375    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816378    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816381    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816383    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816386    2555 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816388    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816391    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816393    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816396    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816400    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816402    2555 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816405    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816408    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816411    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816414    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816416    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:44:47.819006 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816419    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816421    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816424    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816426    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816430    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816432    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816435    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816438    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816440    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816444    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816448    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816452    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816455    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816458    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816461    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816464    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816467    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816470    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816473    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:44:47.819489 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816475    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816478    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816481    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816484    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816487    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816490    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816492    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816495    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816498    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816501    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816503    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816506    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816508    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816511    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816514    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816516    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:44:47.819960 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:47.816519    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:44:47.820369 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.816523    2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 21:44:47.820369 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.817202    2555 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 21:44:47.822246 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.822232    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 21:44:47.823011 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.822999    2555 server.go:1019] "Starting client certificate rotation"
May 26 21:44:47.823115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.823098    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 21:44:47.823155 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.823135    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 21:44:47.844072 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.844053    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 21:44:47.845673 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.845658    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 21:44:47.858422 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.858404    2555 log.go:25] "Validated CRI v1 runtime API"
May 26 21:44:47.863303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.863286    2555 log.go:25] "Validated CRI v1 image API"
May 26 21:44:47.865573 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.865556    2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 21:44:47.868854 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.868833    2555 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e264b84b-04d6-4628-b52d-322653bcdacc:/dev/nvme0n1p4 e59db6df-fbd9-4009-84e5-305b9d3f3a14:/dev/nvme0n1p3]
May 26 21:44:47.868904 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.868854    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 21:44:47.873037 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.872918    2555 manager.go:217] Machine: {Timestamp:2026-05-26 21:44:47.872412807 +0000 UTC m=+0.343641462 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100670 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2862059d43812d0f326138cff969be SystemUUID:ec286205-9d43-812d-0f32-6138cff969be BootID:bfe839f0-4a2b-4336-8290-b0a460560e52 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f0:36:4f:1d:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f0:36:4f:1d:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:7c:b5:9d:58:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 21:44:47.874127 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.874114    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 21:44:47.874213 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.874200    2555 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 21:44:47.875738 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.875714    2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 21:44:47.875906 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.875739    2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-172.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 21:44:47.875997 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.875921    2555 topology_manager.go:138] "Creating topology manager with none policy"
May 26 21:44:47.875997 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.875934    2555 container_manager_linux.go:306] "Creating device plugin manager"
May 26 21:44:47.875997 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.875944    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 21:44:47.876518 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.876503    2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 21:44:47.876585 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.876573    2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 21:44:47.877970 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.877958    2555 state_mem.go:36] "Initialized new in-memory state store"
May 26 21:44:47.878096 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.878085    2555 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 21:44:47.880075 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.880064    2555 kubelet.go:491] "Attempting to sync node with API server"
May 26 21:44:47.880136 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.880081    2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 21:44:47.880136 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.880097    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 21:44:47.880136 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.880110    2555 kubelet.go:397] "Adding apiserver pod source"
May 26 21:44:47.880136 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.880123    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 21:44:47.881129 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.881115    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 21:44:47.881204 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.881139    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 21:44:47.883883 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.883861    2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 21:44:47.885669 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.885656    2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 21:44:47.887417 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887404    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 21:44:47.887458 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887423    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 21:44:47.887458 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887430    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 21:44:47.887458 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887435    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 21:44:47.887458 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887446    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 21:44:47.887458 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887455    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 21:44:47.887601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887463    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 21:44:47.887601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887469    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 21:44:47.887601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887478    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 21:44:47.887601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887484    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 21:44:47.887601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887498    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 21:44:47.887601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.887504    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 21:44:47.888240 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.888223    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 21:44:47.888240 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.888236    2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 21:44:47.891326 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.891312    2555 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 21:44:47.891370 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.891349    2555 server.go:1295] "Started kubelet"
May 26 21:44:47.891419 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.891390    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 21:44:47.891529 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.891480    2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 21:44:47.891572 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.891552    2555 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 21:44:47.892244 ip-10-0-140-172 systemd[1]: Started Kubernetes Kubelet.
May 26 21:44:47.894333 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.894312    2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 21:44:47.894478 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.894463    2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-172.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 21:44:47.894816 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.894761    2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 21:44:47.894951 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.894929    2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 21:44:47.897048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.897029    2555 server.go:317] "Adding debug handlers to kubelet server"
May 26 21:44:47.900642 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.900623    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 21:44:47.900766 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.900028    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-172.ec2.internal.18b33bac0dace5b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-172.ec2.internal,UID:ip-10-0-140-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-172.ec2.internal,},FirstTimestamp:2026-05-26 21:44:47.891326388 +0000 UTC m=+0.362555042,LastTimestamp:2026-05-26 21:44:47.891326388 +0000 UTC m=+0.362555042,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-172.ec2.internal,}"
May 26 21:44:47.901067 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901043    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 21:44:47.901146 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.901060    2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 21:44:47.901146 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901097    2555 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 21:44:47.901146 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901106    2555 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 21:44:47.901269 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901198    2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 21:44:47.901269 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901242    2555 reconstruct.go:97] "Volume reconstruction finished"
May 26 21:44:47.901269 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901250    2555 reconciler.go:26] "Reconciler: start to sync state"
May 26 21:44:47.901682 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901658    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 21:44:47.901768 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901686    2555 factory.go:55] Registering systemd factory
May 26 21:44:47.901768 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901697    2555 factory.go:223] Registration of the systemd container factory successfully
May 26 21:44:47.901927 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901915    2555 factory.go:153] Registering CRI-O factory
May 26 21:44:47.901974 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901938    2555 factory.go:223] Registration of the crio container factory successfully
May 26 21:44:47.901974 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901954    2555 factory.go:103] Registering Raw factory
May 26 21:44:47.901974 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.901968    2555 manager.go:1196] Started watching for new ooms in manager
May 26 21:44:47.901974 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.901968    2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:47.902995 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.902961    2555 manager.go:319] Starting recovery of all containers
May 26 21:44:47.910747 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.910587    2555 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 21:44:47.910747 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.910665    2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 21:44:47.912971 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.912950    2555 manager.go:324] Recovery completed
May 26 21:44:47.917079 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.917067    2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 21:44:47.918982 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.918959    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientMemory"
May 26 21:44:47.919042 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.918994    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasNoDiskPressure"
May 26 21:44:47.919042 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.919004    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientPID"
May 26 21:44:47.919482 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.919466    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 21:44:47.919482 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.919480    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 21:44:47.919570 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.919495    2555 state_mem.go:36] "Initialized new in-memory state store"
May 26 21:44:47.921036 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.920971    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-172.ec2.internal.18b33bac0f52df8b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-172.ec2.internal,UID:ip-10-0-140-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-172.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-172.ec2.internal,},FirstTimestamp:2026-05-26 21:44:47.918981003 +0000 UTC m=+0.390209656,LastTimestamp:2026-05-26 21:44:47.918981003 +0000 UTC m=+0.390209656,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-172.ec2.internal,}"
May 26 21:44:47.921714 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.921703    2555 policy_none.go:49] "None policy: Start"
May 26 21:44:47.921750 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.921720    2555 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 21:44:47.921750 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.921730    2555 state_mem.go:35] "Initializing new in-memory state store"
May 26 21:44:47.933196 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.933132    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-172.ec2.internal.18b33bac0f532593  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-172.ec2.internal,UID:ip-10-0-140-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-172.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-172.ec2.internal,},FirstTimestamp:2026-05-26 21:44:47.918998931 +0000 UTC m=+0.390227584,LastTimestamp:2026-05-26 21:44:47.918998931 +0000 UTC m=+0.390227584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-172.ec2.internal,}"
May 26 21:44:47.935591 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.935575    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tgwcx"
May 26 21:44:47.943180 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.943159    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tgwcx"
May 26 21:44:47.944849 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.944755    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-172.ec2.internal.18b33bac0f53486b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-172.ec2.internal,UID:ip-10-0-140-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-172.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-172.ec2.internal,},FirstTimestamp:2026-05-26 21:44:47.919007851 +0000 UTC m=+0.390236507,LastTimestamp:2026-05-26 21:44:47.919007851 +0000 UTC m=+0.390236507,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-172.ec2.internal,}"
May 26 21:44:47.954949 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.954823    2555 manager.go:341] "Starting Device Plugin manager"
May 26 21:44:47.954949 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.954858    2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 21:44:47.954949 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.954871    2555 server.go:85] "Starting device plugin registration server"
May 26 21:44:47.978660 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.955108    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 21:44:47.978660 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.955121    2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 21:44:47.978660 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.955207    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 21:44:47.978660 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.955280    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 21:44:47.978660 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:47.955289    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 21:44:47.978660 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.955900    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 21:44:47.978660 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:47.955934    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.033763 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.033725    2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 21:44:48.034901 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.034880    2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 21:44:48.035007 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.034908    2555 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 21:44:48.035007 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.034927    2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 21:44:48.035007 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.034935    2555 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 21:44:48.035007 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.034971    2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 21:44:48.040360 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.040340    2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:44:48.056086 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.056049    2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 21:44:48.056853 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.056833    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientMemory"
May 26 21:44:48.056930 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.056860    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasNoDiskPressure"
May 26 21:44:48.056930 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.056873    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientPID"
May 26 21:44:48.056930 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.056908    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-172.ec2.internal"
May 26 21:44:48.065296 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.065279    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-172.ec2.internal"
May 26 21:44:48.065339 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.065298    2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-172.ec2.internal\": node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.076907 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.076891    2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.135087 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.135063    2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal"]
May 26 21:44:48.135157 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.135121    2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 21:44:48.136725 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.136709    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientMemory"
May 26 21:44:48.136771 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.136737    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasNoDiskPressure"
May 26 21:44:48.136771 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.136748    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientPID"
May 26 21:44:48.138031 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.138020    2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 21:44:48.138215 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.138184    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.138254 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.138245    2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 21:44:48.138636 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.138619    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientMemory"
May 26 21:44:48.138636 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.138643    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasNoDiskPressure"
May 26 21:44:48.138763 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.138653    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientPID"
May 26 21:44:48.139680 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.139658    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientMemory"
May 26 21:44:48.139760 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.139690    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasNoDiskPressure"
May 26 21:44:48.139760 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.139704    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientPID"
May 26 21:44:48.140090 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.140073    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.140171 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.140101    2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 21:44:48.140720 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.140702    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientMemory"
May 26 21:44:48.140832 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.140733    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasNoDiskPressure"
May 26 21:44:48.140832 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.140749    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeHasSufficientPID"
May 26 21:44:48.163328 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.163303    2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-172.ec2.internal\" not found" node="ip-10-0-140-172.ec2.internal"
May 26 21:44:48.167458 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.167440    2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-172.ec2.internal\" not found" node="ip-10-0-140-172.ec2.internal"
May 26 21:44:48.177719 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.177701    2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.203878 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.203864    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/943f6c18ce8f2f93d108e18ae3a86146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal\" (UID: \"943f6c18ce8f2f93d108e18ae3a86146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.203943 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.203888    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/943f6c18ce8f2f93d108e18ae3a86146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal\" (UID: \"943f6c18ce8f2f93d108e18ae3a86146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.203943 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.203906    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/956416fc4c5f5837bf8911f355eda4b7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-172.ec2.internal\" (UID: \"956416fc4c5f5837bf8911f355eda4b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.278230 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.278212    2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.304584 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.304568    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/943f6c18ce8f2f93d108e18ae3a86146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal\" (UID: \"943f6c18ce8f2f93d108e18ae3a86146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.304657 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.304593    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/943f6c18ce8f2f93d108e18ae3a86146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal\" (UID: \"943f6c18ce8f2f93d108e18ae3a86146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.304657 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.304611    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/956416fc4c5f5837bf8911f355eda4b7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-172.ec2.internal\" (UID: \"956416fc4c5f5837bf8911f355eda4b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.304657 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.304647    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/956416fc4c5f5837bf8911f355eda4b7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-172.ec2.internal\" (UID: \"956416fc4c5f5837bf8911f355eda4b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.304751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.304679    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/943f6c18ce8f2f93d108e18ae3a86146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal\" (UID: \"943f6c18ce8f2f93d108e18ae3a86146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.304751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.304679    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/943f6c18ce8f2f93d108e18ae3a86146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal\" (UID: \"943f6c18ce8f2f93d108e18ae3a86146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.378927 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.378842    2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.466528 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.466477    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.470170 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.470157    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.479771 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.479752    2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.580239 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.580206    2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.680736 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.680670    2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.780834 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.780806    2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-172.ec2.internal\" not found"
May 26 21:44:48.780979 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.780861    2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:44:48.801811 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.801771    2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.814446 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.814428    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 21:44:48.815848 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.815835    2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal"
May 26 21:44:48.821766 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.821754    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 21:44:48.822851 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.822838    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 21:44:48.822986 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.822970    2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 21:44:48.823036 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.822997    2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 21:44:48.881174 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.881152    2555 apiserver.go:52] "Watching apiserver"
May 26 21:44:48.897986 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.897965    2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 21:44:48.900264 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.900241    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-z8x82","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-66skj","openshift-cluster-node-tuning-operator/tuned-88lzm","openshift-dns/node-resolver-lrpn5","openshift-multus/multus-additional-cni-plugins-llsb5","openshift-multus/multus-jq92z","openshift-multus/network-metrics-daemon-2hnq5","openshift-network-diagnostics/network-check-target-vxxnf","openshift-network-operator/iptables-alerter-rdq98","kube-system/konnectivity-agent-9lgfv","kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"]
May 26 21:44:48.900753 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.900732    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 21:44:48.902710 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.902691    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:48.904709 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.904695    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 21:44:48.904779 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.904723    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 21:44:48.904981 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.904949    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 21:44:48.905072 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.905059    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:48.905125 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.905115    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g6vz7\""
May 26 21:44:48.907896 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.907868    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 21:44:48.907993 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.907929    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 21:44:48.907993 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.907987    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 21:44:48.908205 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.908172    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd64cdb9-323e-45e7-90b7-dce5d0bbba90-host\") pod \"node-ca-z8x82\" (UID: \"fd64cdb9-323e-45e7-90b7-dce5d0bbba90\") " pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:48.908293 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.908212    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd64cdb9-323e-45e7-90b7-dce5d0bbba90-serviceca\") pod \"node-ca-z8x82\" (UID: \"fd64cdb9-323e-45e7-90b7-dce5d0bbba90\") " pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:48.908293 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.908236    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 21:44:48.908293 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.908244    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbjzl\" (UniqueName: \"kubernetes.io/projected/fd64cdb9-323e-45e7-90b7-dce5d0bbba90-kube-api-access-kbjzl\") pod \"node-ca-z8x82\" (UID: \"fd64cdb9-323e-45e7-90b7-dce5d0bbba90\") " pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:48.908293 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.908236    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 21:44:48.908539 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.908525    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 21:44:48.908603 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.908556    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jvdhb\""
May 26 21:44:48.910935 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.910384    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:48.912180 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.912155    2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 21:44:48.914225 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.914206    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:48.914324 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.914305    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:48.914619 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.914433    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 21:44:48.914702 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.914687    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 21:44:48.914865 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.914824    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tsqcc\""
May 26 21:44:48.916320 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.916299    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jq92z"
May 26 21:44:48.916408 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.916398    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rrcbv\""
May 26 21:44:48.916694 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.916674    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 21:44:48.916812 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.916713    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 21:44:48.916812 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.916746    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 21:44:48.917148 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.917132    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kr5xw\""
May 26 21:44:48.917338 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.917326    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 21:44:48.917866 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.917853    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 21:44:48.918410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.918397    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:48.918477 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.918461    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:44:48.920411 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.920399    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:48.920454 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:48.920442    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:44:48.922473 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.922457    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:48.924563 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.924544    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:44:48.926938 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.926918    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:48.945960 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.945896    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 21:39:47 +0000 UTC" deadline="2028-01-08 04:51:41.094697142 +0000 UTC"
May 26 21:44:48.945960 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.945924    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14191h6m52.14877555s"
May 26 21:44:48.946800 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.946771    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 21:44:48.946890 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.946813    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 21:44:48.950247 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.950228    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gkqkk"
May 26 21:44:48.950353 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.950277    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 21:44:48.950418 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.950363    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-86wbn\""
May 26 21:44:48.950418 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.950363    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 21:44:48.950418 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.950395    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 21:44:48.950418 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.950385    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 21:44:48.950669 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.950657    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 21:44:48.955421 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.955405    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 21:44:48.955514 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.955483    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nk85c\""
May 26 21:44:48.956370 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.956353    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rsh8x\""
May 26 21:44:48.956954 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.956936    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 21:44:48.957912 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.957894    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 21:44:48.958008 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.957973    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 21:44:48.958064 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.958007    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s7gzh\""
May 26 21:44:48.963019 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:48.963003    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gkqkk"
May 26 21:44:49.002869 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.002853    2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 21:44:49.008493 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008470    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-ovnkube-script-lib\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.008580 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008498    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqg5h\" (UniqueName: \"kubernetes.io/projected/5ea3ce4c-4326-4a27-b660-bfba85954044-kube-api-access-rqg5h\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.008580 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008520    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbjzl\" (UniqueName: \"kubernetes.io/projected/fd64cdb9-323e-45e7-90b7-dce5d0bbba90-kube-api-access-kbjzl\") pod \"node-ca-z8x82\" (UID: \"fd64cdb9-323e-45e7-90b7-dce5d0bbba90\") " pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:49.008580 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008548    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.008580 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008571    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-run-openvswitch\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.008705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008597    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.008705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008621    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-system-cni-dir\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.008705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008647    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-os-release\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.008705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008691    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-var-lib-cni-bin\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.008907 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008729    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-device-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.008907 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008760    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-run\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.008907 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008848    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-lib-modules\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.008907 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008873    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-var-lib-kubelet\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.008907 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008890    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bedbab1-b03a-4449-9f46-1e8ff5fa26ea-hosts-file\") pod \"node-resolver-lrpn5\" (UID: \"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea\") " pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.009108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008911    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.009108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008933    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-run-netns\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.009108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008950    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-var-lib-kubelet\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.009108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008964    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-systemd-units\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008977    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-cni-bin\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.008996    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2wpx\" (UniqueName: \"kubernetes.io/projected/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-kube-api-access-g2wpx\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009043    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-kubernetes\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.009108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009075    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-conf-dir\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009101    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6q8c\" (UniqueName: \"kubernetes.io/projected/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-kube-api-access-q6q8c\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009135    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-var-lib-openvswitch\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009158    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-cni-netd\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009200    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-os-release\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009232    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd760116-fdd6-4a2c-a33b-918cb49d4182-iptables-alerter-script\") pod \"iptables-alerter-rdq98\" (UID: \"cd760116-fdd6-4a2c-a33b-918cb49d4182\") " pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009266    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd760116-fdd6-4a2c-a33b-918cb49d4182-host-slash\") pod \"iptables-alerter-rdq98\" (UID: \"cd760116-fdd6-4a2c-a33b-918cb49d4182\") " pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009297    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f94aabbd-91e7-496f-ba8c-91c5e75b65a2-konnectivity-ca\") pod \"konnectivity-agent-9lgfv\" (UID: \"f94aabbd-91e7-496f-ba8c-91c5e75b65a2\") " pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009332    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-sys\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009359    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndzxx\" (UniqueName: \"kubernetes.io/projected/d03c3de9-2085-4370-bac2-f91be20e9bee-kube-api-access-ndzxx\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009383    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-var-lib-cni-multus\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.009410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009398    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-modprobe-d\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009420    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-host\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009442    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d03c3de9-2085-4370-bac2-f91be20e9bee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009458    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-socket-dir-parent\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009473    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-socket-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009486    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-etc-openvswitch\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009507    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-node-log\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009549    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009581    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-sys-fs\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009621    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-kubelet\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009646    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-cnibin\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009674    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd64cdb9-323e-45e7-90b7-dce5d0bbba90-serviceca\") pod \"node-ca-z8x82\" (UID: \"fd64cdb9-323e-45e7-90b7-dce5d0bbba90\") " pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009698    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009722    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-daemon-config\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009747    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l87l7\" (UniqueName: \"kubernetes.io/projected/cd760116-fdd6-4a2c-a33b-918cb49d4182-kube-api-access-l87l7\") pod \"iptables-alerter-rdq98\" (UID: \"cd760116-fdd6-4a2c-a33b-918cb49d4182\") " pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009773    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-slash\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.009873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009814    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-run-ovn\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009840    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-sysctl-d\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009863    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjnzk\" (UniqueName: \"kubernetes.io/projected/2bedbab1-b03a-4449-9f46-1e8ff5fa26ea-kube-api-access-cjnzk\") pod \"node-resolver-lrpn5\" (UID: \"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea\") " pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009891    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-cni-dir\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009937    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ea3ce4c-4326-4a27-b660-bfba85954044-cni-binary-copy\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009960    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.009986    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd64cdb9-323e-45e7-90b7-dce5d0bbba90-host\") pod \"node-ca-z8x82\" (UID: \"fd64cdb9-323e-45e7-90b7-dce5d0bbba90\") " pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010013    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-run-systemd\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010044    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-ovn-node-metrics-cert\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010065    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd64cdb9-323e-45e7-90b7-dce5d0bbba90-host\") pod \"node-ca-z8x82\" (UID: \"fd64cdb9-323e-45e7-90b7-dce5d0bbba90\") " pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010104    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-systemd\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010133    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-tmp\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010158    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-system-cni-dir\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010185    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d03c3de9-2085-4370-bac2-f91be20e9bee-cni-binary-copy\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010208    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-cnibin\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010230    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-registration-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010253    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-run-netns\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.010601 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010277    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-tuned\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010300    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-run-k8s-cni-cncf-io\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010322    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-etc-kubernetes\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010344    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010370    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd7d4\" (UniqueName: \"kubernetes.io/projected/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-kube-api-access-gd7d4\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010407    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-log-socket\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010430    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-hostroot\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010454    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-run-multus-certs\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010478    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-ovnkube-config\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010499    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-sysconfig\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010512    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-sysctl-conf\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010533    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ghnb\" (UniqueName: \"kubernetes.io/projected/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-kube-api-access-9ghnb\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010553    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bedbab1-b03a-4449-9f46-1e8ff5fa26ea-tmp-dir\") pod \"node-resolver-lrpn5\" (UID: \"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea\") " pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010571    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d03c3de9-2085-4370-bac2-f91be20e9bee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010586    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f94aabbd-91e7-496f-ba8c-91c5e75b65a2-agent-certs\") pod \"konnectivity-agent-9lgfv\" (UID: \"f94aabbd-91e7-496f-ba8c-91c5e75b65a2\") " pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.010603    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-env-overrides\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.011257 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.011149    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd64cdb9-323e-45e7-90b7-dce5d0bbba90-serviceca\") pod \"node-ca-z8x82\" (UID: \"fd64cdb9-323e-45e7-90b7-dce5d0bbba90\") " pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:49.016712 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.016690    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 21:44:49.019591 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.019573    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbjzl\" (UniqueName: \"kubernetes.io/projected/fd64cdb9-323e-45e7-90b7-dce5d0bbba90-kube-api-access-kbjzl\") pod \"node-ca-z8x82\" (UID: \"fd64cdb9-323e-45e7-90b7-dce5d0bbba90\") " pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:49.056737 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.056712    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956416fc4c5f5837bf8911f355eda4b7.slice/crio-3debd57ff3cd28f2b733a3ffbb6e725220c7229c0a600bc14bd3e6d180fb7069 WatchSource:0}: Error finding container 3debd57ff3cd28f2b733a3ffbb6e725220c7229c0a600bc14bd3e6d180fb7069: Status 404 returned error can't find the container with id 3debd57ff3cd28f2b733a3ffbb6e725220c7229c0a600bc14bd3e6d180fb7069
May 26 21:44:49.057057 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.057036    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943f6c18ce8f2f93d108e18ae3a86146.slice/crio-d6a1e4ad06355196f8272a4dd14d16ad13cac850d5a67b22126e0d436a0475af WatchSource:0}: Error finding container d6a1e4ad06355196f8272a4dd14d16ad13cac850d5a67b22126e0d436a0475af: Status 404 returned error can't find the container with id d6a1e4ad06355196f8272a4dd14d16ad13cac850d5a67b22126e0d436a0475af
May 26 21:44:49.062744 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.062723    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 21:44:49.111054 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111019    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-var-lib-kubelet\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.111054 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111053    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-systemd-units\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.111193 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111069    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-cni-bin\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.111193 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111087    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2wpx\" (UniqueName: \"kubernetes.io/projected/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-kube-api-access-g2wpx\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.111193 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111113    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-kubernetes\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.111193 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111123    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-var-lib-kubelet\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.111193 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111141    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-cni-bin\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.111193 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111130    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-systemd-units\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.111381 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111200    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-kubernetes\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.111381 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111238    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-conf-dir\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.111381 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111273    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6q8c\" (UniqueName: \"kubernetes.io/projected/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-kube-api-access-q6q8c\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:49.111381 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111296    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-var-lib-openvswitch\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.111381 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111320    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-cni-netd\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.111381 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111322    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-conf-dir\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.111381 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111353    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-var-lib-openvswitch\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.111381 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111358    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-cni-netd\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111386    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-os-release\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111411    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd760116-fdd6-4a2c-a33b-918cb49d4182-iptables-alerter-script\") pod \"iptables-alerter-rdq98\" (UID: \"cd760116-fdd6-4a2c-a33b-918cb49d4182\") " pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111427    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd760116-fdd6-4a2c-a33b-918cb49d4182-host-slash\") pod \"iptables-alerter-rdq98\" (UID: \"cd760116-fdd6-4a2c-a33b-918cb49d4182\") " pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111455    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f94aabbd-91e7-496f-ba8c-91c5e75b65a2-konnectivity-ca\") pod \"konnectivity-agent-9lgfv\" (UID: \"f94aabbd-91e7-496f-ba8c-91c5e75b65a2\") " pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111464    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-os-release\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111497    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd760116-fdd6-4a2c-a33b-918cb49d4182-host-slash\") pod \"iptables-alerter-rdq98\" (UID: \"cd760116-fdd6-4a2c-a33b-918cb49d4182\") " pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111554    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-sys\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111572    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndzxx\" (UniqueName: \"kubernetes.io/projected/d03c3de9-2085-4370-bac2-f91be20e9bee-kube-api-access-ndzxx\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111589    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-var-lib-cni-multus\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111622    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-var-lib-cni-multus\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111654    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-sys\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.111688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111685    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-modprobe-d\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111709    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-host\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111733    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d03c3de9-2085-4370-bac2-f91be20e9bee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111766    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-socket-dir-parent\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111809    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-socket-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111822    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-host\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111832    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-modprobe-d\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111865    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-etc-openvswitch\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111889    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-socket-dir-parent\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111834    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-etc-openvswitch\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111911    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd760116-fdd6-4a2c-a33b-918cb49d4182-iptables-alerter-script\") pod \"iptables-alerter-rdq98\" (UID: \"cd760116-fdd6-4a2c-a33b-918cb49d4182\") " pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111932    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-node-log\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111957    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111977    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-socket-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111979    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-node-log\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.111981    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-sys-fs\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112023    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-kubelet\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.112209 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112026    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-sys-fs\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112049    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-cnibin\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112220    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112360    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-daemon-config\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112400    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l87l7\" (UniqueName: \"kubernetes.io/projected/cd760116-fdd6-4a2c-a33b-918cb49d4182-kube-api-access-l87l7\") pod \"iptables-alerter-rdq98\" (UID: \"cd760116-fdd6-4a2c-a33b-918cb49d4182\") " pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112432    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-slash\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112454    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f94aabbd-91e7-496f-ba8c-91c5e75b65a2-konnectivity-ca\") pod \"konnectivity-agent-9lgfv\" (UID: \"f94aabbd-91e7-496f-ba8c-91c5e75b65a2\") " pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112463    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-run-ovn\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112506    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-run-ovn\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112513    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-sysctl-d\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112547    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjnzk\" (UniqueName: \"kubernetes.io/projected/2bedbab1-b03a-4449-9f46-1e8ff5fa26ea-kube-api-access-cjnzk\") pod \"node-resolver-lrpn5\" (UID: \"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea\") " pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112639    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-cnibin\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112704    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-sysctl-d\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112711    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d03c3de9-2085-4370-bac2-f91be20e9bee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112767    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-cni-dir\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112854    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ea3ce4c-4326-4a27-b660-bfba85954044-cni-binary-copy\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112898    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:49.112956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112948    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-kubelet\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.112994    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-run-systemd\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113065    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-daemon-config\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113072    2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113036    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-ovn-node-metrics-cert\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113178    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-multus-cni-dir\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113201    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-run-systemd\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.113217    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113230    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-systemd\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113263    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-tmp\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113057    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-slash\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113299    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-system-cni-dir\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113327    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d03c3de9-2085-4370-bac2-f91be20e9bee-cni-binary-copy\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113361    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-cnibin\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.113457    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs podName:6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8 nodeName:}" failed. No retries permitted until 2026-05-26 21:44:49.613377294 +0000 UTC m=+2.084605946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs") pod "network-metrics-daemon-2hnq5" (UID: "6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113486    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-cnibin\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113549    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-system-cni-dir\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113490    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-registration-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.113719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113586    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ea3ce4c-4326-4a27-b660-bfba85954044-cni-binary-copy\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113612    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-run-netns\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113647    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-systemd\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113649    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-tuned\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113702    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-run-k8s-cni-cncf-io\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113866    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-run-k8s-cni-cncf-io\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.113958    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-registration-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114018    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-run-netns\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114027    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114262    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-etc-kubernetes\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114297    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114327    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd7d4\" (UniqueName: \"kubernetes.io/projected/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-kube-api-access-gd7d4\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114353    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-log-socket\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114416    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-etc-kubernetes\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114463    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-hostroot\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114498    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-run-multus-certs\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114501    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-log-socket\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.114553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114553    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-ovnkube-config\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114562    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114579    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-sysconfig\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114604    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-hostroot\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114611    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-sysctl-conf\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114641    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ghnb\" (UniqueName: \"kubernetes.io/projected/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-kube-api-access-9ghnb\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114705    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bedbab1-b03a-4449-9f46-1e8ff5fa26ea-tmp-dir\") pod \"node-resolver-lrpn5\" (UID: \"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea\") " pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114738    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d03c3de9-2085-4370-bac2-f91be20e9bee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114771    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f94aabbd-91e7-496f-ba8c-91c5e75b65a2-agent-certs\") pod \"konnectivity-agent-9lgfv\" (UID: \"f94aabbd-91e7-496f-ba8c-91c5e75b65a2\") " pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114811    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-env-overrides\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114822    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-run-multus-certs\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.114841    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-ovnkube-script-lib\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.115149    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bedbab1-b03a-4449-9f46-1e8ff5fa26ea-tmp-dir\") pod \"node-resolver-lrpn5\" (UID: \"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea\") " pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.115171    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-ovnkube-config\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.115339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.115256    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-sysconfig\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.115970 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.115541    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-env-overrides\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.115970 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.115618    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d03c3de9-2085-4370-bac2-f91be20e9bee-cni-binary-copy\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.116074 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.116060    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-ovnkube-script-lib\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.116119 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.116061    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d03c3de9-2085-4370-bac2-f91be20e9bee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.116503 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.116483    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqg5h\" (UniqueName: \"kubernetes.io/projected/5ea3ce4c-4326-4a27-b660-bfba85954044-kube-api-access-rqg5h\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.116620 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.116597    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-tmp\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.116743 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.116667    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-sysctl-conf\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.116743 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.116702    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.116979 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.116958    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-etc-tuned\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.117093 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117076    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-run-openvswitch\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.117225 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117210    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.117360 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117348    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-system-cni-dir\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.117472 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117460    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-os-release\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.117673 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117111    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.117673 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117112    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-run-openvswitch\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.117673 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117586    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-var-lib-cni-bin\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.117673 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117627    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-var-lib-cni-bin\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.117673 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117644    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-device-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117680    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-run\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117647    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-system-cni-dir\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117713    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-lib-modules\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117724    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-os-release\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117745    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-var-lib-kubelet\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117769    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-run\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117829    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-var-lib-kubelet\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117859    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-device-dir\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117873    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-lib-modules\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117915    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bedbab1-b03a-4449-9f46-1e8ff5fa26ea-hosts-file\") pod \"node-resolver-lrpn5\" (UID: \"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea\") " pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117945    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117629    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.117994    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bedbab1-b03a-4449-9f46-1e8ff5fa26ea-hosts-file\") pod \"node-resolver-lrpn5\" (UID: \"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea\") " pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.118001    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-run-netns\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.118088    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d03c3de9-2085-4370-bac2-f91be20e9bee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.118086    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ea3ce4c-4326-4a27-b660-bfba85954044-host-run-netns\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.118303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.118217    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-ovn-node-metrics-cert\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.118900 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.118881    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f94aabbd-91e7-496f-ba8c-91c5e75b65a2-agent-certs\") pod \"konnectivity-agent-9lgfv\" (UID: \"f94aabbd-91e7-496f-ba8c-91c5e75b65a2\") " pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:44:49.123367 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.123350    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:44:49.123426 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.123373    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:44:49.123426 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.123382    2555 projected.go:194] Error preparing data for projected volume kube-api-access-24xsw for pod openshift-network-diagnostics/network-check-target-vxxnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:49.123512 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.123438    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw podName:6e73fa00-c8fd-4fdc-9de0-d631225ab749 nodeName:}" failed. No retries permitted until 2026-05-26 21:44:49.623424594 +0000 UTC m=+2.094653251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-24xsw" (UniqueName: "kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw") pod "network-check-target-vxxnf" (UID: "6e73fa00-c8fd-4fdc-9de0-d631225ab749") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:49.125879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.125750    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd7d4\" (UniqueName: \"kubernetes.io/projected/d3564ede-0e4a-4abc-bb36-9f46df84ea9f-kube-api-access-gd7d4\") pod \"aws-ebs-csi-driver-node-hvh97\" (UID: \"d3564ede-0e4a-4abc-bb36-9f46df84ea9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.125990 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.125895    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l87l7\" (UniqueName: \"kubernetes.io/projected/cd760116-fdd6-4a2c-a33b-918cb49d4182-kube-api-access-l87l7\") pod \"iptables-alerter-rdq98\" (UID: \"cd760116-fdd6-4a2c-a33b-918cb49d4182\") " pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.125990 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.125955    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjnzk\" (UniqueName: \"kubernetes.io/projected/2bedbab1-b03a-4449-9f46-1e8ff5fa26ea-kube-api-access-cjnzk\") pod \"node-resolver-lrpn5\" (UID: \"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea\") " pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.126277 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.126251    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2wpx\" (UniqueName: \"kubernetes.io/projected/76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c-kube-api-access-g2wpx\") pod \"ovnkube-node-66skj\" (UID: \"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.126526 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.126504    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ghnb\" (UniqueName: \"kubernetes.io/projected/c4122713-9f5d-4f07-bf19-4cb6b3822c8b-kube-api-access-9ghnb\") pod \"tuned-88lzm\" (UID: \"c4122713-9f5d-4f07-bf19-4cb6b3822c8b\") " pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.126605 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.126591    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndzxx\" (UniqueName: \"kubernetes.io/projected/d03c3de9-2085-4370-bac2-f91be20e9bee-kube-api-access-ndzxx\") pod \"multus-additional-cni-plugins-llsb5\" (UID: \"d03c3de9-2085-4370-bac2-f91be20e9bee\") " pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.127030 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.127007    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqg5h\" (UniqueName: \"kubernetes.io/projected/5ea3ce4c-4326-4a27-b660-bfba85954044-kube-api-access-rqg5h\") pod \"multus-jq92z\" (UID: \"5ea3ce4c-4326-4a27-b660-bfba85954044\") " pod="openshift-multus/multus-jq92z"
May 26 21:44:49.128268 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.128253    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6q8c\" (UniqueName: \"kubernetes.io/projected/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-kube-api-access-q6q8c\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:49.226955 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.226899    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z8x82"
May 26 21:44:49.233639 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.233611    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd64cdb9_323e_45e7_90b7_dce5d0bbba90.slice/crio-e20b83b569b86454a427a345f8a62695ff8d5678e92bf5228e2236ce7d29e8b8 WatchSource:0}: Error finding container e20b83b569b86454a427a345f8a62695ff8d5678e92bf5228e2236ce7d29e8b8: Status 404 returned error can't find the container with id e20b83b569b86454a427a345f8a62695ff8d5678e92bf5228e2236ce7d29e8b8
May 26 21:44:49.259734 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.259711    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:44:49.265662 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.265643    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b7a5f0_8a6e_408d_a94b_54fbfcfbfe5c.slice/crio-211753b8fbf097ae8392e8f7f9ffdf41945c77797c2a6cc882e3828dccd641f5 WatchSource:0}: Error finding container 211753b8fbf097ae8392e8f7f9ffdf41945c77797c2a6cc882e3828dccd641f5: Status 404 returned error can't find the container with id 211753b8fbf097ae8392e8f7f9ffdf41945c77797c2a6cc882e3828dccd641f5
May 26 21:44:49.278164 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.278145    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88lzm"
May 26 21:44:49.283216 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.283199    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4122713_9f5d_4f07_bf19_4cb6b3822c8b.slice/crio-1b014181b22af19f0c589ef1c5cbbe894cdad2394c6dcb4f528f61f2c0dc0e58 WatchSource:0}: Error finding container 1b014181b22af19f0c589ef1c5cbbe894cdad2394c6dcb4f528f61f2c0dc0e58: Status 404 returned error can't find the container with id 1b014181b22af19f0c589ef1c5cbbe894cdad2394c6dcb4f528f61f2c0dc0e58
May 26 21:44:49.293128 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.293115    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lrpn5"
May 26 21:44:49.298573 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.298558    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-llsb5"
May 26 21:44:49.300485 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.300454    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bedbab1_b03a_4449_9f46_1e8ff5fa26ea.slice/crio-8b4b06a56f9c5eb0281c63c98fcb95f1ec76b4feb11dbff6c94f0f03cd402d0a WatchSource:0}: Error finding container 8b4b06a56f9c5eb0281c63c98fcb95f1ec76b4feb11dbff6c94f0f03cd402d0a: Status 404 returned error can't find the container with id 8b4b06a56f9c5eb0281c63c98fcb95f1ec76b4feb11dbff6c94f0f03cd402d0a
May 26 21:44:49.305703 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.305683    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03c3de9_2085_4370_bac2_f91be20e9bee.slice/crio-45fd8fa5127e1bb39b0bdf705b6934418b4c391dd2e0a3f7425cd5433a6e5962 WatchSource:0}: Error finding container 45fd8fa5127e1bb39b0bdf705b6934418b4c391dd2e0a3f7425cd5433a6e5962: Status 404 returned error can't find the container with id 45fd8fa5127e1bb39b0bdf705b6934418b4c391dd2e0a3f7425cd5433a6e5962
May 26 21:44:49.320458 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.320440    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jq92z"
May 26 21:44:49.326509 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.326488    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea3ce4c_4326_4a27_b660_bfba85954044.slice/crio-2091a1284b6dd6791444624dbec189e2c1ae6cb89c9851998e5123cdbd30a996 WatchSource:0}: Error finding container 2091a1284b6dd6791444624dbec189e2c1ae6cb89c9851998e5123cdbd30a996: Status 404 returned error can't find the container with id 2091a1284b6dd6791444624dbec189e2c1ae6cb89c9851998e5123cdbd30a996
May 26 21:44:49.331188 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.331172    2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:44:49.343199 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.343185    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rdq98"
May 26 21:44:49.348780 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.348766    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd760116_fdd6_4a2c_a33b_918cb49d4182.slice/crio-8e94a73c168d2d54a414f3eb084024692b679531a97088151ba388e8893c4947 WatchSource:0}: Error finding container 8e94a73c168d2d54a414f3eb084024692b679531a97088151ba388e8893c4947: Status 404 returned error can't find the container with id 8e94a73c168d2d54a414f3eb084024692b679531a97088151ba388e8893c4947
May 26 21:44:49.357959 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.357944    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:44:49.363190 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.363172    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94aabbd_91e7_496f_ba8c_91c5e75b65a2.slice/crio-f2b0649bdf6212d0b8c002ef3015bbe61c559fb9da26f1f101dc8d008047c43b WatchSource:0}: Error finding container f2b0649bdf6212d0b8c002ef3015bbe61c559fb9da26f1f101dc8d008047c43b: Status 404 returned error can't find the container with id f2b0649bdf6212d0b8c002ef3015bbe61c559fb9da26f1f101dc8d008047c43b
May 26 21:44:49.363190 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.363181    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97"
May 26 21:44:49.368665 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:44:49.368646    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3564ede_0e4a_4abc_bb36_9f46df84ea9f.slice/crio-5596f873ea550576a0d1eb0ca9ff1d490bfe5cb90dd4b0087df0cf014ca78691 WatchSource:0}: Error finding container 5596f873ea550576a0d1eb0ca9ff1d490bfe5cb90dd4b0087df0cf014ca78691: Status 404 returned error can't find the container with id 5596f873ea550576a0d1eb0ca9ff1d490bfe5cb90dd4b0087df0cf014ca78691
May 26 21:44:49.620709 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.620630    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:49.620855 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.620733    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:49.620855 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.620803    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs podName:6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8 nodeName:}" failed. No retries permitted until 2026-05-26 21:44:50.620773752 +0000 UTC m=+3.092002395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs") pod "network-metrics-daemon-2hnq5" (UID: "6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:49.721825 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.721190    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:49.721825 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.721371    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:44:49.721825 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.721391    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:44:49.721825 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.721412    2555 projected.go:194] Error preparing data for projected volume kube-api-access-24xsw for pod openshift-network-diagnostics/network-check-target-vxxnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:49.721825 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:49.721471    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw podName:6e73fa00-c8fd-4fdc-9de0-d631225ab749 nodeName:}" failed. No retries permitted until 2026-05-26 21:44:50.721453002 +0000 UTC m=+3.192681648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-24xsw" (UniqueName: "kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw") pod "network-check-target-vxxnf" (UID: "6e73fa00-c8fd-4fdc-9de0-d631225ab749") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:49.963963 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.963866    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 21:39:48 +0000 UTC" deadline="2028-03-12 17:20:49.021433718 +0000 UTC"
May 26 21:44:49.963963 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:49.963914    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15739h35m59.057523175s"
May 26 21:44:50.061597 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.061542    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97" event={"ID":"d3564ede-0e4a-4abc-bb36-9f46df84ea9f","Type":"ContainerStarted","Data":"5596f873ea550576a0d1eb0ca9ff1d490bfe5cb90dd4b0087df0cf014ca78691"}
May 26 21:44:50.073820 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.073769    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9lgfv" event={"ID":"f94aabbd-91e7-496f-ba8c-91c5e75b65a2","Type":"ContainerStarted","Data":"f2b0649bdf6212d0b8c002ef3015bbe61c559fb9da26f1f101dc8d008047c43b"}
May 26 21:44:50.089732 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.089702    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llsb5" event={"ID":"d03c3de9-2085-4370-bac2-f91be20e9bee","Type":"ContainerStarted","Data":"45fd8fa5127e1bb39b0bdf705b6934418b4c391dd2e0a3f7425cd5433a6e5962"}
May 26 21:44:50.100174 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.100145    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z8x82" event={"ID":"fd64cdb9-323e-45e7-90b7-dce5d0bbba90","Type":"ContainerStarted","Data":"e20b83b569b86454a427a345f8a62695ff8d5678e92bf5228e2236ce7d29e8b8"}
May 26 21:44:50.123487 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.123457    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal" event={"ID":"956416fc4c5f5837bf8911f355eda4b7","Type":"ContainerStarted","Data":"3debd57ff3cd28f2b733a3ffbb6e725220c7229c0a600bc14bd3e6d180fb7069"}
May 26 21:44:50.156387 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.156355    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rdq98" event={"ID":"cd760116-fdd6-4a2c-a33b-918cb49d4182","Type":"ContainerStarted","Data":"8e94a73c168d2d54a414f3eb084024692b679531a97088151ba388e8893c4947"}
May 26 21:44:50.182052 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.181990    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jq92z" event={"ID":"5ea3ce4c-4326-4a27-b660-bfba85954044","Type":"ContainerStarted","Data":"2091a1284b6dd6791444624dbec189e2c1ae6cb89c9851998e5123cdbd30a996"}
May 26 21:44:50.190968 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.190934    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lrpn5" event={"ID":"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea","Type":"ContainerStarted","Data":"8b4b06a56f9c5eb0281c63c98fcb95f1ec76b4feb11dbff6c94f0f03cd402d0a"}
May 26 21:44:50.195507 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.195481    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88lzm" event={"ID":"c4122713-9f5d-4f07-bf19-4cb6b3822c8b","Type":"ContainerStarted","Data":"1b014181b22af19f0c589ef1c5cbbe894cdad2394c6dcb4f528f61f2c0dc0e58"}
May 26 21:44:50.202843 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.202818    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" event={"ID":"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c","Type":"ContainerStarted","Data":"211753b8fbf097ae8392e8f7f9ffdf41945c77797c2a6cc882e3828dccd641f5"}
May 26 21:44:50.213520 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.213369    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal" event={"ID":"943f6c18ce8f2f93d108e18ae3a86146","Type":"ContainerStarted","Data":"d6a1e4ad06355196f8272a4dd14d16ad13cac850d5a67b22126e0d436a0475af"}
May 26 21:44:50.329074 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.328984    2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:44:50.629515 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.629440    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:50.629680 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:50.629629    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:50.629733 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:50.629704    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs podName:6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8 nodeName:}" failed. No retries permitted until 2026-05-26 21:44:52.629681922 +0000 UTC m=+5.100910629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs") pod "network-metrics-daemon-2hnq5" (UID: "6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:50.730868 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.730831    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:50.731048 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:50.731030    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:44:50.731128 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:50.731056    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:44:50.731128 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:50.731069    2555 projected.go:194] Error preparing data for projected volume kube-api-access-24xsw for pod openshift-network-diagnostics/network-check-target-vxxnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:50.731239 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:50.731129    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw podName:6e73fa00-c8fd-4fdc-9de0-d631225ab749 nodeName:}" failed. No retries permitted until 2026-05-26 21:44:52.731111921 +0000 UTC m=+5.202340566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-24xsw" (UniqueName: "kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw") pod "network-check-target-vxxnf" (UID: "6e73fa00-c8fd-4fdc-9de0-d631225ab749") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:50.965051 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.964754    2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:44:50.965585 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.965554    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 21:39:48 +0000 UTC" deadline="2027-11-23 08:08:41.663954329 +0000 UTC"
May 26 21:44:50.965667 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:50.965587    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13090h23m50.69837105s"
May 26 21:44:51.036389 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:51.036357    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:51.036556 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:51.036506    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:44:51.036948 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:51.036927    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:51.037048 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:51.037030    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:44:52.652101 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:52.652055    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:52.652562 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:52.652201    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:52.652562 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:52.652270    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs podName:6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8 nodeName:}" failed. No retries permitted until 2026-05-26 21:44:56.652249998 +0000 UTC m=+9.123478646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs") pod "network-metrics-daemon-2hnq5" (UID: "6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:52.753030 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:52.752944    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:52.753240 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:52.753129    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:44:52.753240 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:52.753150    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:44:52.753240 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:52.753162    2555 projected.go:194] Error preparing data for projected volume kube-api-access-24xsw for pod openshift-network-diagnostics/network-check-target-vxxnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:52.753240 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:52.753223    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw podName:6e73fa00-c8fd-4fdc-9de0-d631225ab749 nodeName:}" failed. No retries permitted until 2026-05-26 21:44:56.753205892 +0000 UTC m=+9.224434539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-24xsw" (UniqueName: "kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw") pod "network-check-target-vxxnf" (UID: "6e73fa00-c8fd-4fdc-9de0-d631225ab749") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:53.036166 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:53.036088    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:53.036345 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:53.036212    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:44:53.036626 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:53.036608    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:53.036758 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:53.036739    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:44:55.035927 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:55.035898    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:55.036344 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:55.036024    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:44:55.036344 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:55.036074    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:55.036344 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:55.036194    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:44:56.686226 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:56.686191    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:56.686656 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:56.686343    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:56.686656 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:56.686412    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs podName:6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:04.686390664 +0000 UTC m=+17.157619323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs") pod "network-metrics-daemon-2hnq5" (UID: "6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:44:56.787339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:56.787301    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:56.787513 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:56.787477    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:44:56.787513 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:56.787494    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:44:56.787513 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:56.787507    2555 projected.go:194] Error preparing data for projected volume kube-api-access-24xsw for pod openshift-network-diagnostics/network-check-target-vxxnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:56.787680 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:56.787561    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw podName:6e73fa00-c8fd-4fdc-9de0-d631225ab749 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:04.787541948 +0000 UTC m=+17.258770597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-24xsw" (UniqueName: "kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw") pod "network-check-target-vxxnf" (UID: "6e73fa00-c8fd-4fdc-9de0-d631225ab749") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:44:57.036105 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:57.035534    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:57.036105 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:57.035534    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:57.036105 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:57.035682    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:44:57.036105 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:57.035743    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:44:59.036044 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:59.035809    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:44:59.036556 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:44:59.035809    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:44:59.036556 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:59.036151    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:44:59.036556 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:44:59.036223    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:01.035802 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:01.035753    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:01.036237 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:01.035756    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:01.036237 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:01.035878    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:01.036237 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:01.035987    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:03.036107 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.036074    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:03.036489 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.036074    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:03.036489 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:03.036205    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:03.036489 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:03.036248    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:03.642460 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.642426    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9d89z"]
May 26 21:45:03.656067 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.656045    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:03.656173 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:03.656147    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:03.740751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.740714    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/682d0998-1e7b-4e5f-ac59-08a8addc2652-dbus\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:03.740937 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.740795    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/682d0998-1e7b-4e5f-ac59-08a8addc2652-kubelet-config\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:03.740937 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.740860    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:03.841979 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.841895    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/682d0998-1e7b-4e5f-ac59-08a8addc2652-dbus\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:03.842138 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.841981    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/682d0998-1e7b-4e5f-ac59-08a8addc2652-kubelet-config\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:03.842138 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.842010    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:03.842138 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.842116    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/682d0998-1e7b-4e5f-ac59-08a8addc2652-kubelet-config\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:03.842138 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:03.842131    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 21:45:03.842323 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:03.842116    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/682d0998-1e7b-4e5f-ac59-08a8addc2652-dbus\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:03.842323 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:03.842192    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret podName:682d0998-1e7b-4e5f-ac59-08a8addc2652 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:04.342173421 +0000 UTC m=+16.813402077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret") pod "global-pull-secret-syncer-9d89z" (UID: "682d0998-1e7b-4e5f-ac59-08a8addc2652") : object "kube-system"/"original-pull-secret" not registered
May 26 21:45:04.345874 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:04.345838    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:04.346325 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:04.345981    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 21:45:04.346325 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:04.346054    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret podName:682d0998-1e7b-4e5f-ac59-08a8addc2652 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:05.346033963 +0000 UTC m=+17.817262609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret") pod "global-pull-secret-syncer-9d89z" (UID: "682d0998-1e7b-4e5f-ac59-08a8addc2652") : object "kube-system"/"original-pull-secret" not registered
May 26 21:45:04.748916 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:04.748825    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:04.749107 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:04.748990    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:04.749107 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:04.749090    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs podName:6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:20.749073241 +0000 UTC m=+33.220301887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs") pod "network-metrics-daemon-2hnq5" (UID: "6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:04.849997 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:04.849953    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:04.850159 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:04.850132    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:45:04.850159 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:04.850158    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:45:04.850280 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:04.850171    2555 projected.go:194] Error preparing data for projected volume kube-api-access-24xsw for pod openshift-network-diagnostics/network-check-target-vxxnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:04.850280 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:04.850239    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw podName:6e73fa00-c8fd-4fdc-9de0-d631225ab749 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:20.850220877 +0000 UTC m=+33.321449533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-24xsw" (UniqueName: "kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw") pod "network-check-target-vxxnf" (UID: "6e73fa00-c8fd-4fdc-9de0-d631225ab749") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:05.035862 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:05.035764    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:05.036015 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:05.035764    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:05.036015 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:05.035917    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:05.036015 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:05.035764    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:05.036173 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:05.036013    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:05.036173 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:05.036150    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:05.354596 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:05.354508    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:05.355006 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:05.354680    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 21:45:05.355006 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:05.354777    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret podName:682d0998-1e7b-4e5f-ac59-08a8addc2652 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:07.354757648 +0000 UTC m=+19.825986306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret") pod "global-pull-secret-syncer-9d89z" (UID: "682d0998-1e7b-4e5f-ac59-08a8addc2652") : object "kube-system"/"original-pull-secret" not registered
May 26 21:45:07.035769 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:07.035739    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:07.035769 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:07.035767    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:07.036264 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:07.035863    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:07.036264 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:07.035983    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:07.036264 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:07.036043    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:07.036264 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:07.036130    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:07.369958 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:07.369875    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:07.370098 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:07.370015    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 21:45:07.370098 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:07.370084    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret podName:682d0998-1e7b-4e5f-ac59-08a8addc2652 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:11.370070366 +0000 UTC m=+23.841299008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret") pod "global-pull-secret-syncer-9d89z" (UID: "682d0998-1e7b-4e5f-ac59-08a8addc2652") : object "kube-system"/"original-pull-secret" not registered
May 26 21:45:09.036251 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.036078    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:09.036936 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.036077    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:09.036936 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.036078    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:09.036936 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:09.036456    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:09.036936 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:09.036323    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:09.036936 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:09.036514    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:09.251156 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.250823    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lrpn5" event={"ID":"2bedbab1-b03a-4449-9f46-1e8ff5fa26ea","Type":"ContainerStarted","Data":"0d48378c960c6e467848e3ab4f46769f9ae8438187f3b3b5396b01c6c484331e"}
May 26 21:45:09.252198 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.252167    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88lzm" event={"ID":"c4122713-9f5d-4f07-bf19-4cb6b3822c8b","Type":"ContainerStarted","Data":"a36d338aef2437b882754b552006bda75dcab04955ae704f56af2112f1f1b132"}
May 26 21:45:09.254672 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.254650    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" event={"ID":"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c","Type":"ContainerStarted","Data":"74151dfe1d1c140d0612af7a2d42c6e170686bfbbea36d8e457de8de603358f4"}
May 26 21:45:09.254803 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.254677    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" event={"ID":"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c","Type":"ContainerStarted","Data":"2bf32bcd73547b1d9afaf01f66ca2eff5caabf129ef73453a6edf2154c0e5241"}
May 26 21:45:09.254803 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.254690    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" event={"ID":"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c","Type":"ContainerStarted","Data":"a7757b9eba2c6830f3e4f6b87efa75533179af50ec78057a0f0eef7a867035c3"}
May 26 21:45:09.254803 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.254701    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" event={"ID":"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c","Type":"ContainerStarted","Data":"350f928cf2d5c0ccec1275a876413eb62f7e0c955ec7775f5dc1ac6762f13749"}
May 26 21:45:09.254803 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.254712    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" event={"ID":"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c","Type":"ContainerStarted","Data":"bdd1b4b236a8e24835258926b94b4d3cdb224d82532684e84aaa154fc736c9dc"}
May 26 21:45:09.254803 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.254723    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" event={"ID":"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c","Type":"ContainerStarted","Data":"2c03410aec7c2a182754695966a17e0ef5bd12da7cdb337cf07d21db6859c512"}
May 26 21:45:09.255976 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.255952    2555 generic.go:358] "Generic (PLEG): container finished" podID="943f6c18ce8f2f93d108e18ae3a86146" containerID="0dbba17265f74a04daf8bf81abce1f8404929dee1a10ddb72d96464706ccf4ef" exitCode=0
May 26 21:45:09.256071 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.256034    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal" event={"ID":"943f6c18ce8f2f93d108e18ae3a86146","Type":"ContainerDied","Data":"0dbba17265f74a04daf8bf81abce1f8404929dee1a10ddb72d96464706ccf4ef"}
May 26 21:45:09.257289 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.257263    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97" event={"ID":"d3564ede-0e4a-4abc-bb36-9f46df84ea9f","Type":"ContainerStarted","Data":"5229f4c7625e62d20b2277efdffff8d81956d72ea4ed8e7ba0e2884c2f9dc1e3"}
May 26 21:45:09.258505 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.258468    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9lgfv" event={"ID":"f94aabbd-91e7-496f-ba8c-91c5e75b65a2","Type":"ContainerStarted","Data":"17fafab15dad25bbfb87b242ddf995177eac273654cfb2a4a804a1fbefc113d5"}
May 26 21:45:09.259637 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.259612    2555 generic.go:358] "Generic (PLEG): container finished" podID="d03c3de9-2085-4370-bac2-f91be20e9bee" containerID="3ffa28991260fde4d73de18831d7d0326e9ca1715f0f0015b0729c41b9f2d288" exitCode=0
May 26 21:45:09.259718 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.259676    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llsb5" event={"ID":"d03c3de9-2085-4370-bac2-f91be20e9bee","Type":"ContainerDied","Data":"3ffa28991260fde4d73de18831d7d0326e9ca1715f0f0015b0729c41b9f2d288"}
May 26 21:45:09.260934 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.260915    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z8x82" event={"ID":"fd64cdb9-323e-45e7-90b7-dce5d0bbba90","Type":"ContainerStarted","Data":"c3bc50263bcc94b6f9ea149950797165810fb708744b20bcff62b78072f4e4f9"}
May 26 21:45:09.262054 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.262027    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal" event={"ID":"956416fc4c5f5837bf8911f355eda4b7","Type":"ContainerStarted","Data":"0cff01447927cd610a615a63bc98c4b9b7cbcbddfd6d4f6410af71167f4ab18b"}
May 26 21:45:09.263321 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.263301    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jq92z" event={"ID":"5ea3ce4c-4326-4a27-b660-bfba85954044","Type":"ContainerStarted","Data":"37dae79f4ef9a92ca90f21b489d3deb4b89ce812654b101168ab0d42b280eed9"}
May 26 21:45:09.263579 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.263543    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-lrpn5" podStartSLOduration=2.171407311 podStartE2EDuration="21.263532059s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:44:49.30273817 +0000 UTC m=+1.773966811" lastFinishedPulling="2026-05-26 21:45:08.394862893 +0000 UTC m=+20.866091559" observedRunningTime="2026-05-26 21:45:09.263031067 +0000 UTC m=+21.734259729" watchObservedRunningTime="2026-05-26 21:45:09.263532059 +0000 UTC m=+21.734760722"
May 26 21:45:09.275082 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.275048    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-172.ec2.internal" podStartSLOduration=21.275036468 podStartE2EDuration="21.275036468s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 21:45:09.274769275 +0000 UTC m=+21.745997952" watchObservedRunningTime="2026-05-26 21:45:09.275036468 +0000 UTC m=+21.746265131"
May 26 21:45:09.287155 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.287119    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z8x82" podStartSLOduration=2.149625315 podStartE2EDuration="21.287106481s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:44:49.23505461 +0000 UTC m=+1.706283251" lastFinishedPulling="2026-05-26 21:45:08.372535758 +0000 UTC m=+20.843764417" observedRunningTime="2026-05-26 21:45:09.286975305 +0000 UTC m=+21.758203969" watchObservedRunningTime="2026-05-26 21:45:09.287106481 +0000 UTC m=+21.758335145"
May 26 21:45:09.300316 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.300265    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-88lzm" podStartSLOduration=2.187162161 podStartE2EDuration="21.300249586s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:44:49.284632153 +0000 UTC m=+1.755860793" lastFinishedPulling="2026-05-26 21:45:08.39771957 +0000 UTC m=+20.868948218" observedRunningTime="2026-05-26 21:45:09.300225411 +0000 UTC m=+21.771454077" watchObservedRunningTime="2026-05-26 21:45:09.300249586 +0000 UTC m=+21.771478249"
May 26 21:45:09.315819 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.315747    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9lgfv" podStartSLOduration=2.284805892 podStartE2EDuration="21.315729119s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:44:49.364594897 +0000 UTC m=+1.835823538" lastFinishedPulling="2026-05-26 21:45:08.39551812 +0000 UTC m=+20.866746765" observedRunningTime="2026-05-26 21:45:09.315478085 +0000 UTC m=+21.786706747" watchObservedRunningTime="2026-05-26 21:45:09.315729119 +0000 UTC m=+21.786957785"
May 26 21:45:09.378894 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:09.378845    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jq92z" podStartSLOduration=2.172105101 podStartE2EDuration="21.378831262s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:44:49.32787442 +0000 UTC m=+1.799103062" lastFinishedPulling="2026-05-26 21:45:08.534600577 +0000 UTC m=+21.005829223" observedRunningTime="2026-05-26 21:45:09.37837993 +0000 UTC m=+21.849608584" watchObservedRunningTime="2026-05-26 21:45:09.378831262 +0000 UTC m=+21.850059923"
May 26 21:45:10.222918 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.222889    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 21:45:10.266904 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.266869    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rdq98" event={"ID":"cd760116-fdd6-4a2c-a33b-918cb49d4182","Type":"ContainerStarted","Data":"9509f0de79dc65b5b2a35e79b59ba0366d890799f2c6c4eed6f0a6c4510f7ce2"}
May 26 21:45:10.268772 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.268740    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal" event={"ID":"943f6c18ce8f2f93d108e18ae3a86146","Type":"ContainerStarted","Data":"62f205b9b61f75d4acc002efb52352ea85200f772bfd19aed9b67bfb8b973267"}
May 26 21:45:10.271094 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.270681    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97" event={"ID":"d3564ede-0e4a-4abc-bb36-9f46df84ea9f","Type":"ContainerStarted","Data":"fbaad22d60e042950c9d18b3632438269dcc4df68b1528ebdbb7c73fcb0df57c"}
May 26 21:45:10.297878 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.297828    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rdq98" podStartSLOduration=3.252327313 podStartE2EDuration="22.297814956s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:44:49.350173313 +0000 UTC m=+1.821401953" lastFinishedPulling="2026-05-26 21:45:08.395660947 +0000 UTC m=+20.866889596" observedRunningTime="2026-05-26 21:45:10.297812963 +0000 UTC m=+22.769041619" watchObservedRunningTime="2026-05-26 21:45:10.297814956 +0000 UTC m=+22.769043609"
May 26 21:45:10.311900 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.311856    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-172.ec2.internal" podStartSLOduration=22.311843466 podStartE2EDuration="22.311843466s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 21:45:10.311739066 +0000 UTC m=+22.782967728" watchObservedRunningTime="2026-05-26 21:45:10.311843466 +0000 UTC m=+22.783072130"
May 26 21:45:10.491868 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.491774    2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:45:10.492415 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.492396    2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:45:10.967445 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.967296    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T21:45:10.22291524Z","UUID":"d955f80c-ba77-4cca-b098-2cb1408847f4","Handler":null,"Name":"","Endpoint":""}
May 26 21:45:10.969061 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.969039    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 21:45:10.969061 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:10.969066    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 21:45:11.036041 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:11.035880    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:11.036041 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:11.035902    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:11.036041 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:11.036009    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:11.036306 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:11.036124    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:11.036306 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:11.036205    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:11.036411 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:11.036309    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:11.406363 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:11.406331    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:11.406827 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:11.406509    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 21:45:11.406827 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:11.406581    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret podName:682d0998-1e7b-4e5f-ac59-08a8addc2652 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:19.406558968 +0000 UTC m=+31.877787628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret") pod "global-pull-secret-syncer-9d89z" (UID: "682d0998-1e7b-4e5f-ac59-08a8addc2652") : object "kube-system"/"original-pull-secret" not registered
May 26 21:45:12.276174 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:12.276137    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97" event={"ID":"d3564ede-0e4a-4abc-bb36-9f46df84ea9f","Type":"ContainerStarted","Data":"03353f5ce559f03b7279aae6abad3882b1a838ce88cf8f876b1bfcb0cc61f636"}
May 26 21:45:12.278737 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:12.278700    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" event={"ID":"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c","Type":"ContainerStarted","Data":"81a65e7ac9d8c410bc7ba8a9f940c6dfc39bdd31298cb9daa66a121c7ad8f489"}
May 26 21:45:12.278859 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:12.278762    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 21:45:12.293422 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:12.293388    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvh97" podStartSLOduration=2.1280965370000002 podStartE2EDuration="24.293378131s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:44:49.370141234 +0000 UTC m=+1.841369875" lastFinishedPulling="2026-05-26 21:45:11.535422814 +0000 UTC m=+24.006651469" observedRunningTime="2026-05-26 21:45:12.293217392 +0000 UTC m=+24.764446054" watchObservedRunningTime="2026-05-26 21:45:12.293378131 +0000 UTC m=+24.764606790"
May 26 21:45:13.035589 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:13.035553    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:13.036088 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:13.035602    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:13.036088 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:13.035690    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:13.036088 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:13.035689    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:13.036088 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:13.035803    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:13.036088 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:13.035873    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:13.603261 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:13.603224    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:45:13.603452 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:13.603358    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 21:45:13.603927 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:13.603898    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9lgfv"
May 26 21:45:14.285393 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:14.285165    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" event={"ID":"76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c","Type":"ContainerStarted","Data":"c92c0bd60f2072fa03be3ad2e533f2ea409fa96cee53278f944b3923baac9a23"}
May 26 21:45:14.285393 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:14.285390    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:45:14.286859 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:14.286833    2555 generic.go:358] "Generic (PLEG): container finished" podID="d03c3de9-2085-4370-bac2-f91be20e9bee" containerID="cf993bec14d4d2aefd99ebe1cbb50565fb86605728fdde869f0f0890be953bd2" exitCode=0
May 26 21:45:14.287027 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:14.286888    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llsb5" event={"ID":"d03c3de9-2085-4370-bac2-f91be20e9bee","Type":"ContainerDied","Data":"cf993bec14d4d2aefd99ebe1cbb50565fb86605728fdde869f0f0890be953bd2"}
May 26 21:45:14.301094 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:14.301071    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:45:14.312954 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:14.312912    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-66skj" podStartSLOduration=7.136078266 podStartE2EDuration="26.312899674s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:44:49.267083461 +0000 UTC m=+1.738312102" lastFinishedPulling="2026-05-26 21:45:08.443904855 +0000 UTC m=+20.915133510" observedRunningTime="2026-05-26 21:45:14.311374145 +0000 UTC m=+26.782602808" watchObservedRunningTime="2026-05-26 21:45:14.312899674 +0000 UTC m=+26.784128375"
May 26 21:45:15.036123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.035933    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:15.036393 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.035953    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:15.036393 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:15.036232    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:15.036393 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.035992    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:15.036393 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:15.036280    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:15.036393 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:15.036363    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:15.289304 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.289234    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:45:15.289304 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.289270    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:45:15.304461 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.304436    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:45:15.775588 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.775556    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vxxnf"]
May 26 21:45:15.775736 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.775691    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:15.775849 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:15.775824    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:15.778869 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.778844    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9d89z"]
May 26 21:45:15.779007 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.778992    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:15.779130 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:15.779106    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:15.779515 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.779479    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2hnq5"]
May 26 21:45:15.779602 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:15.779592    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:15.779711 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:15.779690    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:16.292639 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:16.292608    2555 generic.go:358] "Generic (PLEG): container finished" podID="d03c3de9-2085-4370-bac2-f91be20e9bee" containerID="066f7cc6f47d12d546d2a4b7d93e2bcafd545787bf6adc871cb770171125a26b" exitCode=0
May 26 21:45:16.293028 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:16.292707    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llsb5" event={"ID":"d03c3de9-2085-4370-bac2-f91be20e9bee","Type":"ContainerDied","Data":"066f7cc6f47d12d546d2a4b7d93e2bcafd545787bf6adc871cb770171125a26b"}
May 26 21:45:17.035241 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:17.035218    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:17.035332 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:17.035218    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:17.035437 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:17.035418    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:17.035488 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:17.035316    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:17.296717 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:17.296640    2555 generic.go:358] "Generic (PLEG): container finished" podID="d03c3de9-2085-4370-bac2-f91be20e9bee" containerID="03192bcc2ce71c81d910718749c640d90c58094d274cc9d781d39ce0fd952aac" exitCode=0
May 26 21:45:17.297101 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:17.296725    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llsb5" event={"ID":"d03c3de9-2085-4370-bac2-f91be20e9bee","Type":"ContainerDied","Data":"03192bcc2ce71c81d910718749c640d90c58094d274cc9d781d39ce0fd952aac"}
May 26 21:45:18.036647 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:18.036571    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:18.036840 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:18.036671    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:19.035545 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:19.035513    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:19.036016 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:19.035514    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:19.036016 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:19.035641    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:19.036016 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:19.035693    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:19.470583 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:19.470548    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:19.470777 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:19.470720    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 21:45:19.470871 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:19.470821    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret podName:682d0998-1e7b-4e5f-ac59-08a8addc2652 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:35.470778921 +0000 UTC m=+47.942007563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret") pod "global-pull-secret-syncer-9d89z" (UID: "682d0998-1e7b-4e5f-ac59-08a8addc2652") : object "kube-system"/"original-pull-secret" not registered
May 26 21:45:20.036169 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:20.036091    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:20.036589 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:20.036223    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:45:20.781158 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:20.781121    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:20.781488 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:20.781285    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:20.781488 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:20.781354    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs podName:6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:52.781336503 +0000 UTC m=+65.252565143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs") pod "network-metrics-daemon-2hnq5" (UID: "6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:20.881971 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:20.881930    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:20.882133 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:20.882092    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:45:20.882133 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:20.882117    2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:45:20.882133 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:20.882130    2555 projected.go:194] Error preparing data for projected volume kube-api-access-24xsw for pod openshift-network-diagnostics/network-check-target-vxxnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:20.882255 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:20.882180    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw podName:6e73fa00-c8fd-4fdc-9de0-d631225ab749 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:52.882167122 +0000 UTC m=+65.353395763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-24xsw" (UniqueName: "kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw") pod "network-check-target-vxxnf" (UID: "6e73fa00-c8fd-4fdc-9de0-d631225ab749") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:21.035217 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.035139    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:21.035365 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.035139    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:21.035365 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.035259    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxnf" podUID="6e73fa00-c8fd-4fdc-9de0-d631225ab749"
May 26 21:45:21.035365 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.035332    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d89z" podUID="682d0998-1e7b-4e5f-ac59-08a8addc2652"
May 26 21:45:21.340673 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.340602    2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-172.ec2.internal" event="NodeReady"
May 26 21:45:21.341077 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.340726    2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 21:45:21.375354 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.375327    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"]
May 26 21:45:21.378748 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.378722    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c586759c8-snvtx"]
May 26 21:45:21.378982 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.378960    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:21.381076 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.381055    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 26 21:45:21.381188 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.381123    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 26 21:45:21.381188 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.381125    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-plmgr\""
May 26 21:45:21.383369 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.383351    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"]
May 26 21:45:21.383519 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.383504    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.386602 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.386423    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 21:45:21.387212 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.386668    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"]
May 26 21:45:21.387533 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.387512    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xnc2k\""
May 26 21:45:21.387633 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.387551    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 21:45:21.387820 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.387779    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 21:45:21.391276 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.390297    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"]
May 26 21:45:21.391276 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.390440    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"
May 26 21:45:21.391276 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.390757    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.394922 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.394273    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"]
May 26 21:45:21.394922 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.394300    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"]
May 26 21:45:21.394922 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.394320    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c586759c8-snvtx"]
May 26 21:45:21.394922 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.394412    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.394922 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.394495    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"]
May 26 21:45:21.394922 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.394719    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 26 21:45:21.397900 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.397876    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 21:45:21.398110 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.398089    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 21:45:21.401156 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.398397    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j6kzz"]
May 26 21:45:21.401156 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.398641    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 21:45:21.401156 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.399589    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 21:45:21.401156 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.400353    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 26 21:45:21.401156 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.400831    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 26 21:45:21.401429 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.401210    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 26 21:45:21.401429 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.401271    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 26 21:45:21.401429 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.401416    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 26 21:45:21.401586 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.401568    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-268bl\""
May 26 21:45:21.405994 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.405955    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"]
May 26 21:45:21.406112 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.406080    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:21.407031 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.407012    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j6kzz"]
May 26 21:45:21.408236 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.408220    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 21:45:21.408393 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.408232    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6lg2j\""
May 26 21:45:21.408692 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.408671    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 21:45:21.408808 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.408716    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 21:45:21.486252 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486222    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-installation-pull-secrets\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.486252 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486255    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/3725d185-6a8f-4642-ab6a-1bc36443acfd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.486497 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486300    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.486497 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486326    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfht8\" (UniqueName: \"kubernetes.io/projected/6782e7c9-730f-40f9-b7de-12b52ff8a710-kube-api-access-kfht8\") pod \"managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88\" (UID: \"6782e7c9-730f-40f9-b7de-12b52ff8a710\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"
May 26 21:45:21.486497 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486346    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.486497 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486408    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.486497 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486443    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxmcj\" (UniqueName: \"kubernetes.io/projected/bb2cd3cd-96ca-46a1-bf02-758ae3257048-kube-api-access-lxmcj\") pod \"klusterlet-addon-workmgr-57db448778-q97qx\" (UID: \"bb2cd3cd-96ca-46a1-bf02-758ae3257048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.486752 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486511    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-bound-sa-token\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.486752 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486536    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-hub\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.486752 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486565    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a05e282-0bcd-469e-b857-46a800cd3e33-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:21.486752 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486589    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-certificates\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.486752 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486627    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-trusted-ca\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.486752 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486674    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:21.486752 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486702    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjjrh\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-kube-api-access-tjjrh\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.486752 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486729    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb2cd3cd-96ca-46a1-bf02-758ae3257048-klusterlet-config\") pod \"klusterlet-addon-workmgr-57db448778-q97qx\" (UID: \"bb2cd3cd-96ca-46a1-bf02-758ae3257048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.487108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486770    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg2gf\" (UniqueName: \"kubernetes.io/projected/3725d185-6a8f-4642-ab6a-1bc36443acfd-kube-api-access-tg2gf\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.487108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486816    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6782e7c9-730f-40f9-b7de-12b52ff8a710-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88\" (UID: \"6782e7c9-730f-40f9-b7de-12b52ff8a710\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"
May 26 21:45:21.487108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486845    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb2cd3cd-96ca-46a1-bf02-758ae3257048-tmp\") pod \"klusterlet-addon-workmgr-57db448778-q97qx\" (UID: \"bb2cd3cd-96ca-46a1-bf02-758ae3257048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.487108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486870    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-image-registry-private-configuration\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.487108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486895    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-ca-trust-extracted\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.487108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.486957    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-ca\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.502311 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.502288    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6prn2"]
May 26 21:45:21.509320 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.509300    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.511176 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.511157    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 21:45:21.511342 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.511329    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 21:45:21.511479 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.511452    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhpgm\""
May 26 21:45:21.513026 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.513006    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6prn2"]
May 26 21:45:21.587519 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587478    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-installation-pull-secrets\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.587519 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587516    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/3725d185-6a8f-4642-ab6a-1bc36443acfd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.587757 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587594    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.587757 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587627    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kfht8\" (UniqueName: \"kubernetes.io/projected/6782e7c9-730f-40f9-b7de-12b52ff8a710-kube-api-access-kfht8\") pod \"managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88\" (UID: \"6782e7c9-730f-40f9-b7de-12b52ff8a710\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"
May 26 21:45:21.587757 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587663    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.587757 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587697    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.587757 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587723    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxmcj\" (UniqueName: \"kubernetes.io/projected/bb2cd3cd-96ca-46a1-bf02-758ae3257048-kube-api-access-lxmcj\") pod \"klusterlet-addon-workmgr-57db448778-q97qx\" (UID: \"bb2cd3cd-96ca-46a1-bf02-758ae3257048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587772    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-bound-sa-token\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587809    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-hub\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587842    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a05e282-0bcd-469e-b857-46a800cd3e33-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587869    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-certificates\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587912    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587933    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-trusted-ca\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587954    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587978    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjjrh\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-kube-api-access-tjjrh\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.587999    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb2cd3cd-96ca-46a1-bf02-758ae3257048-klusterlet-config\") pod \"klusterlet-addon-workmgr-57db448778-q97qx\" (UID: \"bb2cd3cd-96ca-46a1-bf02-758ae3257048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.588048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.588040    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tg2gf\" (UniqueName: \"kubernetes.io/projected/3725d185-6a8f-4642-ab6a-1bc36443acfd-kube-api-access-tg2gf\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.588523 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.588062    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6782e7c9-730f-40f9-b7de-12b52ff8a710-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88\" (UID: \"6782e7c9-730f-40f9-b7de-12b52ff8a710\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"
May 26 21:45:21.588523 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.588078    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb2cd3cd-96ca-46a1-bf02-758ae3257048-tmp\") pod \"klusterlet-addon-workmgr-57db448778-q97qx\" (UID: \"bb2cd3cd-96ca-46a1-bf02-758ae3257048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.588523 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.588095    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt6f7\" (UniqueName: \"kubernetes.io/projected/7f055d13-27ca-4f6f-9a34-bca0e9019972-kube-api-access-zt6f7\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:21.588523 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.588116    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-image-registry-private-configuration\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.588523 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.588140    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-ca-trust-extracted\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.588523 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.588160    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-ca\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.588523 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.588270    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/3725d185-6a8f-4642-ab6a-1bc36443acfd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.589223 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.589067    2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 21:45:21.589223 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.589092    2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c586759c8-snvtx: secret "image-registry-tls" not found
May 26 21:45:21.589223 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.589169    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls podName:200f9d44-5f0f-49cb-bc0a-d6a5c691fb15 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:22.089149194 +0000 UTC m=+34.560377845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls") pod "image-registry-7c586759c8-snvtx" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15") : secret "image-registry-tls" not found
May 26 21:45:21.589484 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.589462    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-certificates\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.590430 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.589681    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-trusted-ca\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.590430 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.590097    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a05e282-0bcd-469e-b857-46a800cd3e33-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:21.590430 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.590175    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 21:45:21.590430 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.590229    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert podName:6a05e282-0bcd-469e-b857-46a800cd3e33 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:22.090212742 +0000 UTC m=+34.561441386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-mnjkw" (UID: "6a05e282-0bcd-469e-b857-46a800cd3e33") : secret "networking-console-plugin-cert" not found
May 26 21:45:21.590710 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.590560    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb2cd3cd-96ca-46a1-bf02-758ae3257048-tmp\") pod \"klusterlet-addon-workmgr-57db448778-q97qx\" (UID: \"bb2cd3cd-96ca-46a1-bf02-758ae3257048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.591021 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.591000    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-ca-trust-extracted\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.592732 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.592709    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-installation-pull-secrets\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.592889 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.592867    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-hub\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.592963 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.592908    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.593336 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.593309    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.593719 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.593697    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3725d185-6a8f-4642-ab6a-1bc36443acfd-ca\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.593924 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.593902    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-image-registry-private-configuration\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.594455 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.594435    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6782e7c9-730f-40f9-b7de-12b52ff8a710-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88\" (UID: \"6782e7c9-730f-40f9-b7de-12b52ff8a710\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"
May 26 21:45:21.595610 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.595590    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb2cd3cd-96ca-46a1-bf02-758ae3257048-klusterlet-config\") pod \"klusterlet-addon-workmgr-57db448778-q97qx\" (UID: \"bb2cd3cd-96ca-46a1-bf02-758ae3257048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.602006 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.601982    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfht8\" (UniqueName: \"kubernetes.io/projected/6782e7c9-730f-40f9-b7de-12b52ff8a710-kube-api-access-kfht8\") pod \"managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88\" (UID: \"6782e7c9-730f-40f9-b7de-12b52ff8a710\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"
May 26 21:45:21.602140 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.602037    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-bound-sa-token\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.602896 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.602862    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjjrh\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-kube-api-access-tjjrh\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:21.603299 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.603279    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg2gf\" (UniqueName: \"kubernetes.io/projected/3725d185-6a8f-4642-ab6a-1bc36443acfd-kube-api-access-tg2gf\") pod \"cluster-proxy-proxy-agent-7fdc699d5-ljbng\" (UID: \"3725d185-6a8f-4642-ab6a-1bc36443acfd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.603615 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.603594    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxmcj\" (UniqueName: \"kubernetes.io/projected/bb2cd3cd-96ca-46a1-bf02-758ae3257048-kube-api-access-lxmcj\") pod \"klusterlet-addon-workmgr-57db448778-q97qx\" (UID: \"bb2cd3cd-96ca-46a1-bf02-758ae3257048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.688533 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.688501    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c84ee120-332c-4146-bcfc-c9936d452b5e-config-volume\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.688701 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.688546    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c84ee120-332c-4146-bcfc-c9936d452b5e-tmp-dir\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.688701 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.688611    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.688845 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.688707    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:21.688845 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.688770    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zt6f7\" (UniqueName: \"kubernetes.io/projected/7f055d13-27ca-4f6f-9a34-bca0e9019972-kube-api-access-zt6f7\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:21.688845 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.688829    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czzg4\" (UniqueName: \"kubernetes.io/projected/c84ee120-332c-4146-bcfc-c9936d452b5e-kube-api-access-czzg4\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.689001 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.688875    2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:21.689001 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.688938    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert podName:7f055d13-27ca-4f6f-9a34-bca0e9019972 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:22.18892018 +0000 UTC m=+34.660148824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert") pod "ingress-canary-j6kzz" (UID: "7f055d13-27ca-4f6f-9a34-bca0e9019972") : secret "canary-serving-cert" not found
May 26 21:45:21.697776 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.697749    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt6f7\" (UniqueName: \"kubernetes.io/projected/7f055d13-27ca-4f6f-9a34-bca0e9019972-kube-api-access-zt6f7\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:21.724933 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.724899    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"
May 26 21:45:21.727678 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.727653    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:21.735115 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.734657    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:45:21.790234 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.790199    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czzg4\" (UniqueName: \"kubernetes.io/projected/c84ee120-332c-4146-bcfc-c9936d452b5e-kube-api-access-czzg4\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.790375 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.790250    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c84ee120-332c-4146-bcfc-c9936d452b5e-config-volume\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.790375 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.790281    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c84ee120-332c-4146-bcfc-c9936d452b5e-tmp-dir\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.790375 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.790313    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.790543 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.790528    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:21.790603 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:21.790594    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls podName:c84ee120-332c-4146-bcfc-c9936d452b5e nodeName:}" failed. No retries permitted until 2026-05-26 21:45:22.290580452 +0000 UTC m=+34.761809319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls") pod "dns-default-6prn2" (UID: "c84ee120-332c-4146-bcfc-c9936d452b5e") : secret "dns-default-metrics-tls" not found
May 26 21:45:21.791106 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.791085    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c84ee120-332c-4146-bcfc-c9936d452b5e-tmp-dir\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.791166 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.791146    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c84ee120-332c-4146-bcfc-c9936d452b5e-config-volume\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.800221 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.799777    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czzg4\" (UniqueName: \"kubernetes.io/projected/c84ee120-332c-4146-bcfc-c9936d452b5e-kube-api-access-czzg4\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:21.900704 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.900413    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88"]
May 26 21:45:21.903701 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.903678    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"]
May 26 21:45:21.906322 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:45:21.906292    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6782e7c9_730f_40f9_b7de_12b52ff8a710.slice/crio-317f03ef4782c3aee4cf45322bf05ffdabc2384615ea8e5e5e5398a22e297b7f WatchSource:0}: Error finding container 317f03ef4782c3aee4cf45322bf05ffdabc2384615ea8e5e5e5398a22e297b7f: Status 404 returned error can't find the container with id 317f03ef4782c3aee4cf45322bf05ffdabc2384615ea8e5e5e5398a22e297b7f
May 26 21:45:21.906563 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:45:21.906531    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3725d185_6a8f_4642_ab6a_1bc36443acfd.slice/crio-7223c0dafa8623f122e884c3a53e3dc1b794a0fd4fe6fad8801f45d7c86f5ab5 WatchSource:0}: Error finding container 7223c0dafa8623f122e884c3a53e3dc1b794a0fd4fe6fad8801f45d7c86f5ab5: Status 404 returned error can't find the container with id 7223c0dafa8623f122e884c3a53e3dc1b794a0fd4fe6fad8801f45d7c86f5ab5
May 26 21:45:21.913899 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:21.913877    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"]
May 26 21:45:21.917682 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:45:21.917661    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2cd3cd_96ca_46a1_bf02_758ae3257048.slice/crio-3e43c639c2448463b4d163eec02e0121e5bf16db2e6fc68798ac3d9bf170af48 WatchSource:0}: Error finding container 3e43c639c2448463b4d163eec02e0121e5bf16db2e6fc68798ac3d9bf170af48: Status 404 returned error can't find the container with id 3e43c639c2448463b4d163eec02e0121e5bf16db2e6fc68798ac3d9bf170af48
May 26 21:45:22.035894 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.035863    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:22.038329 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.038303    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 21:45:22.038803 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.038767    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqzm9\""
May 26 21:45:22.094416 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.094341    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:22.094416 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.094394    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:22.094567 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:22.094492    2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 21:45:22.094567 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:22.094506    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 21:45:22.094567 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:22.094507    2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c586759c8-snvtx: secret "image-registry-tls" not found
May 26 21:45:22.094662 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:22.094574    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls podName:200f9d44-5f0f-49cb-bc0a-d6a5c691fb15 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:23.094553879 +0000 UTC m=+35.565782524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls") pod "image-registry-7c586759c8-snvtx" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15") : secret "image-registry-tls" not found
May 26 21:45:22.094662 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:22.094590    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert podName:6a05e282-0bcd-469e-b857-46a800cd3e33 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:23.094581699 +0000 UTC m=+35.565810340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-mnjkw" (UID: "6a05e282-0bcd-469e-b857-46a800cd3e33") : secret "networking-console-plugin-cert" not found
May 26 21:45:22.195321 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.195285    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:22.195510 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:22.195442    2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:22.195567 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:22.195510    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert podName:7f055d13-27ca-4f6f-9a34-bca0e9019972 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:23.195492229 +0000 UTC m=+35.666720890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert") pod "ingress-canary-j6kzz" (UID: "7f055d13-27ca-4f6f-9a34-bca0e9019972") : secret "canary-serving-cert" not found
May 26 21:45:22.295912 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.295875    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:22.296079 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:22.296045    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:22.296127 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:22.296121    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls podName:c84ee120-332c-4146-bcfc-c9936d452b5e nodeName:}" failed. No retries permitted until 2026-05-26 21:45:23.296098858 +0000 UTC m=+35.767327500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls") pod "dns-default-6prn2" (UID: "c84ee120-332c-4146-bcfc-c9936d452b5e") : secret "dns-default-metrics-tls" not found
May 26 21:45:22.307685 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.307628    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88" event={"ID":"6782e7c9-730f-40f9-b7de-12b52ff8a710","Type":"ContainerStarted","Data":"317f03ef4782c3aee4cf45322bf05ffdabc2384615ea8e5e5e5398a22e297b7f"}
May 26 21:45:22.308797 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.308757    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" event={"ID":"3725d185-6a8f-4642-ab6a-1bc36443acfd","Type":"ContainerStarted","Data":"7223c0dafa8623f122e884c3a53e3dc1b794a0fd4fe6fad8801f45d7c86f5ab5"}
May 26 21:45:22.309882 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:22.309860    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx" event={"ID":"bb2cd3cd-96ca-46a1-bf02-758ae3257048","Type":"ContainerStarted","Data":"3e43c639c2448463b4d163eec02e0121e5bf16db2e6fc68798ac3d9bf170af48"}
May 26 21:45:23.035575 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.035539    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:23.036357 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.035539    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:23.038251 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.038225    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 21:45:23.038387 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.038227    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 21:45:23.038959 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.038938    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwrc\""
May 26 21:45:23.039079 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.039023    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 21:45:23.105591 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.105562    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:23.105727 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.105626    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:23.105727 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:23.105716    2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 21:45:23.105855 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:23.105732    2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c586759c8-snvtx: secret "image-registry-tls" not found
May 26 21:45:23.105855 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:23.105805    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 21:45:23.105855 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:23.105813    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls podName:200f9d44-5f0f-49cb-bc0a-d6a5c691fb15 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:25.10577871 +0000 UTC m=+37.577007393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls") pod "image-registry-7c586759c8-snvtx" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15") : secret "image-registry-tls" not found
May 26 21:45:23.105990 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:23.105881    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert podName:6a05e282-0bcd-469e-b857-46a800cd3e33 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:25.105863618 +0000 UTC m=+37.577092266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-mnjkw" (UID: "6a05e282-0bcd-469e-b857-46a800cd3e33") : secret "networking-console-plugin-cert" not found
May 26 21:45:23.206506 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.206478    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:23.206678 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:23.206649    2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:23.206732 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:23.206722    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert podName:7f055d13-27ca-4f6f-9a34-bca0e9019972 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:25.206702967 +0000 UTC m=+37.677931612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert") pod "ingress-canary-j6kzz" (UID: "7f055d13-27ca-4f6f-9a34-bca0e9019972") : secret "canary-serving-cert" not found
May 26 21:45:23.307094 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:23.307007    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:23.307254 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:23.307181    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:23.307308 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:23.307256    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls podName:c84ee120-332c-4146-bcfc-c9936d452b5e nodeName:}" failed. No retries permitted until 2026-05-26 21:45:25.307240565 +0000 UTC m=+37.778469226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls") pod "dns-default-6prn2" (UID: "c84ee120-332c-4146-bcfc-c9936d452b5e") : secret "dns-default-metrics-tls" not found
May 26 21:45:25.122911 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:25.122091    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:25.122911 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:25.122162    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:25.122911 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:25.122325    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 21:45:25.122911 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:25.122390    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert podName:6a05e282-0bcd-469e-b857-46a800cd3e33 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:29.122370959 +0000 UTC m=+41.593599607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-mnjkw" (UID: "6a05e282-0bcd-469e-b857-46a800cd3e33") : secret "networking-console-plugin-cert" not found
May 26 21:45:25.122911 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:25.122822    2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 21:45:25.122911 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:25.122837    2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c586759c8-snvtx: secret "image-registry-tls" not found
May 26 21:45:25.122911 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:25.122886    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls podName:200f9d44-5f0f-49cb-bc0a-d6a5c691fb15 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:29.12287096 +0000 UTC m=+41.594099604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls") pod "image-registry-7c586759c8-snvtx" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15") : secret "image-registry-tls" not found
May 26 21:45:25.224076 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:25.223467    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:25.224076 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:25.223653    2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:25.224076 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:25.223712    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert podName:7f055d13-27ca-4f6f-9a34-bca0e9019972 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:29.223694034 +0000 UTC m=+41.694922677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert") pod "ingress-canary-j6kzz" (UID: "7f055d13-27ca-4f6f-9a34-bca0e9019972") : secret "canary-serving-cert" not found
May 26 21:45:25.325449 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:25.324723    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:25.325449 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:25.324995    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:25.325449 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:25.325056    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls podName:c84ee120-332c-4146-bcfc-c9936d452b5e nodeName:}" failed. No retries permitted until 2026-05-26 21:45:29.325037749 +0000 UTC m=+41.796266394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls") pod "dns-default-6prn2" (UID: "c84ee120-332c-4146-bcfc-c9936d452b5e") : secret "dns-default-metrics-tls" not found
May 26 21:45:25.330055 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:25.329135    2555 generic.go:358] "Generic (PLEG): container finished" podID="d03c3de9-2085-4370-bac2-f91be20e9bee" containerID="9a7165bddeed4629c3b5c03bc881b8fe481b5b224278c5401d7218b764e70bac" exitCode=0
May 26 21:45:25.330055 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:25.329212    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llsb5" event={"ID":"d03c3de9-2085-4370-bac2-f91be20e9bee","Type":"ContainerDied","Data":"9a7165bddeed4629c3b5c03bc881b8fe481b5b224278c5401d7218b764e70bac"}
May 26 21:45:26.334536 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:26.334285    2555 generic.go:358] "Generic (PLEG): container finished" podID="d03c3de9-2085-4370-bac2-f91be20e9bee" containerID="79bd8be7bdf3191491c6208bd25963a7a23b5a96feeffa56d30749c3f3ce89e0" exitCode=0
May 26 21:45:26.334991 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:26.334497    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llsb5" event={"ID":"d03c3de9-2085-4370-bac2-f91be20e9bee","Type":"ContainerDied","Data":"79bd8be7bdf3191491c6208bd25963a7a23b5a96feeffa56d30749c3f3ce89e0"}
May 26 21:45:29.160456 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:29.160421    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:29.160955 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:29.160473    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:29.160955 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:29.160592    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 21:45:29.160955 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:29.160594    2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 21:45:29.160955 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:29.160618    2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c586759c8-snvtx: secret "image-registry-tls" not found
May 26 21:45:29.160955 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:29.160653    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert podName:6a05e282-0bcd-469e-b857-46a800cd3e33 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:37.160637517 +0000 UTC m=+49.631866161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-mnjkw" (UID: "6a05e282-0bcd-469e-b857-46a800cd3e33") : secret "networking-console-plugin-cert" not found
May 26 21:45:29.160955 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:29.160667    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls podName:200f9d44-5f0f-49cb-bc0a-d6a5c691fb15 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:37.160661057 +0000 UTC m=+49.631889698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls") pod "image-registry-7c586759c8-snvtx" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15") : secret "image-registry-tls" not found
May 26 21:45:29.261110 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:29.261072    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:29.261295 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:29.261215    2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:29.261295 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:29.261278    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert podName:7f055d13-27ca-4f6f-9a34-bca0e9019972 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:37.261260214 +0000 UTC m=+49.732488878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert") pod "ingress-canary-j6kzz" (UID: "7f055d13-27ca-4f6f-9a34-bca0e9019972") : secret "canary-serving-cert" not found
May 26 21:45:29.361880 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:29.361845    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:29.362049 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:29.361984    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:29.362122 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:29.362050    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls podName:c84ee120-332c-4146-bcfc-c9936d452b5e nodeName:}" failed. No retries permitted until 2026-05-26 21:45:37.362032506 +0000 UTC m=+49.833261147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls") pod "dns-default-6prn2" (UID: "c84ee120-332c-4146-bcfc-c9936d452b5e") : secret "dns-default-metrics-tls" not found
May 26 21:45:32.347987 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:32.347951    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88" event={"ID":"6782e7c9-730f-40f9-b7de-12b52ff8a710","Type":"ContainerStarted","Data":"9c7af548d710cfe1e1a9977ffb1cb822b55afb3235aa2c89b451b03de800338d"}
May 26 21:45:32.350722 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:32.350699    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llsb5" event={"ID":"d03c3de9-2085-4370-bac2-f91be20e9bee","Type":"ContainerStarted","Data":"956b0208ad6e4d36bb3791cc6f7c9bf542e717a0b50b55d8cafa87b87e674f25"}
May 26 21:45:32.352037 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:32.352017    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" event={"ID":"3725d185-6a8f-4642-ab6a-1bc36443acfd","Type":"ContainerStarted","Data":"003b6c4db65e2b1a40890b3ab1998c54e99c159a24456b1ee2aac8641c020ed1"}
May 26 21:45:32.353094 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:32.353074    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx" event={"ID":"bb2cd3cd-96ca-46a1-bf02-758ae3257048","Type":"ContainerStarted","Data":"fc922683c10ef9b9b76897f53560eca91e62f76f32b87b90f125e3a9eb587ca8"}
May 26 21:45:32.353268 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:32.353255    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:32.354836 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:32.354819    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:45:32.363700 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:32.363658    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88" podStartSLOduration=28.807402522 podStartE2EDuration="38.36364815s" podCreationTimestamp="2026-05-26 21:44:54 +0000 UTC" firstStartedPulling="2026-05-26 21:45:21.908335465 +0000 UTC m=+34.379564106" lastFinishedPulling="2026-05-26 21:45:31.464581079 +0000 UTC m=+43.935809734" observedRunningTime="2026-05-26 21:45:32.362241277 +0000 UTC m=+44.833469941" watchObservedRunningTime="2026-05-26 21:45:32.36364815 +0000 UTC m=+44.834876843"
May 26 21:45:32.382920 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:32.382884    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-llsb5" podStartSLOduration=9.248578484 podStartE2EDuration="44.382873688s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:44:49.307021363 +0000 UTC m=+1.778250003" lastFinishedPulling="2026-05-26 21:45:24.441316563 +0000 UTC m=+36.912545207" observedRunningTime="2026-05-26 21:45:32.38201093 +0000 UTC m=+44.853239605" watchObservedRunningTime="2026-05-26 21:45:32.382873688 +0000 UTC m=+44.854102351"
May 26 21:45:32.397570 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:32.397533    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx" podStartSLOduration=28.835780859 podStartE2EDuration="38.397521885s" podCreationTimestamp="2026-05-26 21:44:54 +0000 UTC" firstStartedPulling="2026-05-26 21:45:21.920218984 +0000 UTC m=+34.391447639" lastFinishedPulling="2026-05-26 21:45:31.481960009 +0000 UTC m=+43.953188665" observedRunningTime="2026-05-26 21:45:32.39694252 +0000 UTC m=+44.868171180" watchObservedRunningTime="2026-05-26 21:45:32.397521885 +0000 UTC m=+44.868750587"
May 26 21:45:35.359957 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:35.359920    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" event={"ID":"3725d185-6a8f-4642-ab6a-1bc36443acfd","Type":"ContainerStarted","Data":"63942bbf1e66d108866a06dc163a3314a0220bc2cc19da6fad7ec92d550df412"}
May 26 21:45:35.360287 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:35.359962    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" event={"ID":"3725d185-6a8f-4642-ab6a-1bc36443acfd","Type":"ContainerStarted","Data":"71d5ba822da12ea8ec6bb1cebd8210a8373eeb8fd00e0f4a98785c31dffc25fc"}
May 26 21:45:35.379903 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:35.379861    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" podStartSLOduration=28.623077355 podStartE2EDuration="41.379849415s" podCreationTimestamp="2026-05-26 21:44:54 +0000 UTC" firstStartedPulling="2026-05-26 21:45:21.908371187 +0000 UTC m=+34.379599845" lastFinishedPulling="2026-05-26 21:45:34.665143264 +0000 UTC m=+47.136371905" observedRunningTime="2026-05-26 21:45:35.378829919 +0000 UTC m=+47.850058583" watchObservedRunningTime="2026-05-26 21:45:35.379849415 +0000 UTC m=+47.851078077"
May 26 21:45:35.513322 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:35.513286    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:35.516301 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:35.516273    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682d0998-1e7b-4e5f-ac59-08a8addc2652-original-pull-secret\") pod \"global-pull-secret-syncer-9d89z\" (UID: \"682d0998-1e7b-4e5f-ac59-08a8addc2652\") " pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:35.652956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:35.652888    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d89z"
May 26 21:45:35.769638 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:35.769587    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9d89z"]
May 26 21:45:35.772935 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:45:35.772900    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682d0998_1e7b_4e5f_ac59_08a8addc2652.slice/crio-9f108c9a20927970a8ca353b350b1a6d21b94fbcc3eb92a097293c698bde1d31 WatchSource:0}: Error finding container 9f108c9a20927970a8ca353b350b1a6d21b94fbcc3eb92a097293c698bde1d31: Status 404 returned error can't find the container with id 9f108c9a20927970a8ca353b350b1a6d21b94fbcc3eb92a097293c698bde1d31
May 26 21:45:36.362988 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:36.362948    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9d89z" event={"ID":"682d0998-1e7b-4e5f-ac59-08a8addc2652","Type":"ContainerStarted","Data":"9f108c9a20927970a8ca353b350b1a6d21b94fbcc3eb92a097293c698bde1d31"}
May 26 21:45:37.227205 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:37.227168    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:37.227388 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:37.227231    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:37.227442 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:37.227394    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 21:45:37.227442 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:37.227408    2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 21:45:37.227442 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:37.227426    2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c586759c8-snvtx: secret "image-registry-tls" not found
May 26 21:45:37.227548 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:37.227465    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert podName:6a05e282-0bcd-469e-b857-46a800cd3e33 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:53.227449811 +0000 UTC m=+65.698678455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-mnjkw" (UID: "6a05e282-0bcd-469e-b857-46a800cd3e33") : secret "networking-console-plugin-cert" not found
May 26 21:45:37.227548 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:37.227480    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls podName:200f9d44-5f0f-49cb-bc0a-d6a5c691fb15 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:53.227473283 +0000 UTC m=+65.698701924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls") pod "image-registry-7c586759c8-snvtx" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15") : secret "image-registry-tls" not found
May 26 21:45:37.327873 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:37.327828    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:37.328049 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:37.328006    2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:37.328110 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:37.328086    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert podName:7f055d13-27ca-4f6f-9a34-bca0e9019972 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:53.328065772 +0000 UTC m=+65.799294433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert") pod "ingress-canary-j6kzz" (UID: "7f055d13-27ca-4f6f-9a34-bca0e9019972") : secret "canary-serving-cert" not found
May 26 21:45:37.428941 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:37.428909    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:37.429379 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:37.429042    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:37.429379 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:37.429155    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls podName:c84ee120-332c-4146-bcfc-c9936d452b5e nodeName:}" failed. No retries permitted until 2026-05-26 21:45:53.429131943 +0000 UTC m=+65.900360597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls") pod "dns-default-6prn2" (UID: "c84ee120-332c-4146-bcfc-c9936d452b5e") : secret "dns-default-metrics-tls" not found
May 26 21:45:40.373603 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:40.373566    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9d89z" event={"ID":"682d0998-1e7b-4e5f-ac59-08a8addc2652","Type":"ContainerStarted","Data":"e48f79906e539672218342ec9da5018c15a21796249f83e3975cb1a6ba4b7c1e"}
May 26 21:45:40.388570 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:40.388525    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9d89z" podStartSLOduration=33.249321537 podStartE2EDuration="37.388512011s" podCreationTimestamp="2026-05-26 21:45:03 +0000 UTC" firstStartedPulling="2026-05-26 21:45:35.774528443 +0000 UTC m=+48.245757087" lastFinishedPulling="2026-05-26 21:45:39.913718919 +0000 UTC m=+52.384947561" observedRunningTime="2026-05-26 21:45:40.388056723 +0000 UTC m=+52.859285385" watchObservedRunningTime="2026-05-26 21:45:40.388512011 +0000 UTC m=+52.859740670"
May 26 21:45:47.313617 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:47.313589    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-66skj"
May 26 21:45:52.854830 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:52.854765    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:45:52.857568 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:52.857549    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 21:45:52.865541 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:52.865524    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 21:45:52.865606 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:52.865596    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs podName:6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8 nodeName:}" failed. No retries permitted until 2026-05-26 21:46:56.865564231 +0000 UTC m=+129.336792871 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs") pod "network-metrics-daemon-2hnq5" (UID: "6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8") : secret "metrics-daemon-secret" not found
May 26 21:45:52.955955 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:52.955918    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:52.958540 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:52.958519    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 21:45:52.968365 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:52.968343    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 21:45:52.979418 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:52.979399    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24xsw\" (UniqueName: \"kubernetes.io/projected/6e73fa00-c8fd-4fdc-9de0-d631225ab749-kube-api-access-24xsw\") pod \"network-check-target-vxxnf\" (UID: \"6e73fa00-c8fd-4fdc-9de0-d631225ab749\") " pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:53.049841 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:53.049816    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwrc\""
May 26 21:45:53.057640 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:53.057614    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:53.171233 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:53.171197    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vxxnf"]
May 26 21:45:53.174077 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:45:53.174046    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e73fa00_c8fd_4fdc_9de0_d631225ab749.slice/crio-88d14c3680469b5fce3e38d86518a068de89f07004ca0546a1f646e89bcc3044 WatchSource:0}: Error finding container 88d14c3680469b5fce3e38d86518a068de89f07004ca0546a1f646e89bcc3044: Status 404 returned error can't find the container with id 88d14c3680469b5fce3e38d86518a068de89f07004ca0546a1f646e89bcc3044
May 26 21:45:53.257710 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:53.257674    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:45:53.257882 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:53.257730    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:45:53.257882 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:53.257862    2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 21:45:53.257990 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:53.257885    2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c586759c8-snvtx: secret "image-registry-tls" not found
May 26 21:45:53.257990 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:53.257905    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 21:45:53.257990 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:53.257951    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls podName:200f9d44-5f0f-49cb-bc0a-d6a5c691fb15 nodeName:}" failed. No retries permitted until 2026-05-26 21:46:25.257933137 +0000 UTC m=+97.729161782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls") pod "image-registry-7c586759c8-snvtx" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15") : secret "image-registry-tls" not found
May 26 21:45:53.257990 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:53.257969    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert podName:6a05e282-0bcd-469e-b857-46a800cd3e33 nodeName:}" failed. No retries permitted until 2026-05-26 21:46:25.257961271 +0000 UTC m=+97.729189912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-mnjkw" (UID: "6a05e282-0bcd-469e-b857-46a800cd3e33") : secret "networking-console-plugin-cert" not found
May 26 21:45:53.358509 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:53.358470    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:45:53.358667 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:53.358636    2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:53.358707 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:53.358699    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert podName:7f055d13-27ca-4f6f-9a34-bca0e9019972 nodeName:}" failed. No retries permitted until 2026-05-26 21:46:25.358683284 +0000 UTC m=+97.829911924 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert") pod "ingress-canary-j6kzz" (UID: "7f055d13-27ca-4f6f-9a34-bca0e9019972") : secret "canary-serving-cert" not found
May 26 21:45:53.409382 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:53.409307    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vxxnf" event={"ID":"6e73fa00-c8fd-4fdc-9de0-d631225ab749","Type":"ContainerStarted","Data":"88d14c3680469b5fce3e38d86518a068de89f07004ca0546a1f646e89bcc3044"}
May 26 21:45:53.459698 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:53.459666    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:45:53.459847 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:53.459831    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:53.459909 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:45:53.459899    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls podName:c84ee120-332c-4146-bcfc-c9936d452b5e nodeName:}" failed. No retries permitted until 2026-05-26 21:46:25.459874175 +0000 UTC m=+97.931102830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls") pod "dns-default-6prn2" (UID: "c84ee120-332c-4146-bcfc-c9936d452b5e") : secret "dns-default-metrics-tls" not found
May 26 21:45:57.420550 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:57.420515    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vxxnf" event={"ID":"6e73fa00-c8fd-4fdc-9de0-d631225ab749","Type":"ContainerStarted","Data":"af45008a4dc912c8ea18216e8101f7d3680b82904f6a471dc2b68137580e2a7e"}
May 26 21:45:57.420972 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:57.420646    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:45:57.435035 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:45:57.434897    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vxxnf" podStartSLOduration=66.168589632 podStartE2EDuration="1m9.434883893s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:45:53.175973196 +0000 UTC m=+65.647201837" lastFinishedPulling="2026-05-26 21:45:56.442267453 +0000 UTC m=+68.913496098" observedRunningTime="2026-05-26 21:45:57.434211564 +0000 UTC m=+69.905440228" watchObservedRunningTime="2026-05-26 21:45:57.434883893 +0000 UTC m=+69.906112557"
May 26 21:46:25.297984 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:46:25.297943    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:46:25.298438 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:46:25.298022    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:46:25.298438 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:25.298077    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 21:46:25.298438 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:25.298100    2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 21:46:25.298438 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:25.298111    2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c586759c8-snvtx: secret "image-registry-tls" not found
May 26 21:46:25.298438 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:25.298160    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls podName:200f9d44-5f0f-49cb-bc0a-d6a5c691fb15 nodeName:}" failed. No retries permitted until 2026-05-26 21:47:29.298145672 +0000 UTC m=+161.769374312 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls") pod "image-registry-7c586759c8-snvtx" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15") : secret "image-registry-tls" not found
May 26 21:46:25.298438 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:25.298172    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert podName:6a05e282-0bcd-469e-b857-46a800cd3e33 nodeName:}" failed. No retries permitted until 2026-05-26 21:47:29.298166372 +0000 UTC m=+161.769395012 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-mnjkw" (UID: "6a05e282-0bcd-469e-b857-46a800cd3e33") : secret "networking-console-plugin-cert" not found
May 26 21:46:25.399028 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:46:25.398983    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:46:25.399189 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:25.399126    2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:46:25.399189 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:25.399185    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert podName:7f055d13-27ca-4f6f-9a34-bca0e9019972 nodeName:}" failed. No retries permitted until 2026-05-26 21:47:29.399171067 +0000 UTC m=+161.870399710 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert") pod "ingress-canary-j6kzz" (UID: "7f055d13-27ca-4f6f-9a34-bca0e9019972") : secret "canary-serving-cert" not found
May 26 21:46:25.500071 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:46:25.500040    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:46:25.500226 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:25.500184    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:46:25.500266 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:25.500239    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls podName:c84ee120-332c-4146-bcfc-c9936d452b5e nodeName:}" failed. No retries permitted until 2026-05-26 21:47:29.500224978 +0000 UTC m=+161.971453620 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls") pod "dns-default-6prn2" (UID: "c84ee120-332c-4146-bcfc-c9936d452b5e") : secret "dns-default-metrics-tls" not found
May 26 21:46:28.425805 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:46:28.425763    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vxxnf"
May 26 21:46:56.927412 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:46:56.927371    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:46:56.927890 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:56.927524    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 21:46:56.927890 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:46:56.927599    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs podName:6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8 nodeName:}" failed. No retries permitted until 2026-05-26 21:48:58.927581928 +0000 UTC m=+251.398810569 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs") pod "network-metrics-daemon-2hnq5" (UID: "6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8") : secret "metrics-daemon-secret" not found
May 26 21:47:03.875499 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:03.875473    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lrpn5_2bedbab1-b03a-4449-9f46-1e8ff5fa26ea/dns-node-resolver/0.log"
May 26 21:47:05.075641 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:05.075612    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z8x82_fd64cdb9-323e-45e7-90b7-dce5d0bbba90/node-ca/0.log"
May 26 21:47:24.391520 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:47:24.391477    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw" podUID="6a05e282-0bcd-469e-b857-46a800cd3e33"
May 26 21:47:24.401665 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:47:24.401634    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c586759c8-snvtx" podUID="200f9d44-5f0f-49cb-bc0a-d6a5c691fb15"
May 26 21:47:24.447948 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:47:24.447916    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-j6kzz" podUID="7f055d13-27ca-4f6f-9a34-bca0e9019972"
May 26 21:47:24.518317 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:47:24.518284    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6prn2" podUID="c84ee120-332c-4146-bcfc-c9936d452b5e"
May 26 21:47:24.615270 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:24.615241    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6prn2"
May 26 21:47:24.615435 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:24.615291    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:47:24.615482 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:24.615435    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:47:24.615523 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:24.615505    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:47:25.049021 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:47:25.048979    2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2hnq5" podUID="6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8"
May 26 21:47:29.377054 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.377006    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:47:29.377547 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.377177    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:47:29.379447 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.379425    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"image-registry-7c586759c8-snvtx\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") " pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:47:29.379562 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.379529    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a05e282-0bcd-469e-b857-46a800cd3e33-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-mnjkw\" (UID: \"6a05e282-0bcd-469e-b857-46a800cd3e33\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:47:29.418883 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.418861    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xnc2k\""
May 26 21:47:29.419008 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.418861    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-plmgr\""
May 26 21:47:29.426931 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.426900    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:47:29.427021 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.426958    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"
May 26 21:47:29.478567 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.478470    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:47:29.482586 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.482531    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f055d13-27ca-4f6f-9a34-bca0e9019972-cert\") pod \"ingress-canary-j6kzz\" (UID: \"7f055d13-27ca-4f6f-9a34-bca0e9019972\") " pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:47:29.551051 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.551016    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw"]
May 26 21:47:29.555133 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:47:29.555094    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a05e282_0bcd_469e_b857_46a800cd3e33.slice/crio-19499d63a15a4de9cbd01792591cffbf9213ec77dd7af92c7774dc26a7745d2a WatchSource:0}: Error finding container 19499d63a15a4de9cbd01792591cffbf9213ec77dd7af92c7774dc26a7745d2a: Status 404 returned error can't find the container with id 19499d63a15a4de9cbd01792591cffbf9213ec77dd7af92c7774dc26a7745d2a
May 26 21:47:29.572968 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.572941    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c586759c8-snvtx"]
May 26 21:47:29.575543 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:47:29.575518    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200f9d44_5f0f_49cb_bc0a_d6a5c691fb15.slice/crio-006d94b90d3ce41d4cc05c48238f662d2a91e078c1840e80dceedb3f501693bf WatchSource:0}: Error finding container 006d94b90d3ce41d4cc05c48238f662d2a91e078c1840e80dceedb3f501693bf: Status 404 returned error can't find the container with id 006d94b90d3ce41d4cc05c48238f662d2a91e078c1840e80dceedb3f501693bf
May 26 21:47:29.580099 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.580082    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:47:29.582177 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.582154    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c84ee120-332c-4146-bcfc-c9936d452b5e-metrics-tls\") pod \"dns-default-6prn2\" (UID: \"c84ee120-332c-4146-bcfc-c9936d452b5e\") " pod="openshift-dns/dns-default-6prn2"
May 26 21:47:29.626522 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.626495    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw" event={"ID":"6a05e282-0bcd-469e-b857-46a800cd3e33","Type":"ContainerStarted","Data":"19499d63a15a4de9cbd01792591cffbf9213ec77dd7af92c7774dc26a7745d2a"}
May 26 21:47:29.627498 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.627446    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c586759c8-snvtx" event={"ID":"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15","Type":"ContainerStarted","Data":"006d94b90d3ce41d4cc05c48238f662d2a91e078c1840e80dceedb3f501693bf"}
May 26 21:47:29.718830 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.718802    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhpgm\""
May 26 21:47:29.718981 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.718925    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6lg2j\""
May 26 21:47:29.726772 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.726753    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6prn2"
May 26 21:47:29.726879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.726773    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j6kzz"
May 26 21:47:29.865002 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.864965    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6prn2"]
May 26 21:47:29.868272 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:47:29.868250    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84ee120_332c_4146_bcfc_c9936d452b5e.slice/crio-bd7dcc0071caef962edf5d18a10169677dd63392ab5fbe1890031170f8692c03 WatchSource:0}: Error finding container bd7dcc0071caef962edf5d18a10169677dd63392ab5fbe1890031170f8692c03: Status 404 returned error can't find the container with id bd7dcc0071caef962edf5d18a10169677dd63392ab5fbe1890031170f8692c03
May 26 21:47:29.878252 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:29.878198    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j6kzz"]
May 26 21:47:29.883328 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:47:29.883307    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f055d13_27ca_4f6f_9a34_bca0e9019972.slice/crio-1dfa4c88ae8e46fbba2b482794095a85e66102bbba7ab480b8a033f424a92486 WatchSource:0}: Error finding container 1dfa4c88ae8e46fbba2b482794095a85e66102bbba7ab480b8a033f424a92486: Status 404 returned error can't find the container with id 1dfa4c88ae8e46fbba2b482794095a85e66102bbba7ab480b8a033f424a92486
May 26 21:47:30.632048 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:30.632008    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j6kzz" event={"ID":"7f055d13-27ca-4f6f-9a34-bca0e9019972","Type":"ContainerStarted","Data":"1dfa4c88ae8e46fbba2b482794095a85e66102bbba7ab480b8a033f424a92486"}
May 26 21:47:30.633456 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:30.633412    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c586759c8-snvtx" event={"ID":"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15","Type":"ContainerStarted","Data":"4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d"}
May 26 21:47:30.633583 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:30.633520    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:47:30.634736 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:30.634714    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6prn2" event={"ID":"c84ee120-332c-4146-bcfc-c9936d452b5e","Type":"ContainerStarted","Data":"bd7dcc0071caef962edf5d18a10169677dd63392ab5fbe1890031170f8692c03"}
May 26 21:47:30.654499 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:30.654116    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c586759c8-snvtx" podStartSLOduration=162.65408228 podStartE2EDuration="2m42.65408228s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 21:47:30.65310102 +0000 UTC m=+163.124329685" watchObservedRunningTime="2026-05-26 21:47:30.65408228 +0000 UTC m=+163.125310945"
May 26 21:47:31.638360 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:31.638316    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw" event={"ID":"6a05e282-0bcd-469e-b857-46a800cd3e33","Type":"ContainerStarted","Data":"07048b74609e779f35a3ac6bbe6728d169a1c761d4518be4afe0cb9157a4d190"}
May 26 21:47:31.655213 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:31.655160    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-mnjkw" podStartSLOduration=151.319846973 podStartE2EDuration="2m32.655141879s" podCreationTimestamp="2026-05-26 21:44:59 +0000 UTC" firstStartedPulling="2026-05-26 21:47:29.557017027 +0000 UTC m=+162.028245667" lastFinishedPulling="2026-05-26 21:47:30.892311924 +0000 UTC m=+163.363540573" observedRunningTime="2026-05-26 21:47:31.653326118 +0000 UTC m=+164.124554782" watchObservedRunningTime="2026-05-26 21:47:31.655141879 +0000 UTC m=+164.126370551"
May 26 21:47:31.726102 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:31.726060    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88" podUID="6782e7c9-730f-40f9-b7de-12b52ff8a710" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/healthz\": dial tcp 10.132.0.8:8000: connect: connection refused"
May 26 21:47:31.728439 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:31.728407    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx" podUID="bb2cd3cd-96ca-46a1-bf02-758ae3257048" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/healthz\": dial tcp 10.132.0.10:8000: connect: connection refused"
May 26 21:47:32.354074 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.354030    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx" podUID="bb2cd3cd-96ca-46a1-bf02-758ae3257048" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
May 26 21:47:32.642119 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.642035    2555 generic.go:358] "Generic (PLEG): container finished" podID="6782e7c9-730f-40f9-b7de-12b52ff8a710" containerID="9c7af548d710cfe1e1a9977ffb1cb822b55afb3235aa2c89b451b03de800338d" exitCode=255
May 26 21:47:32.642496 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.642108    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88" event={"ID":"6782e7c9-730f-40f9-b7de-12b52ff8a710","Type":"ContainerDied","Data":"9c7af548d710cfe1e1a9977ffb1cb822b55afb3235aa2c89b451b03de800338d"}
May 26 21:47:32.642496 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.642411    2555 scope.go:117] "RemoveContainer" containerID="9c7af548d710cfe1e1a9977ffb1cb822b55afb3235aa2c89b451b03de800338d"
May 26 21:47:32.643356 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.643331    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j6kzz" event={"ID":"7f055d13-27ca-4f6f-9a34-bca0e9019972","Type":"ContainerStarted","Data":"90288ee79eed0ccb1e9f52db9e46a7af1f202278ce1fac56e2b5751ae8c5b535"}
May 26 21:47:32.644912 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.644895    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6prn2" event={"ID":"c84ee120-332c-4146-bcfc-c9936d452b5e","Type":"ContainerStarted","Data":"1b0ef1362ec2b560abb7d6b7b74f0908e6b7214881b6788a023adfa179682f0c"}
May 26 21:47:32.644978 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.644927    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6prn2"
May 26 21:47:32.644978 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.644943    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6prn2" event={"ID":"c84ee120-332c-4146-bcfc-c9936d452b5e","Type":"ContainerStarted","Data":"ba166374a0a99ed7140b531910ca414589e29f2f31e437cef1addc69f1dd9a32"}
May 26 21:47:32.646124 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.646100    2555 generic.go:358] "Generic (PLEG): container finished" podID="bb2cd3cd-96ca-46a1-bf02-758ae3257048" containerID="fc922683c10ef9b9b76897f53560eca91e62f76f32b87b90f125e3a9eb587ca8" exitCode=1
May 26 21:47:32.646223 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.646162    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx" event={"ID":"bb2cd3cd-96ca-46a1-bf02-758ae3257048","Type":"ContainerDied","Data":"fc922683c10ef9b9b76897f53560eca91e62f76f32b87b90f125e3a9eb587ca8"}
May 26 21:47:32.646526 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.646510    2555 scope.go:117] "RemoveContainer" containerID="fc922683c10ef9b9b76897f53560eca91e62f76f32b87b90f125e3a9eb587ca8"
May 26 21:47:32.697912 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.697866    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6prn2" podStartSLOduration=129.663905692 podStartE2EDuration="2m11.697850974s" podCreationTimestamp="2026-05-26 21:45:21 +0000 UTC" firstStartedPulling="2026-05-26 21:47:29.870195806 +0000 UTC m=+162.341424446" lastFinishedPulling="2026-05-26 21:47:31.904141073 +0000 UTC m=+164.375369728" observedRunningTime="2026-05-26 21:47:32.6971725 +0000 UTC m=+165.168401164" watchObservedRunningTime="2026-05-26 21:47:32.697850974 +0000 UTC m=+165.169079635"
May 26 21:47:32.732625 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:32.732573    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j6kzz" podStartSLOduration=129.709569708 podStartE2EDuration="2m11.732559274s" podCreationTimestamp="2026-05-26 21:45:21 +0000 UTC" firstStartedPulling="2026-05-26 21:47:29.884939349 +0000 UTC m=+162.356167990" lastFinishedPulling="2026-05-26 21:47:31.90792891 +0000 UTC m=+164.379157556" observedRunningTime="2026-05-26 21:47:32.731953186 +0000 UTC m=+165.203181850" watchObservedRunningTime="2026-05-26 21:47:32.732559274 +0000 UTC m=+165.203787936"
May 26 21:47:33.650129 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:33.650094    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx" event={"ID":"bb2cd3cd-96ca-46a1-bf02-758ae3257048","Type":"ContainerStarted","Data":"a95149170961ea8b0d14a37263af07f550ff05e3dc0d3191963db652f329da2c"}
May 26 21:47:33.650509 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:33.650402    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:47:33.651308 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:33.651283    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57db448778-q97qx"
May 26 21:47:33.651771 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:33.651747    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb6b7c8d6-cdl88" event={"ID":"6782e7c9-730f-40f9-b7de-12b52ff8a710","Type":"ContainerStarted","Data":"ab8d5f75604a362dc1c7afbd85c01c2d315fb6c2908bd68660f66d293edc9ad6"}
May 26 21:47:37.233854 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.233827    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rsmk9"]
May 26 21:47:37.236845 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.236825    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.245261 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.245244    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 21:47:37.245261 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.245256    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6lp6h\""
May 26 21:47:37.245432 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.245247    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 21:47:37.245432 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.245273    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 21:47:37.245432 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.245259    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 21:47:37.259909 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.257234    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rsmk9"]
May 26 21:47:37.338223 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.338195    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac609b15-0d1d-41a1-82cf-3440fad6b48a-crio-socket\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.338362 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.338232    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac609b15-0d1d-41a1-82cf-3440fad6b48a-data-volume\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.338362 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.338252    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsbk9\" (UniqueName: \"kubernetes.io/projected/ac609b15-0d1d-41a1-82cf-3440fad6b48a-kube-api-access-lsbk9\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.338471 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.338384    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac609b15-0d1d-41a1-82cf-3440fad6b48a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.338471 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.338425    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac609b15-0d1d-41a1-82cf-3440fad6b48a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.439034 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.439004    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac609b15-0d1d-41a1-82cf-3440fad6b48a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.439166 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.439037    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac609b15-0d1d-41a1-82cf-3440fad6b48a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.439166 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.439066    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac609b15-0d1d-41a1-82cf-3440fad6b48a-crio-socket\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.439166 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.439086    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac609b15-0d1d-41a1-82cf-3440fad6b48a-data-volume\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.439166 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.439101    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsbk9\" (UniqueName: \"kubernetes.io/projected/ac609b15-0d1d-41a1-82cf-3440fad6b48a-kube-api-access-lsbk9\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.439340 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.439163    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac609b15-0d1d-41a1-82cf-3440fad6b48a-crio-socket\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.439513 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.439487    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac609b15-0d1d-41a1-82cf-3440fad6b48a-data-volume\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.439577 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.439529    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac609b15-0d1d-41a1-82cf-3440fad6b48a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.441386 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.441365    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac609b15-0d1d-41a1-82cf-3440fad6b48a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.447880 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.447861    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsbk9\" (UniqueName: \"kubernetes.io/projected/ac609b15-0d1d-41a1-82cf-3440fad6b48a-kube-api-access-lsbk9\") pod \"insights-runtime-extractor-rsmk9\" (UID: \"ac609b15-0d1d-41a1-82cf-3440fad6b48a\") " pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.545195 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.545138    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rsmk9"
May 26 21:47:37.667729 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:37.667696    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rsmk9"]
May 26 21:47:37.670503 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:47:37.670466    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac609b15_0d1d_41a1_82cf_3440fad6b48a.slice/crio-9b81c34b79f5548c1212b4864177bc4e70327f8b6f8c7c6f9c9459e09a2bb36d WatchSource:0}: Error finding container 9b81c34b79f5548c1212b4864177bc4e70327f8b6f8c7c6f9c9459e09a2bb36d: Status 404 returned error can't find the container with id 9b81c34b79f5548c1212b4864177bc4e70327f8b6f8c7c6f9c9459e09a2bb36d
May 26 21:47:38.667540 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:38.667506    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rsmk9" event={"ID":"ac609b15-0d1d-41a1-82cf-3440fad6b48a","Type":"ContainerStarted","Data":"3768f98b7e70c9999b7776a6e000b9d2f41c2175993deab8a214ec3d93eb8a72"}
May 26 21:47:38.667540 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:38.667541    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rsmk9" event={"ID":"ac609b15-0d1d-41a1-82cf-3440fad6b48a","Type":"ContainerStarted","Data":"b45c6b132225e79114b5c8f42a519d7bc3fa9d03ef4a560b598feef1443272c3"}
May 26 21:47:38.667944 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:38.667551    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rsmk9" event={"ID":"ac609b15-0d1d-41a1-82cf-3440fad6b48a","Type":"ContainerStarted","Data":"9b81c34b79f5548c1212b4864177bc4e70327f8b6f8c7c6f9c9459e09a2bb36d"}
May 26 21:47:40.036005 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:40.035968    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:47:40.674274 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:40.674233    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rsmk9" event={"ID":"ac609b15-0d1d-41a1-82cf-3440fad6b48a","Type":"ContainerStarted","Data":"a00566d9340148ba0d54a39c4189ee44cd376e3350c47005685c6e6ef5640d87"}
May 26 21:47:40.691724 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:40.691682    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rsmk9" podStartSLOduration=1.358874842 podStartE2EDuration="3.691668746s" podCreationTimestamp="2026-05-26 21:47:37 +0000 UTC" firstStartedPulling="2026-05-26 21:47:37.723238029 +0000 UTC m=+170.194466669" lastFinishedPulling="2026-05-26 21:47:40.056031922 +0000 UTC m=+172.527260573" observedRunningTime="2026-05-26 21:47:40.690350987 +0000 UTC m=+173.161579662" watchObservedRunningTime="2026-05-26 21:47:40.691668746 +0000 UTC m=+173.162897409"
May 26 21:47:42.653687 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:42.653656    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6prn2"
May 26 21:47:44.598359 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.598328    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g9h8k"]
May 26 21:47:44.601600 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.601579    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.604810 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.604764    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 21:47:44.604917 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.604840    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 21:47:44.605113 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.605099    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-424c5\""
May 26 21:47:44.605173 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.605109    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 21:47:44.605223 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.605173    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 21:47:44.605432 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.605413    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 21:47:44.605478 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.605457    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 21:47:44.692228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.692191    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-textfile\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.692228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.692227    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-wtmp\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.692424 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.692258    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.692424 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.692314    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-tls\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.692424 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.692346    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-accelerators-collector-config\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.692424 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.692385    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94e69c09-d976-41ff-ba97-c136515fa15d-metrics-client-ca\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.692424 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.692403    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94e69c09-d976-41ff-ba97-c136515fa15d-root\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.692574 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.692434    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mtd\" (UniqueName: \"kubernetes.io/projected/94e69c09-d976-41ff-ba97-c136515fa15d-kube-api-access-r8mtd\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.692574 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.692453    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94e69c09-d976-41ff-ba97-c136515fa15d-sys\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793007 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.792974    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-textfile\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793007 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793006    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-wtmp\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793026    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793046    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-tls\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793077    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-accelerators-collector-config\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793113    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94e69c09-d976-41ff-ba97-c136515fa15d-metrics-client-ca\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793136    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94e69c09-d976-41ff-ba97-c136515fa15d-root\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793175    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mtd\" (UniqueName: \"kubernetes.io/projected/94e69c09-d976-41ff-ba97-c136515fa15d-kube-api-access-r8mtd\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793180    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-wtmp\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793203    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94e69c09-d976-41ff-ba97-c136515fa15d-sys\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793613 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793244    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94e69c09-d976-41ff-ba97-c136515fa15d-sys\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793613 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793280    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94e69c09-d976-41ff-ba97-c136515fa15d-root\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793613 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793318    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-textfile\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793771 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793714    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94e69c09-d976-41ff-ba97-c136515fa15d-metrics-client-ca\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.793771 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.793761    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-accelerators-collector-config\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.795350 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.795324    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.795441 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.795408    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94e69c09-d976-41ff-ba97-c136515fa15d-node-exporter-tls\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.802409 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.802388    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mtd\" (UniqueName: \"kubernetes.io/projected/94e69c09-d976-41ff-ba97-c136515fa15d-kube-api-access-r8mtd\") pod \"node-exporter-g9h8k\" (UID: \"94e69c09-d976-41ff-ba97-c136515fa15d\") " pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:44.910558 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:44.910480    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g9h8k"
May 26 21:47:45.688080 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:45.688031    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g9h8k" event={"ID":"94e69c09-d976-41ff-ba97-c136515fa15d","Type":"ContainerStarted","Data":"477f2aa9f21a7cf5bc2746e5478947b8862e65a4e4eb62255e0e0af84d5e0dd0"}
May 26 21:47:46.691721 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:46.691685    2555 generic.go:358] "Generic (PLEG): container finished" podID="94e69c09-d976-41ff-ba97-c136515fa15d" containerID="b7cef40f43eb0d8a7cb6999ae5a0bfededde90cf242dc77fa1559e7a08e101d8" exitCode=0
May 26 21:47:46.692076 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:46.691746    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g9h8k" event={"ID":"94e69c09-d976-41ff-ba97-c136515fa15d","Type":"ContainerDied","Data":"b7cef40f43eb0d8a7cb6999ae5a0bfededde90cf242dc77fa1559e7a08e101d8"}
May 26 21:47:47.696093 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:47.696060    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g9h8k" event={"ID":"94e69c09-d976-41ff-ba97-c136515fa15d","Type":"ContainerStarted","Data":"40c08dc72908f565ce76dd32a1876fbeb80aadc6525d9ffce6fd4148c26314a6"}
May 26 21:47:47.696093 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:47.696096    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g9h8k" event={"ID":"94e69c09-d976-41ff-ba97-c136515fa15d","Type":"ContainerStarted","Data":"ef1d20366669f77a3869af4fc64f88915e46d57cd7a1f82e5cc4c8053d4eb7c3"}
May 26 21:47:47.718558 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:47.718512    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g9h8k" podStartSLOduration=2.824483843 podStartE2EDuration="3.71849799s" podCreationTimestamp="2026-05-26 21:47:44 +0000 UTC" firstStartedPulling="2026-05-26 21:47:44.921696121 +0000 UTC m=+177.392924762" lastFinishedPulling="2026-05-26 21:47:45.815710253 +0000 UTC m=+178.286938909" observedRunningTime="2026-05-26 21:47:47.716248649 +0000 UTC m=+180.187477312" watchObservedRunningTime="2026-05-26 21:47:47.71849799 +0000 UTC m=+180.189726651"
May 26 21:47:49.431538 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:49.431508    2555 patch_prober.go:28] interesting pod/image-registry-7c586759c8-snvtx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 26 21:47:49.431878 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:49.431558    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c586759c8-snvtx" podUID="200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 21:47:51.642047 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:51.642019    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:47:58.938108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:47:58.938073    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c586759c8-snvtx"]
May 26 21:48:11.720751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:11.720715    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j6kzz_7f055d13-27ca-4f6f-9a34-bca0e9019972/serve-healthcheck-canary/0.log"
May 26 21:48:11.736861 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:11.736830    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" podUID="3725d185-6a8f-4642-ab6a-1bc36443acfd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 21:48:21.737162 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:21.737120    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" podUID="3725d185-6a8f-4642-ab6a-1bc36443acfd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 21:48:23.956370 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:23.956310    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c586759c8-snvtx" podUID="200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" containerName="registry" containerID="cri-o://4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d" gracePeriod=30
May 26 21:48:24.230193 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.229827    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:48:24.295840 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.295810    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-installation-pull-secrets\") pod \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") "
May 26 21:48:24.296003 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.295857    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-image-registry-private-configuration\") pod \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") "
May 26 21:48:24.296003 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.295902    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-trusted-ca\") pod \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") "
May 26 21:48:24.296003 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.295929    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjjrh\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-kube-api-access-tjjrh\") pod \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") "
May 26 21:48:24.296003 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.295963    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-bound-sa-token\") pod \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") "
May 26 21:48:24.296003 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.295998    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-ca-trust-extracted\") pod \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") "
May 26 21:48:24.296267 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.296032    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-certificates\") pod \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") "
May 26 21:48:24.296267 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.296084    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") pod \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\" (UID: \"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15\") "
May 26 21:48:24.296827 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.296729    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:48:24.296827 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.296742    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:48:24.298733 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.298684    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:48:24.298733 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.298690    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:48:24.298922 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.298775    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:48:24.299174 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.299145    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:48:24.300113 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.300088    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-kube-api-access-tjjrh" (OuterVolumeSpecName: "kube-api-access-tjjrh") pod "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15"). InnerVolumeSpecName "kube-api-access-tjjrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:48:24.306092 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.306070    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" (UID: "200f9d44-5f0f-49cb-bc0a-d6a5c691fb15"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 21:48:24.397096 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.397047    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-tls\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:48:24.397096 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.397097    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-installation-pull-secrets\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:48:24.397264 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.397114    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-image-registry-private-configuration\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:48:24.397264 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.397129    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-trusted-ca\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:48:24.397264 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.397141    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjjrh\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-kube-api-access-tjjrh\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:48:24.397264 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.397152    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-bound-sa-token\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:48:24.397264 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.397164    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-ca-trust-extracted\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:48:24.397264 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.397176    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15-registry-certificates\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:48:24.789036 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.788999    2555 generic.go:358] "Generic (PLEG): container finished" podID="200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" containerID="4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d" exitCode=0
May 26 21:48:24.789208 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.789079    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c586759c8-snvtx"
May 26 21:48:24.789208 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.789082    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c586759c8-snvtx" event={"ID":"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15","Type":"ContainerDied","Data":"4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d"}
May 26 21:48:24.789208 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.789198    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c586759c8-snvtx" event={"ID":"200f9d44-5f0f-49cb-bc0a-d6a5c691fb15","Type":"ContainerDied","Data":"006d94b90d3ce41d4cc05c48238f662d2a91e078c1840e80dceedb3f501693bf"}
May 26 21:48:24.789346 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.789212    2555 scope.go:117] "RemoveContainer" containerID="4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d"
May 26 21:48:24.796919 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.796742    2555 scope.go:117] "RemoveContainer" containerID="4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d"
May 26 21:48:24.797119 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:48:24.797070    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d\": container with ID starting with 4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d not found: ID does not exist" containerID="4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d"
May 26 21:48:24.797229 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.797117    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d"} err="failed to get container status \"4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d\": rpc error: code = NotFound desc = could not find container \"4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d\": container with ID starting with 4d6a598f410d7a9ba1842511f725cf5acf2ba0137c5151e416c4fda9e286b62d not found: ID does not exist"
May 26 21:48:24.809679 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.809658    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c586759c8-snvtx"]
May 26 21:48:24.812951 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:24.812933    2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c586759c8-snvtx"]
May 26 21:48:26.040733 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:26.040695    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" path="/var/lib/kubelet/pods/200f9d44-5f0f-49cb-bc0a-d6a5c691fb15/volumes"
May 26 21:48:31.736350 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:31.736312    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" podUID="3725d185-6a8f-4642-ab6a-1bc36443acfd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 21:48:31.736708 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:31.736390    2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng"
May 26 21:48:31.736883 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:31.736865    2555 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"63942bbf1e66d108866a06dc163a3314a0220bc2cc19da6fad7ec92d550df412"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 26 21:48:31.736924 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:31.736904    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" podUID="3725d185-6a8f-4642-ab6a-1bc36443acfd" containerName="service-proxy" containerID="cri-o://63942bbf1e66d108866a06dc163a3314a0220bc2cc19da6fad7ec92d550df412" gracePeriod=30
May 26 21:48:32.811622 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:32.811588    2555 generic.go:358] "Generic (PLEG): container finished" podID="3725d185-6a8f-4642-ab6a-1bc36443acfd" containerID="63942bbf1e66d108866a06dc163a3314a0220bc2cc19da6fad7ec92d550df412" exitCode=2
May 26 21:48:32.812000 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:32.811628    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" event={"ID":"3725d185-6a8f-4642-ab6a-1bc36443acfd","Type":"ContainerDied","Data":"63942bbf1e66d108866a06dc163a3314a0220bc2cc19da6fad7ec92d550df412"}
May 26 21:48:32.812000 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:32.811653    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdc699d5-ljbng" event={"ID":"3725d185-6a8f-4642-ab6a-1bc36443acfd","Type":"ContainerStarted","Data":"febf7e36e68e63c7cfe9b6595fcd0a6190afeb69ca73309193918c74482c17eb"}
May 26 21:48:58.943960 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:58.943923    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:48:58.946102 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:58.946083    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8-metrics-certs\") pod \"network-metrics-daemon-2hnq5\" (UID: \"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8\") " pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:48:59.238929 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:59.238852    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqzm9\""
May 26 21:48:59.246820 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:59.246801    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hnq5"
May 26 21:48:59.365697 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:59.365666    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2hnq5"]
May 26 21:48:59.369801 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:48:59.369763    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8f2549_f2f8_44bb_bb3c_05605d0f8bf8.slice/crio-7b2f9cda73220fb6ff225c7696bff0b42f5c699b9879c7b93d7ecd4088b701e5 WatchSource:0}: Error finding container 7b2f9cda73220fb6ff225c7696bff0b42f5c699b9879c7b93d7ecd4088b701e5: Status 404 returned error can't find the container with id 7b2f9cda73220fb6ff225c7696bff0b42f5c699b9879c7b93d7ecd4088b701e5
May 26 21:48:59.877801 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:48:59.877748    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2hnq5" event={"ID":"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8","Type":"ContainerStarted","Data":"7b2f9cda73220fb6ff225c7696bff0b42f5c699b9879c7b93d7ecd4088b701e5"}
May 26 21:49:00.881471 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:49:00.881433    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2hnq5" event={"ID":"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8","Type":"ContainerStarted","Data":"6b66053db0ab9f0b221f4e6c06b3c06f1b865a36e5b0c413508ba437407797f2"}
May 26 21:49:00.881471 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:49:00.881466    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2hnq5" event={"ID":"6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8","Type":"ContainerStarted","Data":"b5601fedd0e44a0b8964e251ed81f27de00bca6fa6b98a9174704611d10fee85"}
May 26 21:49:00.898308 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:49:00.898265    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2hnq5" podStartSLOduration=251.943953504 podStartE2EDuration="4m12.898253683s" podCreationTimestamp="2026-05-26 21:44:48 +0000 UTC" firstStartedPulling="2026-05-26 21:48:59.371509004 +0000 UTC m=+251.842737649" lastFinishedPulling="2026-05-26 21:49:00.325809174 +0000 UTC m=+252.797037828" observedRunningTime="2026-05-26 21:49:00.896495547 +0000 UTC m=+253.367724211" watchObservedRunningTime="2026-05-26 21:49:00.898253683 +0000 UTC m=+253.369482346"
May 26 21:49:47.918691 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:49:47.918663    2555 kubelet.go:1628] "Image garbage collection succeeded"
May 26 21:51:05.663667 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.663584    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-wfqvr"]
May 26 21:51:05.664131 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.663827    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" containerName="registry"
May 26 21:51:05.664131 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.663838    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" containerName="registry"
May 26 21:51:05.664131 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.663889    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="200f9d44-5f0f-49cb-bc0a-d6a5c691fb15" containerName="registry"
May 26 21:51:05.666596 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.666579    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-wfqvr"
May 26 21:51:05.668919 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.668897    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 26 21:51:05.669039 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.668933    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 26 21:51:05.669039 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.668954    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bd29v\""
May 26 21:51:05.673536 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.673515    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-wfqvr"]
May 26 21:51:05.798019 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.797976    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9068e4c2-a86b-4d3d-80e6-eaa408305aee-bound-sa-token\") pod \"cert-manager-79c8d999ff-wfqvr\" (UID: \"9068e4c2-a86b-4d3d-80e6-eaa408305aee\") " pod="cert-manager/cert-manager-79c8d999ff-wfqvr"
May 26 21:51:05.798180 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.798029    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79tbv\" (UniqueName: \"kubernetes.io/projected/9068e4c2-a86b-4d3d-80e6-eaa408305aee-kube-api-access-79tbv\") pod \"cert-manager-79c8d999ff-wfqvr\" (UID: \"9068e4c2-a86b-4d3d-80e6-eaa408305aee\") " pod="cert-manager/cert-manager-79c8d999ff-wfqvr"
May 26 21:51:05.899013 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.898975    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9068e4c2-a86b-4d3d-80e6-eaa408305aee-bound-sa-token\") pod \"cert-manager-79c8d999ff-wfqvr\" (UID: \"9068e4c2-a86b-4d3d-80e6-eaa408305aee\") " pod="cert-manager/cert-manager-79c8d999ff-wfqvr"
May 26 21:51:05.899194 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.899020    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79tbv\" (UniqueName: \"kubernetes.io/projected/9068e4c2-a86b-4d3d-80e6-eaa408305aee-kube-api-access-79tbv\") pod \"cert-manager-79c8d999ff-wfqvr\" (UID: \"9068e4c2-a86b-4d3d-80e6-eaa408305aee\") " pod="cert-manager/cert-manager-79c8d999ff-wfqvr"
May 26 21:51:05.907829 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.907798    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9068e4c2-a86b-4d3d-80e6-eaa408305aee-bound-sa-token\") pod \"cert-manager-79c8d999ff-wfqvr\" (UID: \"9068e4c2-a86b-4d3d-80e6-eaa408305aee\") " pod="cert-manager/cert-manager-79c8d999ff-wfqvr"
May 26 21:51:05.908078 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.908058    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79tbv\" (UniqueName: \"kubernetes.io/projected/9068e4c2-a86b-4d3d-80e6-eaa408305aee-kube-api-access-79tbv\") pod \"cert-manager-79c8d999ff-wfqvr\" (UID: \"9068e4c2-a86b-4d3d-80e6-eaa408305aee\") " pod="cert-manager/cert-manager-79c8d999ff-wfqvr"
May 26 21:51:05.976136 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:05.976035    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-wfqvr"
May 26 21:51:06.092591 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:06.092554    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-wfqvr"]
May 26 21:51:06.095717 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:51:06.095691    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9068e4c2_a86b_4d3d_80e6_eaa408305aee.slice/crio-4caac70f5735b5b5d6f66193640dd9e37d87d50a25897a8477bc3f16c7460814 WatchSource:0}: Error finding container 4caac70f5735b5b5d6f66193640dd9e37d87d50a25897a8477bc3f16c7460814: Status 404 returned error can't find the container with id 4caac70f5735b5b5d6f66193640dd9e37d87d50a25897a8477bc3f16c7460814
May 26 21:51:06.097800 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:06.097769    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 21:51:06.194054 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:06.194018    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-wfqvr" event={"ID":"9068e4c2-a86b-4d3d-80e6-eaa408305aee","Type":"ContainerStarted","Data":"4caac70f5735b5b5d6f66193640dd9e37d87d50a25897a8477bc3f16c7460814"}
May 26 21:51:09.205530 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:09.205491    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-wfqvr" event={"ID":"9068e4c2-a86b-4d3d-80e6-eaa408305aee","Type":"ContainerStarted","Data":"3d21295eceb44e6ad436c056d40577692b7679afc800e04302060d5a8a3577b4"}
May 26 21:51:09.223472 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:09.223430    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-wfqvr" podStartSLOduration=2.024126926 podStartE2EDuration="4.2234166s" podCreationTimestamp="2026-05-26 21:51:05 +0000 UTC" firstStartedPulling="2026-05-26 21:51:06.097939527 +0000 UTC m=+378.569168167" lastFinishedPulling="2026-05-26 21:51:08.297229197 +0000 UTC m=+380.768457841" observedRunningTime="2026-05-26 21:51:09.221731633 +0000 UTC m=+381.692960298" watchObservedRunningTime="2026-05-26 21:51:09.2234166 +0000 UTC m=+381.694645263"
May 26 21:51:29.918819 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:29.918768    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"]
May 26 21:51:29.922032 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:29.922015    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:29.928300 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:29.928159    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 26 21:51:29.928300 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:29.928198    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 26 21:51:29.928300 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:29.928201    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 26 21:51:29.928440 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:29.928159    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 26 21:51:29.930550 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:29.930527    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6lhxs\""
May 26 21:51:29.942891 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:29.942871    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"]
May 26 21:51:30.066895 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.066864    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/843e48eb-8497-4fcd-9d9e-19552624e895-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-dvmkv\" (UID: \"843e48eb-8497-4fcd-9d9e-19552624e895\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.066895 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.066895    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/843e48eb-8497-4fcd-9d9e-19552624e895-webhook-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-dvmkv\" (UID: \"843e48eb-8497-4fcd-9d9e-19552624e895\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.067088 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.066925    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znsrz\" (UniqueName: \"kubernetes.io/projected/843e48eb-8497-4fcd-9d9e-19552624e895-kube-api-access-znsrz\") pod \"opendatahub-operator-controller-manager-58ddc889d6-dvmkv\" (UID: \"843e48eb-8497-4fcd-9d9e-19552624e895\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.167679 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.167642    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znsrz\" (UniqueName: \"kubernetes.io/projected/843e48eb-8497-4fcd-9d9e-19552624e895-kube-api-access-znsrz\") pod \"opendatahub-operator-controller-manager-58ddc889d6-dvmkv\" (UID: \"843e48eb-8497-4fcd-9d9e-19552624e895\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.167756 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.167709    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/843e48eb-8497-4fcd-9d9e-19552624e895-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-dvmkv\" (UID: \"843e48eb-8497-4fcd-9d9e-19552624e895\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.167756 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.167736    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/843e48eb-8497-4fcd-9d9e-19552624e895-webhook-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-dvmkv\" (UID: \"843e48eb-8497-4fcd-9d9e-19552624e895\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.170267 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.170198    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/843e48eb-8497-4fcd-9d9e-19552624e895-webhook-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-dvmkv\" (UID: \"843e48eb-8497-4fcd-9d9e-19552624e895\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.170393 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.170266    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/843e48eb-8497-4fcd-9d9e-19552624e895-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-dvmkv\" (UID: \"843e48eb-8497-4fcd-9d9e-19552624e895\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.177484 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.177460    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znsrz\" (UniqueName: \"kubernetes.io/projected/843e48eb-8497-4fcd-9d9e-19552624e895-kube-api-access-znsrz\") pod \"opendatahub-operator-controller-manager-58ddc889d6-dvmkv\" (UID: \"843e48eb-8497-4fcd-9d9e-19552624e895\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.232707 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.232683    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:30.383734 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:30.383686    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"]
May 26 21:51:30.389086 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:51:30.389060    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843e48eb_8497_4fcd_9d9e_19552624e895.slice/crio-0e23055f03ca3070a9ac469cfa2d2e1a9afd596842d610e47ee6fc52df76d087 WatchSource:0}: Error finding container 0e23055f03ca3070a9ac469cfa2d2e1a9afd596842d610e47ee6fc52df76d087: Status 404 returned error can't find the container with id 0e23055f03ca3070a9ac469cfa2d2e1a9afd596842d610e47ee6fc52df76d087
May 26 21:51:31.264454 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:31.264414    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv" event={"ID":"843e48eb-8497-4fcd-9d9e-19552624e895","Type":"ContainerStarted","Data":"0e23055f03ca3070a9ac469cfa2d2e1a9afd596842d610e47ee6fc52df76d087"}
May 26 21:51:33.272106 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.272069    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv" event={"ID":"843e48eb-8497-4fcd-9d9e-19552624e895","Type":"ContainerStarted","Data":"87fb16d7f123512d17c52edad487294bfc8d75f2edcdc713cbf310279a531eab"}
May 26 21:51:33.272576 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.272209    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:33.311070 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.311024    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv" podStartSLOduration=1.877753381 podStartE2EDuration="4.31100643s" podCreationTimestamp="2026-05-26 21:51:29 +0000 UTC" firstStartedPulling="2026-05-26 21:51:30.390656758 +0000 UTC m=+402.861885398" lastFinishedPulling="2026-05-26 21:51:32.823909802 +0000 UTC m=+405.295138447" observedRunningTime="2026-05-26 21:51:33.305334861 +0000 UTC m=+405.776563522" watchObservedRunningTime="2026-05-26 21:51:33.31100643 +0000 UTC m=+405.782235092"
May 26 21:51:33.451578 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.451550    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"]
May 26 21:51:33.454636 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.454620    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.456999 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.456977    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 26 21:51:33.457337 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.457322    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 26 21:51:33.457524 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.457508    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gwjs8\""
May 26 21:51:33.457594 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.457544    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 26 21:51:33.457648 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.457624    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 26 21:51:33.457704 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.457690    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 26 21:51:33.470393 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.470366    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"]
May 26 21:51:33.490454 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.490425    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2363f636-5915-4162-9236-cd6188955839-metrics-cert\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.490572 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.490469    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2363f636-5915-4162-9236-cd6188955839-manager-config\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.490572 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.490526    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjcpf\" (UniqueName: \"kubernetes.io/projected/2363f636-5915-4162-9236-cd6188955839-kube-api-access-pjcpf\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.490683 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.490607    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2363f636-5915-4162-9236-cd6188955839-cert\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.591371 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.591287    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2363f636-5915-4162-9236-cd6188955839-cert\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.591371 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.591351    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2363f636-5915-4162-9236-cd6188955839-metrics-cert\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.591582 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.591397    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2363f636-5915-4162-9236-cd6188955839-manager-config\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.591582 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.591433    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjcpf\" (UniqueName: \"kubernetes.io/projected/2363f636-5915-4162-9236-cd6188955839-kube-api-access-pjcpf\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.592184 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.592148    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2363f636-5915-4162-9236-cd6188955839-manager-config\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.594139 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.594114    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2363f636-5915-4162-9236-cd6188955839-metrics-cert\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.594287 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.594269    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2363f636-5915-4162-9236-cd6188955839-cert\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.613460 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.613426    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjcpf\" (UniqueName: \"kubernetes.io/projected/2363f636-5915-4162-9236-cd6188955839-kube-api-access-pjcpf\") pod \"lws-controller-manager-79df896c85-spdp9\" (UID: \"2363f636-5915-4162-9236-cd6188955839\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.763882 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.763848    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:33.891657 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:33.891629    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"]
May 26 21:51:33.893900 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:51:33.893872    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2363f636_5915_4162_9236_cd6188955839.slice/crio-f4374a554744378759b292ce8dbf8d2fb9f1836648ed39e12c388c0814b1f118 WatchSource:0}: Error finding container f4374a554744378759b292ce8dbf8d2fb9f1836648ed39e12c388c0814b1f118: Status 404 returned error can't find the container with id f4374a554744378759b292ce8dbf8d2fb9f1836648ed39e12c388c0814b1f118
May 26 21:51:34.275955 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:34.275921    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9" event={"ID":"2363f636-5915-4162-9236-cd6188955839","Type":"ContainerStarted","Data":"f4374a554744378759b292ce8dbf8d2fb9f1836648ed39e12c388c0814b1f118"}
May 26 21:51:36.282581 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:36.282543    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9" event={"ID":"2363f636-5915-4162-9236-cd6188955839","Type":"ContainerStarted","Data":"d5c845d3c639918e198084d8af8ee1e149b657388af9b3bab41e6f3af10967b8"}
May 26 21:51:36.282967 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:36.282695    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:51:36.298521 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:36.298477    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9" podStartSLOduration=1.046417687 podStartE2EDuration="3.29846288s" podCreationTimestamp="2026-05-26 21:51:33 +0000 UTC" firstStartedPulling="2026-05-26 21:51:33.895681009 +0000 UTC m=+406.366909653" lastFinishedPulling="2026-05-26 21:51:36.147726205 +0000 UTC m=+408.618954846" observedRunningTime="2026-05-26 21:51:36.298110303 +0000 UTC m=+408.769338978" watchObservedRunningTime="2026-05-26 21:51:36.29846288 +0000 UTC m=+408.769691543"
May 26 21:51:44.278298 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:44.278266    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-dvmkv"
May 26 21:51:47.288078 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:51:47.288046    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79df896c85-spdp9"
May 26 21:52:17.718135 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.718095    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"]
May 26 21:52:17.726627 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.726605    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.729092 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.729068    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 21:52:17.730168 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.730149    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 26 21:52:17.730277 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.730178    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 21:52:17.731998 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.731977    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jrl7b\""
May 26 21:52:17.757984 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.757957    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"]
May 26 21:52:17.835645 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.835612    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.835813 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.835653    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.835813 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.835678    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.835813 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.835735    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.835813 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.835767    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.835995 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.835815    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.835995 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.835836    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.835995 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.835904    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6p94\" (UniqueName: \"kubernetes.io/projected/0178fd6b-2050-49c5-b544-e4a6e07b7650-kube-api-access-l6p94\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.835995 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.835947    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0178fd6b-2050-49c5-b544-e4a6e07b7650-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.936698 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.936671    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6p94\" (UniqueName: \"kubernetes.io/projected/0178fd6b-2050-49c5-b544-e4a6e07b7650-kube-api-access-l6p94\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.936698 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.936703    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0178fd6b-2050-49c5-b544-e4a6e07b7650-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.936974 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.936742    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.936974 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.936762    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.936974 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.936909    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.936974 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.936953    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.937201 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.936989    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.937201 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.937035    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.937201 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.937150    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.937344 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.937218    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.937344 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.937327    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.937442 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.937397    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.937552 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.937465    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.937693 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.937673    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0178fd6b-2050-49c5-b544-e4a6e07b7650-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.939214 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.939194    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.939604 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.939584    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.949210 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.949186    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6p94\" (UniqueName: \"kubernetes.io/projected/0178fd6b-2050-49c5-b544-e4a6e07b7650-kube-api-access-l6p94\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:17.949304 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:17.949227    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0178fd6b-2050-49c5-b544-e4a6e07b7650-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8gvlkc\" (UID: \"0178fd6b-2050-49c5-b544-e4a6e07b7650\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:18.036897 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:18.036777    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:18.197490 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:18.197454    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"]
May 26 21:52:18.201104 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:52:18.201079    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0178fd6b_2050_49c5_b544_e4a6e07b7650.slice/crio-6639cc1ad306cc7b0b633775343306734e6335e532b70edff6d2fdd591605fac WatchSource:0}: Error finding container 6639cc1ad306cc7b0b633775343306734e6335e532b70edff6d2fdd591605fac: Status 404 returned error can't find the container with id 6639cc1ad306cc7b0b633775343306734e6335e532b70edff6d2fdd591605fac
May 26 21:52:18.388917 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:18.388882    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc" event={"ID":"0178fd6b-2050-49c5-b544-e4a6e07b7650","Type":"ContainerStarted","Data":"6639cc1ad306cc7b0b633775343306734e6335e532b70edff6d2fdd591605fac"}
May 26 21:52:21.329975 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:21.329940    2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 26 21:52:21.330229 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:21.330018    2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 26 21:52:21.330229 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:21.330055    2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 26 21:52:21.398746 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:21.398720    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc" event={"ID":"0178fd6b-2050-49c5-b544-e4a6e07b7650","Type":"ContainerStarted","Data":"c5e86918e8540f241c008019d4817b3d7460934aa1dfba5c0af81de585248d3c"}
May 26 21:52:21.418812 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:21.417781    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc" podStartSLOduration=1.291317046 podStartE2EDuration="4.417765069s" podCreationTimestamp="2026-05-26 21:52:17 +0000 UTC" firstStartedPulling="2026-05-26 21:52:18.203257008 +0000 UTC m=+450.674485649" lastFinishedPulling="2026-05-26 21:52:21.329705025 +0000 UTC m=+453.800933672" observedRunningTime="2026-05-26 21:52:21.416310639 +0000 UTC m=+453.887539300" watchObservedRunningTime="2026-05-26 21:52:21.417765069 +0000 UTC m=+453.888993732"
May 26 21:52:22.039641 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:22.039612    2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:22.041485 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:22.041463    2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:22.402383 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:22.402358    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:22.403234 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:22.403219    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8gvlkc"
May 26 21:52:48.296443 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.296403    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvphf"]
May 26 21:52:48.299641 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.299621    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvphf"
May 26 21:52:48.302506 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.302485    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 26 21:52:48.302705 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.302690    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-v7985\""
May 26 21:52:48.303507 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.303489    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 26 21:52:48.310710 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.310689    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvphf"]
May 26 21:52:48.362814 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.362765    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vb6v\" (UniqueName: \"kubernetes.io/projected/b12d15de-f132-4f6e-b6cc-6c4507c97ae6-kube-api-access-2vb6v\") pod \"kuadrant-operator-catalog-lvphf\" (UID: \"b12d15de-f132-4f6e-b6cc-6c4507c97ae6\") " pod="kuadrant-system/kuadrant-operator-catalog-lvphf"
May 26 21:52:48.464139 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.464102    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vb6v\" (UniqueName: \"kubernetes.io/projected/b12d15de-f132-4f6e-b6cc-6c4507c97ae6-kube-api-access-2vb6v\") pod \"kuadrant-operator-catalog-lvphf\" (UID: \"b12d15de-f132-4f6e-b6cc-6c4507c97ae6\") " pod="kuadrant-system/kuadrant-operator-catalog-lvphf"
May 26 21:52:48.472491 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.472461    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vb6v\" (UniqueName: \"kubernetes.io/projected/b12d15de-f132-4f6e-b6cc-6c4507c97ae6-kube-api-access-2vb6v\") pod \"kuadrant-operator-catalog-lvphf\" (UID: \"b12d15de-f132-4f6e-b6cc-6c4507c97ae6\") " pod="kuadrant-system/kuadrant-operator-catalog-lvphf"
May 26 21:52:48.608759 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.608730    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvphf"
May 26 21:52:48.624721 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.624694    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvphf"]
May 26 21:52:48.731323 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.731290    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvphf"]
May 26 21:52:48.734400 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:52:48.734369    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12d15de_f132_4f6e_b6cc_6c4507c97ae6.slice/crio-2c8ef383ea348d808259eeae5640c9267233170a4f2dbe792ea4085370cff930 WatchSource:0}: Error finding container 2c8ef383ea348d808259eeae5640c9267233170a4f2dbe792ea4085370cff930: Status 404 returned error can't find the container with id 2c8ef383ea348d808259eeae5640c9267233170a4f2dbe792ea4085370cff930
May 26 21:52:48.833092 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.833061    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k5gcp"]
May 26 21:52:48.837324 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.837309    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k5gcp"
May 26 21:52:48.843348 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.843322    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k5gcp"]
May 26 21:52:48.866045 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.865985    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8bn\" (UniqueName: \"kubernetes.io/projected/bc60fe3a-a46f-4249-87e0-f3a95185e64f-kube-api-access-5n8bn\") pod \"kuadrant-operator-catalog-k5gcp\" (UID: \"bc60fe3a-a46f-4249-87e0-f3a95185e64f\") " pod="kuadrant-system/kuadrant-operator-catalog-k5gcp"
May 26 21:52:48.966781 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.966739    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8bn\" (UniqueName: \"kubernetes.io/projected/bc60fe3a-a46f-4249-87e0-f3a95185e64f-kube-api-access-5n8bn\") pod \"kuadrant-operator-catalog-k5gcp\" (UID: \"bc60fe3a-a46f-4249-87e0-f3a95185e64f\") " pod="kuadrant-system/kuadrant-operator-catalog-k5gcp"
May 26 21:52:48.976033 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:48.976004    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8bn\" (UniqueName: \"kubernetes.io/projected/bc60fe3a-a46f-4249-87e0-f3a95185e64f-kube-api-access-5n8bn\") pod \"kuadrant-operator-catalog-k5gcp\" (UID: \"bc60fe3a-a46f-4249-87e0-f3a95185e64f\") " pod="kuadrant-system/kuadrant-operator-catalog-k5gcp"
May 26 21:52:49.148400 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:49.148299    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k5gcp"
May 26 21:52:49.271869 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:49.271838    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k5gcp"]
May 26 21:52:49.289621 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:52:49.289590    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc60fe3a_a46f_4249_87e0_f3a95185e64f.slice/crio-eff4b93457486fa631bad019a7d251479239440d05e0e82d5c31c0708449a642 WatchSource:0}: Error finding container eff4b93457486fa631bad019a7d251479239440d05e0e82d5c31c0708449a642: Status 404 returned error can't find the container with id eff4b93457486fa631bad019a7d251479239440d05e0e82d5c31c0708449a642
May 26 21:52:49.470925 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:49.470832    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvphf" event={"ID":"b12d15de-f132-4f6e-b6cc-6c4507c97ae6","Type":"ContainerStarted","Data":"2c8ef383ea348d808259eeae5640c9267233170a4f2dbe792ea4085370cff930"}
May 26 21:52:49.472075 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:49.472025    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k5gcp" event={"ID":"bc60fe3a-a46f-4249-87e0-f3a95185e64f","Type":"ContainerStarted","Data":"eff4b93457486fa631bad019a7d251479239440d05e0e82d5c31c0708449a642"}
May 26 21:52:51.481194 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:51.481159    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvphf" event={"ID":"b12d15de-f132-4f6e-b6cc-6c4507c97ae6","Type":"ContainerStarted","Data":"94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251"}
May 26 21:52:51.481751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:51.481243    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lvphf" podUID="b12d15de-f132-4f6e-b6cc-6c4507c97ae6" containerName="registry-server" containerID="cri-o://94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251" gracePeriod=2
May 26 21:52:51.482531 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:51.482497    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k5gcp" event={"ID":"bc60fe3a-a46f-4249-87e0-f3a95185e64f","Type":"ContainerStarted","Data":"1f0f8ef6f1cb8f08505dd5bb0da4e7480e61b2d7839aadd571170b8fc201799f"}
May 26 21:52:51.496439 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:51.496397    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lvphf" podStartSLOduration=1.169168843 podStartE2EDuration="3.496380097s" podCreationTimestamp="2026-05-26 21:52:48 +0000 UTC" firstStartedPulling="2026-05-26 21:52:48.735859869 +0000 UTC m=+481.207088513" lastFinishedPulling="2026-05-26 21:52:51.063071123 +0000 UTC m=+483.534299767" observedRunningTime="2026-05-26 21:52:51.495094892 +0000 UTC m=+483.966323555" watchObservedRunningTime="2026-05-26 21:52:51.496380097 +0000 UTC m=+483.967608804"
May 26 21:52:51.509140 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:51.509080    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-k5gcp" podStartSLOduration=1.741002011 podStartE2EDuration="3.509064078s" podCreationTimestamp="2026-05-26 21:52:48 +0000 UTC" firstStartedPulling="2026-05-26 21:52:49.291011863 +0000 UTC m=+481.762240508" lastFinishedPulling="2026-05-26 21:52:51.059073934 +0000 UTC m=+483.530302575" observedRunningTime="2026-05-26 21:52:51.508778508 +0000 UTC m=+483.980007183" watchObservedRunningTime="2026-05-26 21:52:51.509064078 +0000 UTC m=+483.980292741"
May 26 21:52:51.714712 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:51.714688    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvphf"
May 26 21:52:51.783196 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:51.783121    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vb6v\" (UniqueName: \"kubernetes.io/projected/b12d15de-f132-4f6e-b6cc-6c4507c97ae6-kube-api-access-2vb6v\") pod \"b12d15de-f132-4f6e-b6cc-6c4507c97ae6\" (UID: \"b12d15de-f132-4f6e-b6cc-6c4507c97ae6\") "
May 26 21:52:51.785191 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:51.785167    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b12d15de-f132-4f6e-b6cc-6c4507c97ae6-kube-api-access-2vb6v" (OuterVolumeSpecName: "kube-api-access-2vb6v") pod "b12d15de-f132-4f6e-b6cc-6c4507c97ae6" (UID: "b12d15de-f132-4f6e-b6cc-6c4507c97ae6"). InnerVolumeSpecName "kube-api-access-2vb6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:52:51.884321 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:51.884288    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vb6v\" (UniqueName: \"kubernetes.io/projected/b12d15de-f132-4f6e-b6cc-6c4507c97ae6-kube-api-access-2vb6v\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:52:52.486902 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:52.486866    2555 generic.go:358] "Generic (PLEG): container finished" podID="b12d15de-f132-4f6e-b6cc-6c4507c97ae6" containerID="94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251" exitCode=0
May 26 21:52:52.487285 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:52.486920    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvphf" event={"ID":"b12d15de-f132-4f6e-b6cc-6c4507c97ae6","Type":"ContainerDied","Data":"94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251"}
May 26 21:52:52.487285 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:52.486951    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvphf"
May 26 21:52:52.487285 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:52.486966    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvphf" event={"ID":"b12d15de-f132-4f6e-b6cc-6c4507c97ae6","Type":"ContainerDied","Data":"2c8ef383ea348d808259eeae5640c9267233170a4f2dbe792ea4085370cff930"}
May 26 21:52:52.487285 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:52.486987    2555 scope.go:117] "RemoveContainer" containerID="94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251"
May 26 21:52:52.494699 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:52.494683    2555 scope.go:117] "RemoveContainer" containerID="94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251"
May 26 21:52:52.494953 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:52:52.494935    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251\": container with ID starting with 94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251 not found: ID does not exist" containerID="94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251"
May 26 21:52:52.495023 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:52.494965    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251"} err="failed to get container status \"94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251\": rpc error: code = NotFound desc = could not find container \"94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251\": container with ID starting with 94e2f294587e5d47320a52a69c2cd280774c97334edf82c27fa28a85443a9251 not found: ID does not exist"
May 26 21:52:52.501407 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:52.501386    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvphf"]
May 26 21:52:52.507678 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:52.507658    2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvphf"]
May 26 21:52:54.039570 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:54.039541    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b12d15de-f132-4f6e-b6cc-6c4507c97ae6" path="/var/lib/kubelet/pods/b12d15de-f132-4f6e-b6cc-6c4507c97ae6/volumes"
May 26 21:52:59.149030 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:59.148993    2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-k5gcp"
May 26 21:52:59.149030 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:59.149036    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-k5gcp"
May 26 21:52:59.169639 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:59.169610    2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-k5gcp"
May 26 21:52:59.528338 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:52:59.528270    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-k5gcp"
May 26 21:53:19.464125 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.464093    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"]
May 26 21:53:19.464484 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.464354    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b12d15de-f132-4f6e-b6cc-6c4507c97ae6" containerName="registry-server"
May 26 21:53:19.464484 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.464364    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b12d15de-f132-4f6e-b6cc-6c4507c97ae6" containerName="registry-server"
May 26 21:53:19.464484 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.464420    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b12d15de-f132-4f6e-b6cc-6c4507c97ae6" containerName="registry-server"
May 26 21:53:19.467118 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.467101    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"
May 26 21:53:19.470769 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.470750    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nzk2m\""
May 26 21:53:19.475730 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.475705    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"]
May 26 21:53:19.575282 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.575251    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcbqc\" (UniqueName: \"kubernetes.io/projected/51979ac8-a6c6-44ad-a33d-fa7682d040ae-kube-api-access-hcbqc\") pod \"limitador-operator-controller-manager-85c4996f8c-jqls5\" (UID: \"51979ac8-a6c6-44ad-a33d-fa7682d040ae\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"
May 26 21:53:19.676394 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.676354    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcbqc\" (UniqueName: \"kubernetes.io/projected/51979ac8-a6c6-44ad-a33d-fa7682d040ae-kube-api-access-hcbqc\") pod \"limitador-operator-controller-manager-85c4996f8c-jqls5\" (UID: \"51979ac8-a6c6-44ad-a33d-fa7682d040ae\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"
May 26 21:53:19.690589 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.690562    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcbqc\" (UniqueName: \"kubernetes.io/projected/51979ac8-a6c6-44ad-a33d-fa7682d040ae-kube-api-access-hcbqc\") pod \"limitador-operator-controller-manager-85c4996f8c-jqls5\" (UID: \"51979ac8-a6c6-44ad-a33d-fa7682d040ae\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"
May 26 21:53:19.777108 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.777031    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"
May 26 21:53:19.905210 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:19.905179    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"]
May 26 21:53:19.910362 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:53:19.910339    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51979ac8_a6c6_44ad_a33d_fa7682d040ae.slice/crio-60a9fd1e54b31ea97db18085db0fbe729d7f1497d8f4a6b93b50bb00114195ba WatchSource:0}: Error finding container 60a9fd1e54b31ea97db18085db0fbe729d7f1497d8f4a6b93b50bb00114195ba: Status 404 returned error can't find the container with id 60a9fd1e54b31ea97db18085db0fbe729d7f1497d8f4a6b93b50bb00114195ba
May 26 21:53:20.571180 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:20.571130    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5" event={"ID":"51979ac8-a6c6-44ad-a33d-fa7682d040ae","Type":"ContainerStarted","Data":"60a9fd1e54b31ea97db18085db0fbe729d7f1497d8f4a6b93b50bb00114195ba"}
May 26 21:53:21.575389 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:21.575357    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5" event={"ID":"51979ac8-a6c6-44ad-a33d-fa7682d040ae","Type":"ContainerStarted","Data":"3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3"}
May 26 21:53:21.575698 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:21.575473    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"
May 26 21:53:21.593674 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:21.593630    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5" podStartSLOduration=1.056361632 podStartE2EDuration="2.593613048s" podCreationTimestamp="2026-05-26 21:53:19 +0000 UTC" firstStartedPulling="2026-05-26 21:53:19.91242353 +0000 UTC m=+512.383652171" lastFinishedPulling="2026-05-26 21:53:21.449674933 +0000 UTC m=+513.920903587" observedRunningTime="2026-05-26 21:53:21.591644022 +0000 UTC m=+514.062872685" watchObservedRunningTime="2026-05-26 21:53:21.593613048 +0000 UTC m=+514.064841712"
May 26 21:53:27.864685 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:27.864643    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-tg58g"]
May 26 21:53:27.869525 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:27.869503    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-tg58g"
May 26 21:53:27.873742 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:27.873723    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-clqhg\""
May 26 21:53:27.878634 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:27.878612    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-tg58g"]
May 26 21:53:27.938362 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:27.938330    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqffb\" (UniqueName: \"kubernetes.io/projected/46826bf5-ab4f-4667-a7ba-6be7e15b52d4-kube-api-access-qqffb\") pod \"authorino-operator-657f44b778-tg58g\" (UID: \"46826bf5-ab4f-4667-a7ba-6be7e15b52d4\") " pod="kuadrant-system/authorino-operator-657f44b778-tg58g"
May 26 21:53:28.038779 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:28.038752    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqffb\" (UniqueName: \"kubernetes.io/projected/46826bf5-ab4f-4667-a7ba-6be7e15b52d4-kube-api-access-qqffb\") pod \"authorino-operator-657f44b778-tg58g\" (UID: \"46826bf5-ab4f-4667-a7ba-6be7e15b52d4\") " pod="kuadrant-system/authorino-operator-657f44b778-tg58g"
May 26 21:53:28.053022 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:28.052990    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqffb\" (UniqueName: \"kubernetes.io/projected/46826bf5-ab4f-4667-a7ba-6be7e15b52d4-kube-api-access-qqffb\") pod \"authorino-operator-657f44b778-tg58g\" (UID: \"46826bf5-ab4f-4667-a7ba-6be7e15b52d4\") " pod="kuadrant-system/authorino-operator-657f44b778-tg58g"
May 26 21:53:28.179684 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:28.179596    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-tg58g"
May 26 21:53:28.308395 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:28.308363    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-tg58g"]
May 26 21:53:28.311630 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:53:28.311603    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46826bf5_ab4f_4667_a7ba_6be7e15b52d4.slice/crio-9045fca0a512694c0bde2345f72739ebfd0426d273832e1f7deee27640698c8a WatchSource:0}: Error finding container 9045fca0a512694c0bde2345f72739ebfd0426d273832e1f7deee27640698c8a: Status 404 returned error can't find the container with id 9045fca0a512694c0bde2345f72739ebfd0426d273832e1f7deee27640698c8a
May 26 21:53:28.598098 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:28.598063    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-tg58g" event={"ID":"46826bf5-ab4f-4667-a7ba-6be7e15b52d4","Type":"ContainerStarted","Data":"9045fca0a512694c0bde2345f72739ebfd0426d273832e1f7deee27640698c8a"}
May 26 21:53:30.609562 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:30.609497    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-tg58g" event={"ID":"46826bf5-ab4f-4667-a7ba-6be7e15b52d4","Type":"ContainerStarted","Data":"925492ed402c815cb38076809f65ec5059ec098b1dfe0cf6367af13a08e9325d"}
May 26 21:53:30.610060 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:30.609583    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-tg58g"
May 26 21:53:30.628241 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:30.628193    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-tg58g" podStartSLOduration=1.52932977 podStartE2EDuration="3.628179286s" podCreationTimestamp="2026-05-26 21:53:27 +0000 UTC" firstStartedPulling="2026-05-26 21:53:28.313751562 +0000 UTC m=+520.784980203" lastFinishedPulling="2026-05-26 21:53:30.412601077 +0000 UTC m=+522.883829719" observedRunningTime="2026-05-26 21:53:30.626962994 +0000 UTC m=+523.098191648" watchObservedRunningTime="2026-05-26 21:53:30.628179286 +0000 UTC m=+523.099407948"
May 26 21:53:32.580531 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:32.580500    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"
May 26 21:53:41.617414 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:41.617340    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-tg58g"
May 26 21:53:44.024938 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.024907    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"]
May 26 21:53:44.025400 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.025201    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5" podUID="51979ac8-a6c6-44ad-a33d-fa7682d040ae" containerName="manager" containerID="cri-o://3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3" gracePeriod=2
May 26 21:53:44.028087 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.028057    2555 status_manager.go:895] "Failed to get status for pod" podUID="51979ac8-a6c6-44ad-a33d-fa7682d040ae" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5" err="pods \"limitador-operator-controller-manager-85c4996f8c-jqls5\" is forbidden: User \"system:node:ip-10-0-140-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-172.ec2.internal' and this object"
May 26 21:53:44.028211 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.028114    2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"]
May 26 21:53:44.130497 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.130467    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"]
May 26 21:53:44.130779 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.130766    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51979ac8-a6c6-44ad-a33d-fa7682d040ae" containerName="manager"
May 26 21:53:44.130840 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.130781    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="51979ac8-a6c6-44ad-a33d-fa7682d040ae" containerName="manager"
May 26 21:53:44.130875 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.130849    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="51979ac8-a6c6-44ad-a33d-fa7682d040ae" containerName="manager"
May 26 21:53:44.133632 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.133608    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"
May 26 21:53:44.150488 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.150460    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"]
May 26 21:53:44.255123 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.255093    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcg5m\" (UniqueName: \"kubernetes.io/projected/f085aab4-2a80-4dd1-b56f-886e3ed89fd2-kube-api-access-wcg5m\") pod \"limitador-operator-controller-manager-85c4996f8c-fhgd5\" (UID: \"f085aab4-2a80-4dd1-b56f-886e3ed89fd2\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"
May 26 21:53:44.257768 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.257750    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"
May 26 21:53:44.356193 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.356164    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcbqc\" (UniqueName: \"kubernetes.io/projected/51979ac8-a6c6-44ad-a33d-fa7682d040ae-kube-api-access-hcbqc\") pod \"51979ac8-a6c6-44ad-a33d-fa7682d040ae\" (UID: \"51979ac8-a6c6-44ad-a33d-fa7682d040ae\") "
May 26 21:53:44.356357 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.356306    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcg5m\" (UniqueName: \"kubernetes.io/projected/f085aab4-2a80-4dd1-b56f-886e3ed89fd2-kube-api-access-wcg5m\") pod \"limitador-operator-controller-manager-85c4996f8c-fhgd5\" (UID: \"f085aab4-2a80-4dd1-b56f-886e3ed89fd2\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"
May 26 21:53:44.358084 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.358064    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51979ac8-a6c6-44ad-a33d-fa7682d040ae-kube-api-access-hcbqc" (OuterVolumeSpecName: "kube-api-access-hcbqc") pod "51979ac8-a6c6-44ad-a33d-fa7682d040ae" (UID: "51979ac8-a6c6-44ad-a33d-fa7682d040ae"). InnerVolumeSpecName "kube-api-access-hcbqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:53:44.375065 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.375039    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcg5m\" (UniqueName: \"kubernetes.io/projected/f085aab4-2a80-4dd1-b56f-886e3ed89fd2-kube-api-access-wcg5m\") pod \"limitador-operator-controller-manager-85c4996f8c-fhgd5\" (UID: \"f085aab4-2a80-4dd1-b56f-886e3ed89fd2\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"
May 26 21:53:44.445511 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.445482    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"
May 26 21:53:44.457376 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.457356    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcbqc\" (UniqueName: \"kubernetes.io/projected/51979ac8-a6c6-44ad-a33d-fa7682d040ae-kube-api-access-hcbqc\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:53:44.595553 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.595524    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"]
May 26 21:53:44.598624 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:53:44.598597    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf085aab4_2a80_4dd1_b56f_886e3ed89fd2.slice/crio-0a6a00153a2bc4defc17fb3f4db6fa997565fc096cc654b4c2005714adc42586 WatchSource:0}: Error finding container 0a6a00153a2bc4defc17fb3f4db6fa997565fc096cc654b4c2005714adc42586: Status 404 returned error can't find the container with id 0a6a00153a2bc4defc17fb3f4db6fa997565fc096cc654b4c2005714adc42586
May 26 21:53:44.657057 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.657028    2555 generic.go:358] "Generic (PLEG): container finished" podID="51979ac8-a6c6-44ad-a33d-fa7682d040ae" containerID="3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3" exitCode=0
May 26 21:53:44.657179 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.657091    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jqls5"
May 26 21:53:44.657179 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.657122    2555 scope.go:117] "RemoveContainer" containerID="3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3"
May 26 21:53:44.658317 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.658295    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5" event={"ID":"f085aab4-2a80-4dd1-b56f-886e3ed89fd2","Type":"ContainerStarted","Data":"0a6a00153a2bc4defc17fb3f4db6fa997565fc096cc654b4c2005714adc42586"}
May 26 21:53:44.665082 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.664760    2555 scope.go:117] "RemoveContainer" containerID="3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3"
May 26 21:53:44.665082 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:53:44.665042    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3\": container with ID starting with 3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3 not found: ID does not exist" containerID="3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3"
May 26 21:53:44.665215 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:44.665075    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3"} err="failed to get container status \"3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3\": rpc error: code = NotFound desc = could not find container \"3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3\": container with ID starting with 3d916190d0816cfa43328da5124cb37bafaeacb07334b31007dec7b6faee7be3 not found: ID does not exist"
May 26 21:53:45.665353 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:45.665315    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5" event={"ID":"f085aab4-2a80-4dd1-b56f-886e3ed89fd2","Type":"ContainerStarted","Data":"9275c87da35c973e76669a2dcc5772f7e8d9b7b9d5079ea1bfcef14af20628e6"}
May 26 21:53:45.665741 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:45.665482    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"
May 26 21:53:45.689938 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:45.689888    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5" podStartSLOduration=1.689870468 podStartE2EDuration="1.689870468s" podCreationTimestamp="2026-05-26 21:53:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 21:53:45.68918167 +0000 UTC m=+538.160410334" watchObservedRunningTime="2026-05-26 21:53:45.689870468 +0000 UTC m=+538.161099132"
May 26 21:53:46.040125 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:46.040049    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51979ac8-a6c6-44ad-a33d-fa7682d040ae" path="/var/lib/kubelet/pods/51979ac8-a6c6-44ad-a33d-fa7682d040ae/volumes"
May 26 21:53:56.670455 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:53:56.670424    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fhgd5"
May 26 21:54:18.057700 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.057664    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gwkvq"]
May 26 21:54:18.060651 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.060632    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq"
May 26 21:54:18.062848 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.062829    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rgjwv\""
May 26 21:54:18.067322 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.067302    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gwkvq"]
May 26 21:54:18.209354 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.209322    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-j5wl2"]
May 26 21:54:18.212359 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.212340    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-j5wl2"
May 26 21:54:18.219877 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.219855    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khz9h\" (UniqueName: \"kubernetes.io/projected/dc4c0f01-493b-476c-8237-a16495d152ce-kube-api-access-khz9h\") pod \"authorino-f99f4b5cd-gwkvq\" (UID: \"dc4c0f01-493b-476c-8237-a16495d152ce\") " pod="kuadrant-system/authorino-f99f4b5cd-gwkvq"
May 26 21:54:18.219979 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.219929    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-j5wl2"]
May 26 21:54:18.320845 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.320769    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj9nh\" (UniqueName: \"kubernetes.io/projected/b1497575-b31c-421f-b88a-07d6c47ad752-kube-api-access-bj9nh\") pod \"authorino-7498df8756-j5wl2\" (UID: \"b1497575-b31c-421f-b88a-07d6c47ad752\") " pod="kuadrant-system/authorino-7498df8756-j5wl2"
May 26 21:54:18.320845 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.320833    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khz9h\" (UniqueName: \"kubernetes.io/projected/dc4c0f01-493b-476c-8237-a16495d152ce-kube-api-access-khz9h\") pod \"authorino-f99f4b5cd-gwkvq\" (UID: \"dc4c0f01-493b-476c-8237-a16495d152ce\") " pod="kuadrant-system/authorino-f99f4b5cd-gwkvq"
May 26 21:54:18.328749 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.328718    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khz9h\" (UniqueName: \"kubernetes.io/projected/dc4c0f01-493b-476c-8237-a16495d152ce-kube-api-access-khz9h\") pod \"authorino-f99f4b5cd-gwkvq\" (UID: \"dc4c0f01-493b-476c-8237-a16495d152ce\") " pod="kuadrant-system/authorino-f99f4b5cd-gwkvq"
May 26 21:54:18.370770 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.370731    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq"
May 26 21:54:18.422019 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.421983    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bj9nh\" (UniqueName: \"kubernetes.io/projected/b1497575-b31c-421f-b88a-07d6c47ad752-kube-api-access-bj9nh\") pod \"authorino-7498df8756-j5wl2\" (UID: \"b1497575-b31c-421f-b88a-07d6c47ad752\") " pod="kuadrant-system/authorino-7498df8756-j5wl2"
May 26 21:54:18.431754 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.431719    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj9nh\" (UniqueName: \"kubernetes.io/projected/b1497575-b31c-421f-b88a-07d6c47ad752-kube-api-access-bj9nh\") pod \"authorino-7498df8756-j5wl2\" (UID: \"b1497575-b31c-421f-b88a-07d6c47ad752\") " pod="kuadrant-system/authorino-7498df8756-j5wl2"
May 26 21:54:18.492625 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.492467    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gwkvq"]
May 26 21:54:18.495153 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:54:18.495126    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc4c0f01_493b_476c_8237_a16495d152ce.slice/crio-9d73b9161b19c9fde0f727d1874cdd896df86eb6f030e3c8e68c1334ad3d1249 WatchSource:0}: Error finding container 9d73b9161b19c9fde0f727d1874cdd896df86eb6f030e3c8e68c1334ad3d1249: Status 404 returned error can't find the container with id 9d73b9161b19c9fde0f727d1874cdd896df86eb6f030e3c8e68c1334ad3d1249
May 26 21:54:18.521852 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.521828    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-j5wl2"
May 26 21:54:18.652926 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.652900    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-j5wl2"]
May 26 21:54:18.657269 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:54:18.657158    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1497575_b31c_421f_b88a_07d6c47ad752.slice/crio-9746c16ab372cc88ae0cdf6064e8a50d39c4ef8ffa61180fcca45f9575dbf4ac WatchSource:0}: Error finding container 9746c16ab372cc88ae0cdf6064e8a50d39c4ef8ffa61180fcca45f9575dbf4ac: Status 404 returned error can't find the container with id 9746c16ab372cc88ae0cdf6064e8a50d39c4ef8ffa61180fcca45f9575dbf4ac
May 26 21:54:18.768745 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.768713    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-j5wl2" event={"ID":"b1497575-b31c-421f-b88a-07d6c47ad752","Type":"ContainerStarted","Data":"9746c16ab372cc88ae0cdf6064e8a50d39c4ef8ffa61180fcca45f9575dbf4ac"}
May 26 21:54:18.769683 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:18.769647    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq" event={"ID":"dc4c0f01-493b-476c-8237-a16495d152ce","Type":"ContainerStarted","Data":"9d73b9161b19c9fde0f727d1874cdd896df86eb6f030e3c8e68c1334ad3d1249"}
May 26 21:54:22.786824 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:22.786764    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-j5wl2" event={"ID":"b1497575-b31c-421f-b88a-07d6c47ad752","Type":"ContainerStarted","Data":"da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407"}
May 26 21:54:22.788112 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:22.788091    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq" event={"ID":"dc4c0f01-493b-476c-8237-a16495d152ce","Type":"ContainerStarted","Data":"0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1"}
May 26 21:54:22.807443 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:22.807392    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-j5wl2" podStartSLOduration=1.523488048 podStartE2EDuration="4.807378396s" podCreationTimestamp="2026-05-26 21:54:18 +0000 UTC" firstStartedPulling="2026-05-26 21:54:18.658078872 +0000 UTC m=+571.129307512" lastFinishedPulling="2026-05-26 21:54:21.941969218 +0000 UTC m=+574.413197860" observedRunningTime="2026-05-26 21:54:22.806337155 +0000 UTC m=+575.277565816" watchObservedRunningTime="2026-05-26 21:54:22.807378396 +0000 UTC m=+575.278607058"
May 26 21:54:22.823303 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:22.823261    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq" podStartSLOduration=1.367388061 podStartE2EDuration="4.823248213s" podCreationTimestamp="2026-05-26 21:54:18 +0000 UTC" firstStartedPulling="2026-05-26 21:54:18.496407502 +0000 UTC m=+570.967636142" lastFinishedPulling="2026-05-26 21:54:21.952267648 +0000 UTC m=+574.423496294" observedRunningTime="2026-05-26 21:54:22.822052205 +0000 UTC m=+575.293280878" watchObservedRunningTime="2026-05-26 21:54:22.823248213 +0000 UTC m=+575.294476875"
May 26 21:54:22.853585 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:22.853537    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gwkvq"]
May 26 21:54:24.795339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:24.795274    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq" podUID="dc4c0f01-493b-476c-8237-a16495d152ce" containerName="authorino" containerID="cri-o://0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1" gracePeriod=30
May 26 21:54:25.036893 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.036871    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq"
May 26 21:54:25.081118 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.081051    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khz9h\" (UniqueName: \"kubernetes.io/projected/dc4c0f01-493b-476c-8237-a16495d152ce-kube-api-access-khz9h\") pod \"dc4c0f01-493b-476c-8237-a16495d152ce\" (UID: \"dc4c0f01-493b-476c-8237-a16495d152ce\") "
May 26 21:54:25.083011 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.082974    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc4c0f01-493b-476c-8237-a16495d152ce-kube-api-access-khz9h" (OuterVolumeSpecName: "kube-api-access-khz9h") pod "dc4c0f01-493b-476c-8237-a16495d152ce" (UID: "dc4c0f01-493b-476c-8237-a16495d152ce"). InnerVolumeSpecName "kube-api-access-khz9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:54:25.182157 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.182127    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khz9h\" (UniqueName: \"kubernetes.io/projected/dc4c0f01-493b-476c-8237-a16495d152ce-kube-api-access-khz9h\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:54:25.798916 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.798830    2555 generic.go:358] "Generic (PLEG): container finished" podID="dc4c0f01-493b-476c-8237-a16495d152ce" containerID="0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1" exitCode=0
May 26 21:54:25.798916 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.798879    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq"
May 26 21:54:25.799329 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.798913    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq" event={"ID":"dc4c0f01-493b-476c-8237-a16495d152ce","Type":"ContainerDied","Data":"0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1"}
May 26 21:54:25.799329 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.798944    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gwkvq" event={"ID":"dc4c0f01-493b-476c-8237-a16495d152ce","Type":"ContainerDied","Data":"9d73b9161b19c9fde0f727d1874cdd896df86eb6f030e3c8e68c1334ad3d1249"}
May 26 21:54:25.799329 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.798961    2555 scope.go:117] "RemoveContainer" containerID="0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1"
May 26 21:54:25.806643 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.806627    2555 scope.go:117] "RemoveContainer" containerID="0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1"
May 26 21:54:25.806913 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:54:25.806892    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1\": container with ID starting with 0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1 not found: ID does not exist" containerID="0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1"
May 26 21:54:25.806972 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.806924    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1"} err="failed to get container status \"0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1\": rpc error: code = NotFound desc = could not find container \"0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1\": container with ID starting with 0a2a7237d6fd92774ccfeeac06f469127ce6174dc39b24d962cf56d983beb9a1 not found: ID does not exist"
May 26 21:54:25.818775 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.818752    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gwkvq"]
May 26 21:54:25.822725 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:25.822705    2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gwkvq"]
May 26 21:54:26.039879 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:26.039847    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc4c0f01-493b-476c-8237-a16495d152ce" path="/var/lib/kubelet/pods/dc4c0f01-493b-476c-8237-a16495d152ce/volumes"
May 26 21:54:50.179777 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.179734    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xpf9f"]
May 26 21:54:50.180286 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.180205    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc4c0f01-493b-476c-8237-a16495d152ce" containerName="authorino"
May 26 21:54:50.180286 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.180224    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc4c0f01-493b-476c-8237-a16495d152ce" containerName="authorino"
May 26 21:54:50.180407 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.180347    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc4c0f01-493b-476c-8237-a16495d152ce" containerName="authorino"
May 26 21:54:50.184354 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.184331    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xpf9f"
May 26 21:54:50.189741 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.189715    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xpf9f"]
May 26 21:54:50.247521 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.247481    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcgl\" (UniqueName: \"kubernetes.io/projected/4a2f0581-8c0a-4e97-acad-df695bbc31e5-kube-api-access-4zcgl\") pod \"authorino-8b475cf9f-xpf9f\" (UID: \"4a2f0581-8c0a-4e97-acad-df695bbc31e5\") " pod="kuadrant-system/authorino-8b475cf9f-xpf9f"
May 26 21:54:50.347987 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.347951    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcgl\" (UniqueName: \"kubernetes.io/projected/4a2f0581-8c0a-4e97-acad-df695bbc31e5-kube-api-access-4zcgl\") pod \"authorino-8b475cf9f-xpf9f\" (UID: \"4a2f0581-8c0a-4e97-acad-df695bbc31e5\") " pod="kuadrant-system/authorino-8b475cf9f-xpf9f"
May 26 21:54:50.359837 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.359813    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcgl\" (UniqueName: \"kubernetes.io/projected/4a2f0581-8c0a-4e97-acad-df695bbc31e5-kube-api-access-4zcgl\") pod \"authorino-8b475cf9f-xpf9f\" (UID: \"4a2f0581-8c0a-4e97-acad-df695bbc31e5\") " pod="kuadrant-system/authorino-8b475cf9f-xpf9f"
May 26 21:54:50.433426 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.433352    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xpf9f"]
May 26 21:54:50.433603 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.433592    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xpf9f"
May 26 21:54:50.461711 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.461680    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-855fd4f756-qr7x8"]
May 26 21:54:50.465965 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.465941    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855fd4f756-qr7x8"
May 26 21:54:50.472922 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.472898    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-855fd4f756-qr7x8"]
May 26 21:54:50.549573 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.549544    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9hbr\" (UniqueName: \"kubernetes.io/projected/5b6bc23e-fa65-4e27-bb54-8a4337254953-kube-api-access-z9hbr\") pod \"authorino-855fd4f756-qr7x8\" (UID: \"5b6bc23e-fa65-4e27-bb54-8a4337254953\") " pod="kuadrant-system/authorino-855fd4f756-qr7x8"
May 26 21:54:50.559869 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.559841    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xpf9f"]
May 26 21:54:50.563106 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:54:50.563073    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a2f0581_8c0a_4e97_acad_df695bbc31e5.slice/crio-1e383522ae238ce4d7a571140d0d46b0c5d73541105d7b3e8ed0643920598147 WatchSource:0}: Error finding container 1e383522ae238ce4d7a571140d0d46b0c5d73541105d7b3e8ed0643920598147: Status 404 returned error can't find the container with id 1e383522ae238ce4d7a571140d0d46b0c5d73541105d7b3e8ed0643920598147
May 26 21:54:50.650943 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.650907    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9hbr\" (UniqueName: \"kubernetes.io/projected/5b6bc23e-fa65-4e27-bb54-8a4337254953-kube-api-access-z9hbr\") pod \"authorino-855fd4f756-qr7x8\" (UID: \"5b6bc23e-fa65-4e27-bb54-8a4337254953\") " pod="kuadrant-system/authorino-855fd4f756-qr7x8"
May 26 21:54:50.662433 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.662399    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9hbr\" (UniqueName: \"kubernetes.io/projected/5b6bc23e-fa65-4e27-bb54-8a4337254953-kube-api-access-z9hbr\") pod \"authorino-855fd4f756-qr7x8\" (UID: \"5b6bc23e-fa65-4e27-bb54-8a4337254953\") " pod="kuadrant-system/authorino-855fd4f756-qr7x8"
May 26 21:54:50.777544 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.777461    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855fd4f756-qr7x8"
May 26 21:54:50.876938 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.876897    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xpf9f" event={"ID":"4a2f0581-8c0a-4e97-acad-df695bbc31e5","Type":"ContainerStarted","Data":"1e383522ae238ce4d7a571140d0d46b0c5d73541105d7b3e8ed0643920598147"}
May 26 21:54:50.899472 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:50.899446    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-855fd4f756-qr7x8"]
May 26 21:54:50.902844 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:54:50.902820    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b6bc23e_fa65_4e27_bb54_8a4337254953.slice/crio-3e1b351b1b11fa2e140fed99cd8c55221d74301a27f5d8cfc5b03ea4f9510dc8 WatchSource:0}: Error finding container 3e1b351b1b11fa2e140fed99cd8c55221d74301a27f5d8cfc5b03ea4f9510dc8: Status 404 returned error can't find the container with id 3e1b351b1b11fa2e140fed99cd8c55221d74301a27f5d8cfc5b03ea4f9510dc8
May 26 21:54:51.881218 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:51.881181    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xpf9f" event={"ID":"4a2f0581-8c0a-4e97-acad-df695bbc31e5","Type":"ContainerStarted","Data":"efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52"}
May 26 21:54:51.881666 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:51.881259    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-xpf9f" podUID="4a2f0581-8c0a-4e97-acad-df695bbc31e5" containerName="authorino" containerID="cri-o://efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52" gracePeriod=30
May 26 21:54:51.882555 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:51.882533    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855fd4f756-qr7x8" event={"ID":"5b6bc23e-fa65-4e27-bb54-8a4337254953","Type":"ContainerStarted","Data":"62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb"}
May 26 21:54:51.882662 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:51.882562    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855fd4f756-qr7x8" event={"ID":"5b6bc23e-fa65-4e27-bb54-8a4337254953","Type":"ContainerStarted","Data":"3e1b351b1b11fa2e140fed99cd8c55221d74301a27f5d8cfc5b03ea4f9510dc8"}
May 26 21:54:51.896091 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:51.896050    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-xpf9f" podStartSLOduration=1.587514252 podStartE2EDuration="1.896037787s" podCreationTimestamp="2026-05-26 21:54:50 +0000 UTC" firstStartedPulling="2026-05-26 21:54:50.564372532 +0000 UTC m=+603.035601173" lastFinishedPulling="2026-05-26 21:54:50.872896064 +0000 UTC m=+603.344124708" observedRunningTime="2026-05-26 21:54:51.894957823 +0000 UTC m=+604.366186485" watchObservedRunningTime="2026-05-26 21:54:51.896037787 +0000 UTC m=+604.367266450"
May 26 21:54:51.909978 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:51.909936    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-855fd4f756-qr7x8" podStartSLOduration=1.587007069 podStartE2EDuration="1.909925019s" podCreationTimestamp="2026-05-26 21:54:50 +0000 UTC" firstStartedPulling="2026-05-26 21:54:50.904125616 +0000 UTC m=+603.375354256" lastFinishedPulling="2026-05-26 21:54:51.227043548 +0000 UTC m=+603.698272206" observedRunningTime="2026-05-26 21:54:51.908428858 +0000 UTC m=+604.379657522" watchObservedRunningTime="2026-05-26 21:54:51.909925019 +0000 UTC m=+604.381153682"
May 26 21:54:51.930770 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:51.930739    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-j5wl2"]
May 26 21:54:51.931043 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:51.931013    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-j5wl2" podUID="b1497575-b31c-421f-b88a-07d6c47ad752" containerName="authorino" containerID="cri-o://da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407" gracePeriod=30
May 26 21:54:52.065664 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.065629    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86d54959cb-s44hm"]
May 26 21:54:52.069772 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.069745    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:54:52.072090 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.072055    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 26 21:54:52.076847 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.076806    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86d54959cb-s44hm"]
May 26 21:54:52.163498 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.163450    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7664f0b8-2749-4f8f-b842-3274e4aafa76-tls-cert\") pod \"authorino-86d54959cb-s44hm\" (UID: \"7664f0b8-2749-4f8f-b842-3274e4aafa76\") " pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:54:52.163498 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.163500    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4kg2\" (UniqueName: \"kubernetes.io/projected/7664f0b8-2749-4f8f-b842-3274e4aafa76-kube-api-access-k4kg2\") pod \"authorino-86d54959cb-s44hm\" (UID: \"7664f0b8-2749-4f8f-b842-3274e4aafa76\") " pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:54:52.183709 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.183690    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xpf9f"
May 26 21:54:52.193432 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.193415    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-j5wl2"
May 26 21:54:52.264647 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.264619    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj9nh\" (UniqueName: \"kubernetes.io/projected/b1497575-b31c-421f-b88a-07d6c47ad752-kube-api-access-bj9nh\") pod \"b1497575-b31c-421f-b88a-07d6c47ad752\" (UID: \"b1497575-b31c-421f-b88a-07d6c47ad752\") "
May 26 21:54:52.264822 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.264664    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zcgl\" (UniqueName: \"kubernetes.io/projected/4a2f0581-8c0a-4e97-acad-df695bbc31e5-kube-api-access-4zcgl\") pod \"4a2f0581-8c0a-4e97-acad-df695bbc31e5\" (UID: \"4a2f0581-8c0a-4e97-acad-df695bbc31e5\") "
May 26 21:54:52.264822 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.264809    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7664f0b8-2749-4f8f-b842-3274e4aafa76-tls-cert\") pod \"authorino-86d54959cb-s44hm\" (UID: \"7664f0b8-2749-4f8f-b842-3274e4aafa76\") " pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:54:52.264960 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.264855    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4kg2\" (UniqueName: \"kubernetes.io/projected/7664f0b8-2749-4f8f-b842-3274e4aafa76-kube-api-access-k4kg2\") pod \"authorino-86d54959cb-s44hm\" (UID: \"7664f0b8-2749-4f8f-b842-3274e4aafa76\") " pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:54:52.266815 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.266773    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1497575-b31c-421f-b88a-07d6c47ad752-kube-api-access-bj9nh" (OuterVolumeSpecName: "kube-api-access-bj9nh") pod "b1497575-b31c-421f-b88a-07d6c47ad752" (UID: "b1497575-b31c-421f-b88a-07d6c47ad752"). InnerVolumeSpecName "kube-api-access-bj9nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:54:52.266925 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.266821    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a2f0581-8c0a-4e97-acad-df695bbc31e5-kube-api-access-4zcgl" (OuterVolumeSpecName: "kube-api-access-4zcgl") pod "4a2f0581-8c0a-4e97-acad-df695bbc31e5" (UID: "4a2f0581-8c0a-4e97-acad-df695bbc31e5"). InnerVolumeSpecName "kube-api-access-4zcgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:54:52.267129 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.267110    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7664f0b8-2749-4f8f-b842-3274e4aafa76-tls-cert\") pod \"authorino-86d54959cb-s44hm\" (UID: \"7664f0b8-2749-4f8f-b842-3274e4aafa76\") " pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:54:52.272931 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.272905    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4kg2\" (UniqueName: \"kubernetes.io/projected/7664f0b8-2749-4f8f-b842-3274e4aafa76-kube-api-access-k4kg2\") pod \"authorino-86d54959cb-s44hm\" (UID: \"7664f0b8-2749-4f8f-b842-3274e4aafa76\") " pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:54:52.365775 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.365693    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj9nh\" (UniqueName: \"kubernetes.io/projected/b1497575-b31c-421f-b88a-07d6c47ad752-kube-api-access-bj9nh\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:54:52.365775 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.365723    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zcgl\" (UniqueName: \"kubernetes.io/projected/4a2f0581-8c0a-4e97-acad-df695bbc31e5-kube-api-access-4zcgl\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:54:52.380556 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.380515    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:54:52.502640 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.502610    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86d54959cb-s44hm"]
May 26 21:54:52.505499 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:54:52.505473    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7664f0b8_2749_4f8f_b842_3274e4aafa76.slice/crio-1a36fa31d5c09f39d94dfa2290e2652ffd6d4183d040da46454580235f088f79 WatchSource:0}: Error finding container 1a36fa31d5c09f39d94dfa2290e2652ffd6d4183d040da46454580235f088f79: Status 404 returned error can't find the container with id 1a36fa31d5c09f39d94dfa2290e2652ffd6d4183d040da46454580235f088f79
May 26 21:54:52.888943 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.888911    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d54959cb-s44hm" event={"ID":"7664f0b8-2749-4f8f-b842-3274e4aafa76","Type":"ContainerStarted","Data":"1a36fa31d5c09f39d94dfa2290e2652ffd6d4183d040da46454580235f088f79"}
May 26 21:54:52.890114 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.890092    2555 generic.go:358] "Generic (PLEG): container finished" podID="b1497575-b31c-421f-b88a-07d6c47ad752" containerID="da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407" exitCode=0
May 26 21:54:52.890220 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.890144    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-j5wl2"
May 26 21:54:52.890220 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.890152    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-j5wl2" event={"ID":"b1497575-b31c-421f-b88a-07d6c47ad752","Type":"ContainerDied","Data":"da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407"}
May 26 21:54:52.890220 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.890200    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-j5wl2" event={"ID":"b1497575-b31c-421f-b88a-07d6c47ad752","Type":"ContainerDied","Data":"9746c16ab372cc88ae0cdf6064e8a50d39c4ef8ffa61180fcca45f9575dbf4ac"}
May 26 21:54:52.890360 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.890222    2555 scope.go:117] "RemoveContainer" containerID="da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407"
May 26 21:54:52.891312 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.891285    2555 generic.go:358] "Generic (PLEG): container finished" podID="4a2f0581-8c0a-4e97-acad-df695bbc31e5" containerID="efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52" exitCode=0
May 26 21:54:52.891383 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.891338    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xpf9f"
May 26 21:54:52.891435 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.891374    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xpf9f" event={"ID":"4a2f0581-8c0a-4e97-acad-df695bbc31e5","Type":"ContainerDied","Data":"efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52"}
May 26 21:54:52.891435 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.891406    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xpf9f" event={"ID":"4a2f0581-8c0a-4e97-acad-df695bbc31e5","Type":"ContainerDied","Data":"1e383522ae238ce4d7a571140d0d46b0c5d73541105d7b3e8ed0643920598147"}
May 26 21:54:52.901548 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.901526    2555 scope.go:117] "RemoveContainer" containerID="da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407"
May 26 21:54:52.901902 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:54:52.901876    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407\": container with ID starting with da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407 not found: ID does not exist" containerID="da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407"
May 26 21:54:52.902003 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.901911    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407"} err="failed to get container status \"da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407\": rpc error: code = NotFound desc = could not find container \"da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407\": container with ID starting with da3e4689cd5e48d20b0ea095b76d6ecb1d7fe95263adf0db81c4dbc2bdbe7407 not found: ID does not exist"
May 26 21:54:52.902003 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.901930    2555 scope.go:117] "RemoveContainer" containerID="efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52"
May 26 21:54:52.910710 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.910694    2555 scope.go:117] "RemoveContainer" containerID="efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52"
May 26 21:54:52.910963 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:54:52.910946    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52\": container with ID starting with efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52 not found: ID does not exist" containerID="efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52"
May 26 21:54:52.911014 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.910970    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52"} err="failed to get container status \"efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52\": rpc error: code = NotFound desc = could not find container \"efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52\": container with ID starting with efef4e18fe1ef009f453938afc5bc5d9b24d8b93a6a365572d03bd842830fb52 not found: ID does not exist"
May 26 21:54:52.918634 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.918613    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-j5wl2"]
May 26 21:54:52.922641 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.922620    2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-j5wl2"]
May 26 21:54:52.931632 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.931602    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xpf9f"]
May 26 21:54:52.935267 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:52.935244    2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xpf9f"]
May 26 21:54:53.896065 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:53.896030    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d54959cb-s44hm" event={"ID":"7664f0b8-2749-4f8f-b842-3274e4aafa76","Type":"ContainerStarted","Data":"d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143"}
May 26 21:54:53.912150 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:53.912106    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-86d54959cb-s44hm" podStartSLOduration=1.5943459199999999 podStartE2EDuration="1.912090584s" podCreationTimestamp="2026-05-26 21:54:52 +0000 UTC" firstStartedPulling="2026-05-26 21:54:52.506936612 +0000 UTC m=+604.978165258" lastFinishedPulling="2026-05-26 21:54:52.824681271 +0000 UTC m=+605.295909922" observedRunningTime="2026-05-26 21:54:53.911102515 +0000 UTC m=+606.382331177" watchObservedRunningTime="2026-05-26 21:54:53.912090584 +0000 UTC m=+606.383319248"
May 26 21:54:53.940243 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:53.940210    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-855fd4f756-qr7x8"]
May 26 21:54:53.940430 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:53.940409    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-855fd4f756-qr7x8" podUID="5b6bc23e-fa65-4e27-bb54-8a4337254953" containerName="authorino" containerID="cri-o://62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb" gracePeriod=30
May 26 21:54:54.039905 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.039870    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a2f0581-8c0a-4e97-acad-df695bbc31e5" path="/var/lib/kubelet/pods/4a2f0581-8c0a-4e97-acad-df695bbc31e5/volumes"
May 26 21:54:54.040230 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.040216    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1497575-b31c-421f-b88a-07d6c47ad752" path="/var/lib/kubelet/pods/b1497575-b31c-421f-b88a-07d6c47ad752/volumes"
May 26 21:54:54.180447 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.180426    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855fd4f756-qr7x8"
May 26 21:54:54.188795 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.188768    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9hbr\" (UniqueName: \"kubernetes.io/projected/5b6bc23e-fa65-4e27-bb54-8a4337254953-kube-api-access-z9hbr\") pod \"5b6bc23e-fa65-4e27-bb54-8a4337254953\" (UID: \"5b6bc23e-fa65-4e27-bb54-8a4337254953\") "
May 26 21:54:54.190677 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.190658    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6bc23e-fa65-4e27-bb54-8a4337254953-kube-api-access-z9hbr" (OuterVolumeSpecName: "kube-api-access-z9hbr") pod "5b6bc23e-fa65-4e27-bb54-8a4337254953" (UID: "5b6bc23e-fa65-4e27-bb54-8a4337254953"). InnerVolumeSpecName "kube-api-access-z9hbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:54:54.289632 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.289605    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9hbr\" (UniqueName: \"kubernetes.io/projected/5b6bc23e-fa65-4e27-bb54-8a4337254953-kube-api-access-z9hbr\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:54:54.902515 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.902472    2555 generic.go:358] "Generic (PLEG): container finished" podID="5b6bc23e-fa65-4e27-bb54-8a4337254953" containerID="62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb" exitCode=0
May 26 21:54:54.902515 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.902519    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855fd4f756-qr7x8"
May 26 21:54:54.903046 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.902563    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855fd4f756-qr7x8" event={"ID":"5b6bc23e-fa65-4e27-bb54-8a4337254953","Type":"ContainerDied","Data":"62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb"}
May 26 21:54:54.903046 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.902603    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855fd4f756-qr7x8" event={"ID":"5b6bc23e-fa65-4e27-bb54-8a4337254953","Type":"ContainerDied","Data":"3e1b351b1b11fa2e140fed99cd8c55221d74301a27f5d8cfc5b03ea4f9510dc8"}
May 26 21:54:54.903046 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.902624    2555 scope.go:117] "RemoveContainer" containerID="62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb"
May 26 21:54:54.910266 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.910249    2555 scope.go:117] "RemoveContainer" containerID="62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb"
May 26 21:54:54.910506 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:54:54.910489    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb\": container with ID starting with 62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb not found: ID does not exist" containerID="62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb"
May 26 21:54:54.910566 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.910520    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb"} err="failed to get container status \"62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb\": rpc error: code = NotFound desc = could not find container \"62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb\": container with ID starting with 62a69b0e4374fe93724939abc9435ae64ef5b69289bf12786df9d9781aa244eb not found: ID does not exist"
May 26 21:54:54.922102 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.922077    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-855fd4f756-qr7x8"]
May 26 21:54:54.925844 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:54.925824    2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-855fd4f756-qr7x8"]
May 26 21:54:55.334028 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.333957    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bdddc4f57-lz246"]
May 26 21:54:55.334224 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.334213    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6bc23e-fa65-4e27-bb54-8a4337254953" containerName="authorino"
May 26 21:54:55.334269 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.334226    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6bc23e-fa65-4e27-bb54-8a4337254953" containerName="authorino"
May 26 21:54:55.334269 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.334234    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a2f0581-8c0a-4e97-acad-df695bbc31e5" containerName="authorino"
May 26 21:54:55.334269 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.334239    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a2f0581-8c0a-4e97-acad-df695bbc31e5" containerName="authorino"
May 26 21:54:55.334269 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.334255    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1497575-b31c-421f-b88a-07d6c47ad752" containerName="authorino"
May 26 21:54:55.334269 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.334261    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1497575-b31c-421f-b88a-07d6c47ad752" containerName="authorino"
May 26 21:54:55.334406 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.334307    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a2f0581-8c0a-4e97-acad-df695bbc31e5" containerName="authorino"
May 26 21:54:55.334406 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.334315    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b6bc23e-fa65-4e27-bb54-8a4337254953" containerName="authorino"
May 26 21:54:55.334406 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.334322    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1497575-b31c-421f-b88a-07d6c47ad752" containerName="authorino"
May 26 21:54:55.379159 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.379125    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bdddc4f57-lz246"]
May 26 21:54:55.379308 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.379198    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bdddc4f57-lz246"
May 26 21:54:55.382062 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.382041    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 26 21:54:55.382169 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.382080    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nv4cd\""
May 26 21:54:55.395885 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.395861    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh7ks\" (UniqueName: \"kubernetes.io/projected/92a998de-78e1-4dde-89da-3d1abb8bc163-kube-api-access-rh7ks\") pod \"maas-controller-5bdddc4f57-lz246\" (UID: \"92a998de-78e1-4dde-89da-3d1abb8bc163\") " pod="opendatahub/maas-controller-5bdddc4f57-lz246"
May 26 21:54:55.497210 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.497175    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rh7ks\" (UniqueName: \"kubernetes.io/projected/92a998de-78e1-4dde-89da-3d1abb8bc163-kube-api-access-rh7ks\") pod \"maas-controller-5bdddc4f57-lz246\" (UID: \"92a998de-78e1-4dde-89da-3d1abb8bc163\") " pod="opendatahub/maas-controller-5bdddc4f57-lz246"
May 26 21:54:55.511172 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.511149    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh7ks\" (UniqueName: \"kubernetes.io/projected/92a998de-78e1-4dde-89da-3d1abb8bc163-kube-api-access-rh7ks\") pod \"maas-controller-5bdddc4f57-lz246\" (UID: \"92a998de-78e1-4dde-89da-3d1abb8bc163\") " pod="opendatahub/maas-controller-5bdddc4f57-lz246"
May 26 21:54:55.688835 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.688773    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bdddc4f57-lz246"
May 26 21:54:55.811276 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.811243    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bdddc4f57-lz246"]
May 26 21:54:55.815473 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:54:55.815448    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a998de_78e1_4dde_89da_3d1abb8bc163.slice/crio-665a4aa0460308c6f9b5a4f82ff5b46e026284fcf5fbe2ec824ce903dbe88e1a WatchSource:0}: Error finding container 665a4aa0460308c6f9b5a4f82ff5b46e026284fcf5fbe2ec824ce903dbe88e1a: Status 404 returned error can't find the container with id 665a4aa0460308c6f9b5a4f82ff5b46e026284fcf5fbe2ec824ce903dbe88e1a
May 26 21:54:55.907615 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:55.907584    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bdddc4f57-lz246" event={"ID":"92a998de-78e1-4dde-89da-3d1abb8bc163","Type":"ContainerStarted","Data":"665a4aa0460308c6f9b5a4f82ff5b46e026284fcf5fbe2ec824ce903dbe88e1a"}
May 26 21:54:56.040163 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:56.040091    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b6bc23e-fa65-4e27-bb54-8a4337254953" path="/var/lib/kubelet/pods/5b6bc23e-fa65-4e27-bb54-8a4337254953/volumes"
May 26 21:54:58.921453 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:58.921419    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bdddc4f57-lz246" event={"ID":"92a998de-78e1-4dde-89da-3d1abb8bc163","Type":"ContainerStarted","Data":"b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e"}
May 26 21:54:58.921838 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:58.921547    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bdddc4f57-lz246"
May 26 21:54:58.938766 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:54:58.938715    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5bdddc4f57-lz246" podStartSLOduration=1.388011371 podStartE2EDuration="3.938696871s" podCreationTimestamp="2026-05-26 21:54:55 +0000 UTC" firstStartedPulling="2026-05-26 21:54:55.816699614 +0000 UTC m=+608.287928254" lastFinishedPulling="2026-05-26 21:54:58.367385113 +0000 UTC m=+610.838613754" observedRunningTime="2026-05-26 21:54:58.938412649 +0000 UTC m=+611.409641313" watchObservedRunningTime="2026-05-26 21:54:58.938696871 +0000 UTC m=+611.409925535"
May 26 21:55:09.679509 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.679428    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bdddc4f57-lz246"]
May 26 21:55:09.679986 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.679664    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5bdddc4f57-lz246" podUID="92a998de-78e1-4dde-89da-3d1abb8bc163" containerName="manager" containerID="cri-o://b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e" gracePeriod=30
May 26 21:55:09.688605 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.688576    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bdddc4f57-lz246"
May 26 21:55:09.921025 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.921001    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bdddc4f57-lz246"
May 26 21:55:09.955412 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.955338    2555 generic.go:358] "Generic (PLEG): container finished" podID="92a998de-78e1-4dde-89da-3d1abb8bc163" containerID="b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e" exitCode=0
May 26 21:55:09.955412 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.955385    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bdddc4f57-lz246" event={"ID":"92a998de-78e1-4dde-89da-3d1abb8bc163","Type":"ContainerDied","Data":"b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e"}
May 26 21:55:09.955412 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.955410    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bdddc4f57-lz246" event={"ID":"92a998de-78e1-4dde-89da-3d1abb8bc163","Type":"ContainerDied","Data":"665a4aa0460308c6f9b5a4f82ff5b46e026284fcf5fbe2ec824ce903dbe88e1a"}
May 26 21:55:09.955622 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.955411    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bdddc4f57-lz246"
May 26 21:55:09.955622 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.955425    2555 scope.go:117] "RemoveContainer" containerID="b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e"
May 26 21:55:09.963035 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.963018    2555 scope.go:117] "RemoveContainer" containerID="b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e"
May 26 21:55:09.963268 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:55:09.963250    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e\": container with ID starting with b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e not found: ID does not exist" containerID="b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e"
May 26 21:55:09.963324 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:09.963277    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e"} err="failed to get container status \"b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e\": rpc error: code = NotFound desc = could not find container \"b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e\": container with ID starting with b3afca01a1cdc00f8952bdaf477dfe618d08e2541c9b09aad917f70233868d5e not found: ID does not exist"
May 26 21:55:10.011630 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:10.011596    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh7ks\" (UniqueName: \"kubernetes.io/projected/92a998de-78e1-4dde-89da-3d1abb8bc163-kube-api-access-rh7ks\") pod \"92a998de-78e1-4dde-89da-3d1abb8bc163\" (UID: \"92a998de-78e1-4dde-89da-3d1abb8bc163\") "
May 26 21:55:10.013830 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:10.013770    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a998de-78e1-4dde-89da-3d1abb8bc163-kube-api-access-rh7ks" (OuterVolumeSpecName: "kube-api-access-rh7ks") pod "92a998de-78e1-4dde-89da-3d1abb8bc163" (UID: "92a998de-78e1-4dde-89da-3d1abb8bc163"). InnerVolumeSpecName "kube-api-access-rh7ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:55:10.112631 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:10.112594    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh7ks\" (UniqueName: \"kubernetes.io/projected/92a998de-78e1-4dde-89da-3d1abb8bc163-kube-api-access-rh7ks\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:55:10.271635 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:10.271544    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bdddc4f57-lz246"]
May 26 21:55:10.276293 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:10.276269    2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bdddc4f57-lz246"]
May 26 21:55:12.039339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:12.039304    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92a998de-78e1-4dde-89da-3d1abb8bc163" path="/var/lib/kubelet/pods/92a998de-78e1-4dde-89da-3d1abb8bc163/volumes"
May 26 21:55:48.712120 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.712079    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"]
May 26 21:55:48.712513 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.712412    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a998de-78e1-4dde-89da-3d1abb8bc163" containerName="manager"
May 26 21:55:48.712513 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.712426    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a998de-78e1-4dde-89da-3d1abb8bc163" containerName="manager"
May 26 21:55:48.712513 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.712474    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="92a998de-78e1-4dde-89da-3d1abb8bc163" containerName="manager"
May 26 21:55:48.716688 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.716672    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.719307 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.719285    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c55w2\""
May 26 21:55:48.719307 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.719298    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 26 21:55:48.720228 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.720213    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 26 21:55:48.720312 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.720211    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 26 21:55:48.723968 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.723947    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"]
May 26 21:55:48.829960 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.829932    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.830119 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.829970    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxztx\" (UniqueName: \"kubernetes.io/projected/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-kube-api-access-kxztx\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.830119 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.830006    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.830119 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.830070    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.830119 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.830112    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.830252 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.830140    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.931094 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.931063    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.931236 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.931104    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.931236 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.931126    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.931236 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.931159    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.931236 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.931180    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxztx\" (UniqueName: \"kubernetes.io/projected/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-kube-api-access-kxztx\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.931236 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.931201    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.931570 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.931540    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.931673 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.931595    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.931673 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.931659    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.933337 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.933319    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.933698 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.933679    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:48.938250 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:48.938231    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxztx\" (UniqueName: \"kubernetes.io/projected/a4fe240c-d6bc-470a-9efe-7fd63f6f6754-kube-api-access-kxztx\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m\" (UID: \"a4fe240c-d6bc-470a-9efe-7fd63f6f6754\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:49.026887 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:49.026817    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:55:49.154470 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:49.154438    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"]
May 26 21:55:49.157236 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:55:49.157202    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4fe240c_d6bc_470a_9efe_7fd63f6f6754.slice/crio-64eb32e2b160d988159532ee1a75f855828d671dbd043e8713b4778161e1efea WatchSource:0}: Error finding container 64eb32e2b160d988159532ee1a75f855828d671dbd043e8713b4778161e1efea: Status 404 returned error can't find the container with id 64eb32e2b160d988159532ee1a75f855828d671dbd043e8713b4778161e1efea
May 26 21:55:50.083781 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:50.083739    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m" event={"ID":"a4fe240c-d6bc-470a-9efe-7fd63f6f6754","Type":"ContainerStarted","Data":"64eb32e2b160d988159532ee1a75f855828d671dbd043e8713b4778161e1efea"}
May 26 21:55:56.105568 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:55:56.105529    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m" event={"ID":"a4fe240c-d6bc-470a-9efe-7fd63f6f6754","Type":"ContainerStarted","Data":"6857b2000ed19f9243a576cf7d64f951c8d7b35ef5371873d13e880e16dc17b7"}
May 26 21:56:01.121349 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:01.121318    2555 generic.go:358] "Generic (PLEG): container finished" podID="a4fe240c-d6bc-470a-9efe-7fd63f6f6754" containerID="6857b2000ed19f9243a576cf7d64f951c8d7b35ef5371873d13e880e16dc17b7" exitCode=0
May 26 21:56:01.121732 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:01.121358    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m" event={"ID":"a4fe240c-d6bc-470a-9efe-7fd63f6f6754","Type":"ContainerDied","Data":"6857b2000ed19f9243a576cf7d64f951c8d7b35ef5371873d13e880e16dc17b7"}
May 26 21:56:03.130440 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:03.130405    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m" event={"ID":"a4fe240c-d6bc-470a-9efe-7fd63f6f6754","Type":"ContainerStarted","Data":"2a11b2bf71143c295dacc1d25abc99450c2f9a682fc5e0f9676a8de8d6d2e90a"}
May 26 21:56:03.130822 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:03.130613    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:56:03.150080 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:03.150031    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m" podStartSLOduration=2.106475487 podStartE2EDuration="15.150014745s" podCreationTimestamp="2026-05-26 21:55:48 +0000 UTC" firstStartedPulling="2026-05-26 21:55:49.159255606 +0000 UTC m=+661.630484247" lastFinishedPulling="2026-05-26 21:56:02.202794848 +0000 UTC m=+674.674023505" observedRunningTime="2026-05-26 21:56:03.14793965 +0000 UTC m=+675.619168313" watchObservedRunningTime="2026-05-26 21:56:03.150014745 +0000 UTC m=+675.621243408"
May 26 21:56:08.907236 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.907196    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"]
May 26 21:56:08.913931 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.913904    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:08.916389 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.916372    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 26 21:56:08.921339 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.921316    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"]
May 26 21:56:08.997614 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.997576    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:08.997751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.997628    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:08.997751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.997659    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbad96da-fad4-440b-ad2a-754a83caf95f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:08.997751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.997677    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrg22\" (UniqueName: \"kubernetes.io/projected/dbad96da-fad4-440b-ad2a-754a83caf95f-kube-api-access-jrg22\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:08.997751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.997696    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:08.997751 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:08.997730    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.098847 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.098813    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.099052 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.098854    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.099052 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.098887    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.099052 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.098917    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.099052 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.098959    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbad96da-fad4-440b-ad2a-754a83caf95f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.099052 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.099002    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrg22\" (UniqueName: \"kubernetes.io/projected/dbad96da-fad4-440b-ad2a-754a83caf95f-kube-api-access-jrg22\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.099310 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.099291    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.099373 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.099330    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.099410 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.099370    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.101102 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.101081    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbad96da-fad4-440b-ad2a-754a83caf95f-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.101486 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.101465    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbad96da-fad4-440b-ad2a-754a83caf95f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.106516 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.106494    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrg22\" (UniqueName: \"kubernetes.io/projected/dbad96da-fad4-440b-ad2a-754a83caf95f-kube-api-access-jrg22\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-crv9h\" (UID: \"dbad96da-fad4-440b-ad2a-754a83caf95f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.223758 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.223674    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:09.350420 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.350395    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"]
May 26 21:56:09.352862 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:56:09.352827    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbad96da_fad4_440b_ad2a_754a83caf95f.slice/crio-6a8ac93f1dd166414bcc91db3a6e87aa817831566fa22110244a3a9443c76293 WatchSource:0}: Error finding container 6a8ac93f1dd166414bcc91db3a6e87aa817831566fa22110244a3a9443c76293: Status 404 returned error can't find the container with id 6a8ac93f1dd166414bcc91db3a6e87aa817831566fa22110244a3a9443c76293
May 26 21:56:09.355293 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:09.355277    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 21:56:10.154804 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:10.154738    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h" event={"ID":"dbad96da-fad4-440b-ad2a-754a83caf95f","Type":"ContainerStarted","Data":"42619786c0c22d5a9e8a6dce0a3d53744a7701eba1ed7f84a483a4ea272417a9"}
May 26 21:56:10.154804 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:10.154773    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h" event={"ID":"dbad96da-fad4-440b-ad2a-754a83caf95f","Type":"ContainerStarted","Data":"6a8ac93f1dd166414bcc91db3a6e87aa817831566fa22110244a3a9443c76293"}
May 26 21:56:14.146516 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:14.146479    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m"
May 26 21:56:18.181069 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:18.181033    2555 generic.go:358] "Generic (PLEG): container finished" podID="dbad96da-fad4-440b-ad2a-754a83caf95f" containerID="42619786c0c22d5a9e8a6dce0a3d53744a7701eba1ed7f84a483a4ea272417a9" exitCode=0
May 26 21:56:18.181518 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:18.181086    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h" event={"ID":"dbad96da-fad4-440b-ad2a-754a83caf95f","Type":"ContainerDied","Data":"42619786c0c22d5a9e8a6dce0a3d53744a7701eba1ed7f84a483a4ea272417a9"}
May 26 21:56:19.190904 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:19.190871    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h" event={"ID":"dbad96da-fad4-440b-ad2a-754a83caf95f","Type":"ContainerStarted","Data":"0a3eafd88cc82d1248bc36ba5e70f0296bb91d91c98b1439658504e74ed0bdca"}
May 26 21:56:19.191453 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:19.191096    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:19.212448 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:19.212396    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h" podStartSLOduration=11.014033989 podStartE2EDuration="11.212376652s" podCreationTimestamp="2026-05-26 21:56:08 +0000 UTC" firstStartedPulling="2026-05-26 21:56:18.181811408 +0000 UTC m=+690.653040049" lastFinishedPulling="2026-05-26 21:56:18.380154071 +0000 UTC m=+690.851382712" observedRunningTime="2026-05-26 21:56:19.210996301 +0000 UTC m=+691.682224964" watchObservedRunningTime="2026-05-26 21:56:19.212376652 +0000 UTC m=+691.683605316"
May 26 21:56:25.706921 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.706842    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"]
May 26 21:56:25.740028 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.739998    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"]
May 26 21:56:25.740176 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.740124    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.742944 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.742919    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 26 21:56:25.843660 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.843623    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5132d895-a797-4f27-afce-08b1398fb1df-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.843833 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.843674    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.843833 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.843726    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.843833 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.843757    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.843956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.843844    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.843956 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.843870    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v2cq\" (UniqueName: \"kubernetes.io/projected/5132d895-a797-4f27-afce-08b1398fb1df-kube-api-access-9v2cq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.945145 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.945104    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.945291 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.945150    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9v2cq\" (UniqueName: \"kubernetes.io/projected/5132d895-a797-4f27-afce-08b1398fb1df-kube-api-access-9v2cq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.945291 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.945182    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5132d895-a797-4f27-afce-08b1398fb1df-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.945291 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.945212    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.945291 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.945236    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.945291 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.945260    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.945579 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.945554    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.945624 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.945605    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.945706 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.945685    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.947429 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.947408    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5132d895-a797-4f27-afce-08b1398fb1df-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.947690 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.947673    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5132d895-a797-4f27-afce-08b1398fb1df-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:25.952745 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:25.952727    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v2cq\" (UniqueName: \"kubernetes.io/projected/5132d895-a797-4f27-afce-08b1398fb1df-kube-api-access-9v2cq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh\" (UID: \"5132d895-a797-4f27-afce-08b1398fb1df\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:26.049889 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:26.049814    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:26.176600 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:26.176389    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"]
May 26 21:56:26.179657 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:56:26.179619    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5132d895_a797_4f27_afce_08b1398fb1df.slice/crio-a75548ba480c364539794174acabc78f912f7bc3f22c8f688c80788ea3d4c7e0 WatchSource:0}: Error finding container a75548ba480c364539794174acabc78f912f7bc3f22c8f688c80788ea3d4c7e0: Status 404 returned error can't find the container with id a75548ba480c364539794174acabc78f912f7bc3f22c8f688c80788ea3d4c7e0
May 26 21:56:26.214096 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:26.214062    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh" event={"ID":"5132d895-a797-4f27-afce-08b1398fb1df","Type":"ContainerStarted","Data":"a75548ba480c364539794174acabc78f912f7bc3f22c8f688c80788ea3d4c7e0"}
May 26 21:56:27.218941 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:27.218906    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh" event={"ID":"5132d895-a797-4f27-afce-08b1398fb1df","Type":"ContainerStarted","Data":"d426f10d4dcdc84a0e44710e97732acbb020b2d081608c063bf1706c96f90b05"}
May 26 21:56:30.207222 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:30.207186    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-crv9h"
May 26 21:56:32.236219 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:32.236183    2555 generic.go:358] "Generic (PLEG): container finished" podID="5132d895-a797-4f27-afce-08b1398fb1df" containerID="d426f10d4dcdc84a0e44710e97732acbb020b2d081608c063bf1706c96f90b05" exitCode=0
May 26 21:56:32.236675 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:32.236258    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh" event={"ID":"5132d895-a797-4f27-afce-08b1398fb1df","Type":"ContainerDied","Data":"d426f10d4dcdc84a0e44710e97732acbb020b2d081608c063bf1706c96f90b05"}
May 26 21:56:33.240694 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:33.240657    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh" event={"ID":"5132d895-a797-4f27-afce-08b1398fb1df","Type":"ContainerStarted","Data":"99fc4782cb99b44da57499f432d58dee864a3058b94d8c1929f16784110f326b"}
May 26 21:56:33.241110 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:33.240934    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:33.257918 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:33.257867    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh" podStartSLOduration=7.865867971 podStartE2EDuration="8.257854102s" podCreationTimestamp="2026-05-26 21:56:25 +0000 UTC" firstStartedPulling="2026-05-26 21:56:32.236995721 +0000 UTC m=+704.708224362" lastFinishedPulling="2026-05-26 21:56:32.628981837 +0000 UTC m=+705.100210493" observedRunningTime="2026-05-26 21:56:33.25708309 +0000 UTC m=+705.728311752" watchObservedRunningTime="2026-05-26 21:56:33.257854102 +0000 UTC m=+705.729082764"
May 26 21:56:44.257016 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:44.256941    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh"
May 26 21:56:52.829501 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:52.829463    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8644d4cd5c-fb8vt"]
May 26 21:56:52.832845 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:52.832826    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8644d4cd5c-fb8vt"
May 26 21:56:52.839070 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:52.839046    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8644d4cd5c-fb8vt"]
May 26 21:56:52.870138 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:52.870108    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3888013-6f8c-49bf-b093-00ab89bde14d-tls-cert\") pod \"authorino-8644d4cd5c-fb8vt\" (UID: \"f3888013-6f8c-49bf-b093-00ab89bde14d\") " pod="kuadrant-system/authorino-8644d4cd5c-fb8vt"
May 26 21:56:52.870261 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:52.870177    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpjzq\" (UniqueName: \"kubernetes.io/projected/f3888013-6f8c-49bf-b093-00ab89bde14d-kube-api-access-mpjzq\") pod \"authorino-8644d4cd5c-fb8vt\" (UID: \"f3888013-6f8c-49bf-b093-00ab89bde14d\") " pod="kuadrant-system/authorino-8644d4cd5c-fb8vt"
May 26 21:56:52.971206 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:52.971169    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3888013-6f8c-49bf-b093-00ab89bde14d-tls-cert\") pod \"authorino-8644d4cd5c-fb8vt\" (UID: \"f3888013-6f8c-49bf-b093-00ab89bde14d\") " pod="kuadrant-system/authorino-8644d4cd5c-fb8vt"
May 26 21:56:52.971359 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:52.971267    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpjzq\" (UniqueName: \"kubernetes.io/projected/f3888013-6f8c-49bf-b093-00ab89bde14d-kube-api-access-mpjzq\") pod \"authorino-8644d4cd5c-fb8vt\" (UID: \"f3888013-6f8c-49bf-b093-00ab89bde14d\") " pod="kuadrant-system/authorino-8644d4cd5c-fb8vt"
May 26 21:56:52.973704 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:52.973683    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3888013-6f8c-49bf-b093-00ab89bde14d-tls-cert\") pod \"authorino-8644d4cd5c-fb8vt\" (UID: \"f3888013-6f8c-49bf-b093-00ab89bde14d\") " pod="kuadrant-system/authorino-8644d4cd5c-fb8vt"
May 26 21:56:52.978322 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:52.978302    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpjzq\" (UniqueName: \"kubernetes.io/projected/f3888013-6f8c-49bf-b093-00ab89bde14d-kube-api-access-mpjzq\") pod \"authorino-8644d4cd5c-fb8vt\" (UID: \"f3888013-6f8c-49bf-b093-00ab89bde14d\") " pod="kuadrant-system/authorino-8644d4cd5c-fb8vt"
May 26 21:56:53.143262 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:53.143217    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8644d4cd5c-fb8vt"
May 26 21:56:53.271924 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:53.271899    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8644d4cd5c-fb8vt"]
May 26 21:56:53.274627 ip-10-0-140-172 kubenswrapper[2555]: W0526 21:56:53.274599    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3888013_6f8c_49bf_b093_00ab89bde14d.slice/crio-75a6e90dada89a471eb3cdf0f969b9de05a822a9909005eb782becd228c43256 WatchSource:0}: Error finding container 75a6e90dada89a471eb3cdf0f969b9de05a822a9909005eb782becd228c43256: Status 404 returned error can't find the container with id 75a6e90dada89a471eb3cdf0f969b9de05a822a9909005eb782becd228c43256
May 26 21:56:53.304344 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:53.304315    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8644d4cd5c-fb8vt" event={"ID":"f3888013-6f8c-49bf-b093-00ab89bde14d","Type":"ContainerStarted","Data":"75a6e90dada89a471eb3cdf0f969b9de05a822a9909005eb782becd228c43256"}
May 26 21:56:54.308848 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.308814    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8644d4cd5c-fb8vt" event={"ID":"f3888013-6f8c-49bf-b093-00ab89bde14d","Type":"ContainerStarted","Data":"d547571b4c11e88cebdb459cb9385f7047a49af7f709e731a41a394bfd171439"}
May 26 21:56:54.324534 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.324488    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8644d4cd5c-fb8vt" podStartSLOduration=1.928475852 podStartE2EDuration="2.324473733s" podCreationTimestamp="2026-05-26 21:56:52 +0000 UTC" firstStartedPulling="2026-05-26 21:56:53.276356318 +0000 UTC m=+725.747584962" lastFinishedPulling="2026-05-26 21:56:53.67235419 +0000 UTC m=+726.143582843" observedRunningTime="2026-05-26 21:56:54.323392885 +0000 UTC m=+726.794621548" watchObservedRunningTime="2026-05-26 21:56:54.324473733 +0000 UTC m=+726.795702429"
May 26 21:56:54.350694 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.349083    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86d54959cb-s44hm"]
May 26 21:56:54.350694 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.349327    2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-86d54959cb-s44hm" podUID="7664f0b8-2749-4f8f-b842-3274e4aafa76" containerName="authorino" containerID="cri-o://d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143" gracePeriod=30
May 26 21:56:54.602493 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.602472    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:56:54.688138 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.688107    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7664f0b8-2749-4f8f-b842-3274e4aafa76-tls-cert\") pod \"7664f0b8-2749-4f8f-b842-3274e4aafa76\" (UID: \"7664f0b8-2749-4f8f-b842-3274e4aafa76\") "
May 26 21:56:54.688294 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.688156    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4kg2\" (UniqueName: \"kubernetes.io/projected/7664f0b8-2749-4f8f-b842-3274e4aafa76-kube-api-access-k4kg2\") pod \"7664f0b8-2749-4f8f-b842-3274e4aafa76\" (UID: \"7664f0b8-2749-4f8f-b842-3274e4aafa76\") "
May 26 21:56:54.690218 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.690196    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7664f0b8-2749-4f8f-b842-3274e4aafa76-kube-api-access-k4kg2" (OuterVolumeSpecName: "kube-api-access-k4kg2") pod "7664f0b8-2749-4f8f-b842-3274e4aafa76" (UID: "7664f0b8-2749-4f8f-b842-3274e4aafa76"). InnerVolumeSpecName "kube-api-access-k4kg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:56:54.697684 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.697662    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7664f0b8-2749-4f8f-b842-3274e4aafa76-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7664f0b8-2749-4f8f-b842-3274e4aafa76" (UID: "7664f0b8-2749-4f8f-b842-3274e4aafa76"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:56:54.789079 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.789039    2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7664f0b8-2749-4f8f-b842-3274e4aafa76-tls-cert\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:56:54.789079 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:54.789076    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4kg2\" (UniqueName: \"kubernetes.io/projected/7664f0b8-2749-4f8f-b842-3274e4aafa76-kube-api-access-k4kg2\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 21:56:55.314580 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:55.314499    2555 generic.go:358] "Generic (PLEG): container finished" podID="7664f0b8-2749-4f8f-b842-3274e4aafa76" containerID="d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143" exitCode=0
May 26 21:56:55.314580 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:55.314542    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d54959cb-s44hm"
May 26 21:56:55.315049 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:55.314573    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d54959cb-s44hm" event={"ID":"7664f0b8-2749-4f8f-b842-3274e4aafa76","Type":"ContainerDied","Data":"d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143"}
May 26 21:56:55.315049 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:55.314614    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d54959cb-s44hm" event={"ID":"7664f0b8-2749-4f8f-b842-3274e4aafa76","Type":"ContainerDied","Data":"1a36fa31d5c09f39d94dfa2290e2652ffd6d4183d040da46454580235f088f79"}
May 26 21:56:55.315049 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:55.314629    2555 scope.go:117] "RemoveContainer" containerID="d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143"
May 26 21:56:55.323026 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:55.322849    2555 scope.go:117] "RemoveContainer" containerID="d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143"
May 26 21:56:55.323257 ip-10-0-140-172 kubenswrapper[2555]: E0526 21:56:55.323223    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143\": container with ID starting with d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143 not found: ID does not exist" containerID="d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143"
May 26 21:56:55.323363 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:55.323257    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143"} err="failed to get container status \"d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143\": rpc error: code = NotFound desc = could not find container \"d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143\": container with ID starting with d34ab088845a1608f1e3b032552797cd1803a1705af18fa32b124e817ab05143 not found: ID does not exist"
May 26 21:56:55.341693 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:55.341666    2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86d54959cb-s44hm"]
May 26 21:56:55.348391 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:55.348359    2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86d54959cb-s44hm"]
May 26 21:56:56.039506 ip-10-0-140-172 kubenswrapper[2555]: I0526 21:56:56.039466    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7664f0b8-2749-4f8f-b842-3274e4aafa76" path="/var/lib/kubelet/pods/7664f0b8-2749-4f8f-b842-3274e4aafa76/volumes"
May 26 22:00:00.144411 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.144374    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663880-8m5rd"]
May 26 22:00:00.144879 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.144687    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7664f0b8-2749-4f8f-b842-3274e4aafa76" containerName="authorino"
May 26 22:00:00.144879 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.144699    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7664f0b8-2749-4f8f-b842-3274e4aafa76" containerName="authorino"
May 26 22:00:00.144879 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.144756    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="7664f0b8-2749-4f8f-b842-3274e4aafa76" containerName="authorino"
May 26 22:00:00.147635 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.147618    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd"
May 26 22:00:00.149825 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.149804    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ndlt2\""
May 26 22:00:00.154578 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.154553    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663880-8m5rd"]
May 26 22:00:00.195494 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.195463    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fdtr\" (UniqueName: \"kubernetes.io/projected/b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6-kube-api-access-7fdtr\") pod \"maas-api-key-cleanup-29663880-8m5rd\" (UID: \"b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6\") " pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd"
May 26 22:00:00.295959 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.295919    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdtr\" (UniqueName: \"kubernetes.io/projected/b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6-kube-api-access-7fdtr\") pod \"maas-api-key-cleanup-29663880-8m5rd\" (UID: \"b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6\") " pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd"
May 26 22:00:00.305519 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.305486    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fdtr\" (UniqueName: \"kubernetes.io/projected/b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6-kube-api-access-7fdtr\") pod \"maas-api-key-cleanup-29663880-8m5rd\" (UID: \"b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6\") " pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd"
May 26 22:00:00.458933 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.458854    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd"
May 26 22:00:00.585881 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.585837    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663880-8m5rd"]
May 26 22:00:00.589467 ip-10-0-140-172 kubenswrapper[2555]: W0526 22:00:00.589441    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ae8e2a_8377_453a_b719_7d7cd5a1a1a6.slice/crio-c96db5dbfcb8e37660ee60fcb71e720637e0f84f9337b181503777da5716711d WatchSource:0}: Error finding container c96db5dbfcb8e37660ee60fcb71e720637e0f84f9337b181503777da5716711d: Status 404 returned error can't find the container with id c96db5dbfcb8e37660ee60fcb71e720637e0f84f9337b181503777da5716711d
May 26 22:00:00.896143 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:00.896108    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd" event={"ID":"b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6","Type":"ContainerStarted","Data":"c96db5dbfcb8e37660ee60fcb71e720637e0f84f9337b181503777da5716711d"}
May 26 22:00:13.944254 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:13.944167    2555 generic.go:358] "Generic (PLEG): container finished" podID="b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6" containerID="f1bbde86485463c18df75bf0363413b4aab55e2b31677522f8121aa53c9567f4" exitCode=0
May 26 22:00:13.944254 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:13.944245    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd" event={"ID":"b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6","Type":"ContainerDied","Data":"f1bbde86485463c18df75bf0363413b4aab55e2b31677522f8121aa53c9567f4"}
May 26 22:00:15.073818 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:15.073531    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd"
May 26 22:00:15.112066 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:15.112043    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fdtr\" (UniqueName: \"kubernetes.io/projected/b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6-kube-api-access-7fdtr\") pod \"b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6\" (UID: \"b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6\") "
May 26 22:00:15.114248 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:15.114220    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6-kube-api-access-7fdtr" (OuterVolumeSpecName: "kube-api-access-7fdtr") pod "b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6" (UID: "b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6"). InnerVolumeSpecName "kube-api-access-7fdtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 22:00:15.212856 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:15.212762    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fdtr\" (UniqueName: \"kubernetes.io/projected/b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6-kube-api-access-7fdtr\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 22:00:15.951722 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:15.951687    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd" event={"ID":"b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6","Type":"ContainerDied","Data":"c96db5dbfcb8e37660ee60fcb71e720637e0f84f9337b181503777da5716711d"}
May 26 22:00:15.951722 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:15.951722    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c96db5dbfcb8e37660ee60fcb71e720637e0f84f9337b181503777da5716711d"
May 26 22:00:15.951722 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:00:15.951700    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663880-8m5rd"
May 26 22:15:00.155281 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.155243    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663895-4ckht"]
May 26 22:15:00.155714 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.155535    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6" containerName="cleanup"
May 26 22:15:00.155714 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.155546    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6" containerName="cleanup"
May 26 22:15:00.155714 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.155598    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6" containerName="cleanup"
May 26 22:15:00.158475 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.158458    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663895-4ckht"
May 26 22:15:00.160837 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.160817    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ndlt2\""
May 26 22:15:00.172679 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.172653    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663895-4ckht"]
May 26 22:15:00.269986 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.269952    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hzkf\" (UniqueName: \"kubernetes.io/projected/d7194ea4-ad51-47cb-ac53-1e433450b3cf-kube-api-access-5hzkf\") pod \"maas-api-key-cleanup-29663895-4ckht\" (UID: \"d7194ea4-ad51-47cb-ac53-1e433450b3cf\") " pod="opendatahub/maas-api-key-cleanup-29663895-4ckht"
May 26 22:15:00.370327 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.370296    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzkf\" (UniqueName: \"kubernetes.io/projected/d7194ea4-ad51-47cb-ac53-1e433450b3cf-kube-api-access-5hzkf\") pod \"maas-api-key-cleanup-29663895-4ckht\" (UID: \"d7194ea4-ad51-47cb-ac53-1e433450b3cf\") " pod="opendatahub/maas-api-key-cleanup-29663895-4ckht"
May 26 22:15:00.378403 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.378369    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzkf\" (UniqueName: \"kubernetes.io/projected/d7194ea4-ad51-47cb-ac53-1e433450b3cf-kube-api-access-5hzkf\") pod \"maas-api-key-cleanup-29663895-4ckht\" (UID: \"d7194ea4-ad51-47cb-ac53-1e433450b3cf\") " pod="opendatahub/maas-api-key-cleanup-29663895-4ckht"
May 26 22:15:00.468489 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.468406    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663895-4ckht"
May 26 22:15:00.592878 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.592853    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663895-4ckht"]
May 26 22:15:00.595825 ip-10-0-140-172 kubenswrapper[2555]: W0526 22:15:00.595770    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7194ea4_ad51_47cb_ac53_1e433450b3cf.slice/crio-b02095baaed9e8b9815efadfc42bf45b9e2ae825bed6537dda41097d13b6e42f WatchSource:0}: Error finding container b02095baaed9e8b9815efadfc42bf45b9e2ae825bed6537dda41097d13b6e42f: Status 404 returned error can't find the container with id b02095baaed9e8b9815efadfc42bf45b9e2ae825bed6537dda41097d13b6e42f
May 26 22:15:00.597585 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.597564    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 22:15:00.772752 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:00.772653    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663895-4ckht" event={"ID":"d7194ea4-ad51-47cb-ac53-1e433450b3cf","Type":"ContainerStarted","Data":"b02095baaed9e8b9815efadfc42bf45b9e2ae825bed6537dda41097d13b6e42f"}
May 26 22:15:01.778031 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:01.777941    2555 generic.go:358] "Generic (PLEG): container finished" podID="d7194ea4-ad51-47cb-ac53-1e433450b3cf" containerID="7db14f1fdd4951b935d3bc9e171dc23b4366d6bb650f9da6697658884e230483" exitCode=0
May 26 22:15:01.778371 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:01.778023    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663895-4ckht" event={"ID":"d7194ea4-ad51-47cb-ac53-1e433450b3cf","Type":"ContainerDied","Data":"7db14f1fdd4951b935d3bc9e171dc23b4366d6bb650f9da6697658884e230483"}
May 26 22:15:02.904134 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:02.904112    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663895-4ckht"
May 26 22:15:02.988525 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:02.988498    2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hzkf\" (UniqueName: \"kubernetes.io/projected/d7194ea4-ad51-47cb-ac53-1e433450b3cf-kube-api-access-5hzkf\") pod \"d7194ea4-ad51-47cb-ac53-1e433450b3cf\" (UID: \"d7194ea4-ad51-47cb-ac53-1e433450b3cf\") "
May 26 22:15:02.990515 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:02.990490    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7194ea4-ad51-47cb-ac53-1e433450b3cf-kube-api-access-5hzkf" (OuterVolumeSpecName: "kube-api-access-5hzkf") pod "d7194ea4-ad51-47cb-ac53-1e433450b3cf" (UID: "d7194ea4-ad51-47cb-ac53-1e433450b3cf"). InnerVolumeSpecName "kube-api-access-5hzkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 22:15:03.089472 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:03.089396    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hzkf\" (UniqueName: \"kubernetes.io/projected/d7194ea4-ad51-47cb-ac53-1e433450b3cf-kube-api-access-5hzkf\") on node \"ip-10-0-140-172.ec2.internal\" DevicePath \"\""
May 26 22:15:03.786233 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:03.786202    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663895-4ckht" event={"ID":"d7194ea4-ad51-47cb-ac53-1e433450b3cf","Type":"ContainerDied","Data":"b02095baaed9e8b9815efadfc42bf45b9e2ae825bed6537dda41097d13b6e42f"}
May 26 22:15:03.786233 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:03.786228    2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663895-4ckht"
May 26 22:15:03.786233 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:15:03.786235    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b02095baaed9e8b9815efadfc42bf45b9e2ae825bed6537dda41097d13b6e42f"
May 26 22:19:26.663126 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:26.663088    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8644d4cd5c-fb8vt_f3888013-6f8c-49bf-b093-00ab89bde14d/authorino/0.log"
May 26 22:19:31.366156 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:31.366119    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663880-8m5rd_b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6/cleanup/0.log"
May 26 22:19:31.474373 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:31.474347    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663895-4ckht_d7194ea4-ad51-47cb-ac53-1e433450b3cf/cleanup/0.log"
May 26 22:19:31.827434 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:31.827354    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58ddc889d6-dvmkv_843e48eb-8497-4fcd-9d9e-19552624e895/manager/0.log"
May 26 22:19:33.456911 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:33.454822    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8644d4cd5c-fb8vt_f3888013-6f8c-49bf-b093-00ab89bde14d/authorino/0.log"
May 26 22:19:33.577566 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:33.577534    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-tg58g_46826bf5-ab4f-4667-a7ba-6be7e15b52d4/manager/0.log"
May 26 22:19:33.932654 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:33.932623    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k5gcp_bc60fe3a-a46f-4249-87e0-f3a95185e64f/registry-server/0.log"
May 26 22:19:34.313126 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:34.313049    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-fhgd5_f085aab4-2a80-4dd1-b56f-886e3ed89fd2/manager/0.log"
May 26 22:19:34.656282 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:34.656250    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8gvlkc_0178fd6b-2050-49c5-b544-e4a6e07b7650/istio-proxy/0.log"
May 26 22:19:35.705964 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:35.705936    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh_5132d895-a797-4f27-afce-08b1398fb1df/main/0.log"
May 26 22:19:35.713057 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:35.713004    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-njrhh_5132d895-a797-4f27-afce-08b1398fb1df/storage-initializer/0.log"
May 26 22:19:35.825314 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:35.825279    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m_a4fe240c-d6bc-470a-9efe-7fd63f6f6754/storage-initializer/0.log"
May 26 22:19:35.834010 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:35.833980    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-ltw2m_a4fe240c-d6bc-470a-9efe-7fd63f6f6754/main/0.log"
May 26 22:19:36.295583 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:36.295550    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-crv9h_dbad96da-fad4-440b-ad2a-754a83caf95f/storage-initializer/0.log"
May 26 22:19:36.303892 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:36.303867    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-crv9h_dbad96da-fad4-440b-ad2a-754a83caf95f/main/0.log"
May 26 22:19:43.392316 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:43.392289    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9d89z_682d0998-1e7b-4e5f-ac59-08a8addc2652/global-pull-secret-syncer/0.log"
May 26 22:19:43.600350 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:43.600305    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9lgfv_f94aabbd-91e7-496f-ba8c-91c5e75b65a2/konnectivity-agent/0.log"
May 26 22:19:43.665550 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:43.665466    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-172.ec2.internal_956416fc4c5f5837bf8911f355eda4b7/haproxy/0.log"
May 26 22:19:48.266657 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:48.266615    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8644d4cd5c-fb8vt_f3888013-6f8c-49bf-b093-00ab89bde14d/authorino/0.log"
May 26 22:19:48.297256 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:48.297216    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-tg58g_46826bf5-ab4f-4667-a7ba-6be7e15b52d4/manager/0.log"
May 26 22:19:48.391156 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:48.391127    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k5gcp_bc60fe3a-a46f-4249-87e0-f3a95185e64f/registry-server/0.log"
May 26 22:19:48.565918 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:48.565831    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-fhgd5_f085aab4-2a80-4dd1-b56f-886e3ed89fd2/manager/0.log"
May 26 22:19:50.492606 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:50.492575    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g9h8k_94e69c09-d976-41ff-ba97-c136515fa15d/node-exporter/0.log"
May 26 22:19:50.512967 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:50.512946    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g9h8k_94e69c09-d976-41ff-ba97-c136515fa15d/kube-rbac-proxy/0.log"
May 26 22:19:50.533301 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:50.533285    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g9h8k_94e69c09-d976-41ff-ba97-c136515fa15d/init-textfile/0.log"
May 26 22:19:52.101581 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.101550    2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"]
May 26 22:19:52.101969 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.101855    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7194ea4-ad51-47cb-ac53-1e433450b3cf" containerName="cleanup"
May 26 22:19:52.101969 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.101867    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7194ea4-ad51-47cb-ac53-1e433450b3cf" containerName="cleanup"
May 26 22:19:52.101969 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.101931    2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7194ea4-ad51-47cb-ac53-1e433450b3cf" containerName="cleanup"
May 26 22:19:52.103918 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.103898    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.106040 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.106020    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fhwx9\"/\"kube-root-ca.crt\""
May 26 22:19:52.106845 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.106827    2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fhwx9\"/\"default-dockercfg-42src\""
May 26 22:19:52.106913 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.106827    2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fhwx9\"/\"openshift-service-ca.crt\""
May 26 22:19:52.113827 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.113804    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"]
May 26 22:19:52.215827 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.215771    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-mnjkw_6a05e282-0bcd-469e-b857-46a800cd3e33/networking-console-plugin/0.log"
May 26 22:19:52.245688 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.245659    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ncmv\" (UniqueName: \"kubernetes.io/projected/08a00279-b30d-494d-9c53-a58679e21f23-kube-api-access-8ncmv\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.245688 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.245690    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-proc\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.245943 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.245716    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-lib-modules\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.245943 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.245741    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-podres\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.245943 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.245854    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-sys\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.346871 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.346832    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-sys\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.347042 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.346896    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ncmv\" (UniqueName: \"kubernetes.io/projected/08a00279-b30d-494d-9c53-a58679e21f23-kube-api-access-8ncmv\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.347042 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.346920    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-proc\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.347042 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.346944    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-lib-modules\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.347042 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.346951    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-sys\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.347042 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.346972    2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-podres\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.347223 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.347049    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-proc\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.347223 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.347084    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-lib-modules\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.347223 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.347088    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08a00279-b30d-494d-9c53-a58679e21f23-podres\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.355288 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.355228    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ncmv\" (UniqueName: \"kubernetes.io/projected/08a00279-b30d-494d-9c53-a58679e21f23-kube-api-access-8ncmv\") pod \"perf-node-gather-daemonset-2ml4m\" (UID: \"08a00279-b30d-494d-9c53-a58679e21f23\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.414758 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.414730    2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.541954 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.541921    2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"]
May 26 22:19:52.546795 ip-10-0-140-172 kubenswrapper[2555]: W0526 22:19:52.546756    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod08a00279_b30d_494d_9c53_a58679e21f23.slice/crio-cab922f718f4d0370079245bc7b5bc60b47c86358c5a729e9babef501abfbf96 WatchSource:0}: Error finding container cab922f718f4d0370079245bc7b5bc60b47c86358c5a729e9babef501abfbf96: Status 404 returned error can't find the container with id cab922f718f4d0370079245bc7b5bc60b47c86358c5a729e9babef501abfbf96
May 26 22:19:52.706954 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.706862    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m" event={"ID":"08a00279-b30d-494d-9c53-a58679e21f23","Type":"ContainerStarted","Data":"ac2de8d0426ab5286b10d5720b1906c52fd7e5fe4b193955138aeb87b90224ee"}
May 26 22:19:52.706954 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.706906    2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m" event={"ID":"08a00279-b30d-494d-9c53-a58679e21f23","Type":"ContainerStarted","Data":"cab922f718f4d0370079245bc7b5bc60b47c86358c5a729e9babef501abfbf96"}
May 26 22:19:52.706954 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.706940    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:52.720761 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:52.720712    2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m" podStartSLOduration=0.720695854 podStartE2EDuration="720.695854ms" podCreationTimestamp="2026-05-26 22:19:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 22:19:52.720144379 +0000 UTC m=+2105.191373041" watchObservedRunningTime="2026-05-26 22:19:52.720695854 +0000 UTC m=+2105.191924518"
May 26 22:19:54.595008 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:54.594974    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6prn2_c84ee120-332c-4146-bcfc-c9936d452b5e/dns/0.log"
May 26 22:19:54.618691 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:54.618662    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6prn2_c84ee120-332c-4146-bcfc-c9936d452b5e/kube-rbac-proxy/0.log"
May 26 22:19:54.732215 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:54.732184    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lrpn5_2bedbab1-b03a-4449-9f46-1e8ff5fa26ea/dns-node-resolver/0.log"
May 26 22:19:55.303473 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:55.303446    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z8x82_fd64cdb9-323e-45e7-90b7-dce5d0bbba90/node-ca/0.log"
May 26 22:19:56.101472 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:56.101442    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8gvlkc_0178fd6b-2050-49c5-b544-e4a6e07b7650/istio-proxy/0.log"
May 26 22:19:56.940975 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:56.940943    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j6kzz_7f055d13-27ca-4f6f-9a34-bca0e9019972/serve-healthcheck-canary/0.log"
May 26 22:19:57.568957 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:57.568926    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rsmk9_ac609b15-0d1d-41a1-82cf-3440fad6b48a/kube-rbac-proxy/0.log"
May 26 22:19:57.593970 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:57.593944    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rsmk9_ac609b15-0d1d-41a1-82cf-3440fad6b48a/exporter/0.log"
May 26 22:19:57.616267 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:57.616245    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rsmk9_ac609b15-0d1d-41a1-82cf-3440fad6b48a/extractor/0.log"
May 26 22:19:58.719176 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:58.719147    2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-2ml4m"
May 26 22:19:59.511242 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:59.511215    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663880-8m5rd_b5ae8e2a-8377-453a-b719-7d7cd5a1a1a6/cleanup/0.log"
May 26 22:19:59.534375 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:59.534348    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663895-4ckht_d7194ea4-ad51-47cb-ac53-1e433450b3cf/cleanup/0.log"
May 26 22:19:59.709050 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:19:59.709016    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58ddc889d6-dvmkv_843e48eb-8497-4fcd-9d9e-19552624e895/manager/0.log"
May 26 22:20:01.047458 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:01.047376    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79df896c85-spdp9_2363f636-5915-4162-9236-cd6188955839/manager/0.log"
May 26 22:20:07.012824 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.012797    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llsb5_d03c3de9-2085-4370-bac2-f91be20e9bee/kube-multus-additional-cni-plugins/0.log"
May 26 22:20:07.033725 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.033700    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llsb5_d03c3de9-2085-4370-bac2-f91be20e9bee/egress-router-binary-copy/0.log"
May 26 22:20:07.055617 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.055592    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llsb5_d03c3de9-2085-4370-bac2-f91be20e9bee/cni-plugins/0.log"
May 26 22:20:07.081913 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.081892    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llsb5_d03c3de9-2085-4370-bac2-f91be20e9bee/bond-cni-plugin/0.log"
May 26 22:20:07.106175 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.106149    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llsb5_d03c3de9-2085-4370-bac2-f91be20e9bee/routeoverride-cni/0.log"
May 26 22:20:07.132244 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.132225    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llsb5_d03c3de9-2085-4370-bac2-f91be20e9bee/whereabouts-cni-bincopy/0.log"
May 26 22:20:07.158382 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.158356    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llsb5_d03c3de9-2085-4370-bac2-f91be20e9bee/whereabouts-cni/0.log"
May 26 22:20:07.355563 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.355531    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jq92z_5ea3ce4c-4326-4a27-b660-bfba85954044/kube-multus/0.log"
May 26 22:20:07.376136 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.376113    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2hnq5_6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8/network-metrics-daemon/0.log"
May 26 22:20:07.398477 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:07.398456    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2hnq5_6c8f2549-f2f8-44bb-bb3c-05605d0f8bf8/kube-rbac-proxy/0.log"
May 26 22:20:08.313707 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:08.313673    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66skj_76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c/ovn-controller/0.log"
May 26 22:20:08.350681 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:08.350650    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66skj_76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c/ovn-acl-logging/0.log"
May 26 22:20:08.374472 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:08.374443    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66skj_76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c/kube-rbac-proxy-node/0.log"
May 26 22:20:08.397493 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:08.397469    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66skj_76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c/kube-rbac-proxy-ovn-metrics/0.log"
May 26 22:20:08.413847 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:08.413826    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66skj_76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c/northd/0.log"
May 26 22:20:08.434596 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:08.434572    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66skj_76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c/nbdb/0.log"
May 26 22:20:08.456536 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:08.456513    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66skj_76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c/sbdb/0.log"
May 26 22:20:08.618172 ip-10-0-140-172 kubenswrapper[2555]: I0526 22:20:08.618136    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66skj_76b7a5f0-8a6e-408d-a94b-54fbfcfbfe5c/ovnkube-controller/0.log"